How to provide automated feedback on the writing process? A participatory approach to design writing analytics tools

Conijn, R (通讯作者),Eindhoven Univ Technol, POB 513, NL-5600 MB Eindhoven, Netherlands.
2022-11-2
Current writing support tools tend to focus on assessing final or intermediate products, rather than the writing process. However, sensing technologies, such as keystroke logging, can enable provision of automated feedback during, and on aspects of, the writing process. Despite this potential, little is known about the critical indicators that can be used to effectively provide this feedback. This article proposes a participatory approach to identify the indicators of students' writing processes that are meaningful for educational stakeholders and that can be considered in the design of future systems to provide automated, personalized feedback. This approach is illustrated through a qualitative research design that included five participatory sessions with five distinct groups of stakeholders: bachelor and postgraduate students, teachers, writing specialists, and professional development staff. Results illustrate the value of the proposed approach, showing that students were especially interested in lower-level behavioral indicators, while the other stakeholders focused on higher-order cognitive and pedagogical constructs. These findings lay the groundwork for future work in extracting these higher-level indicators from in-depth analysis of writing processes. In addition, differences in terminology and the levels at which the indicators were discussed, highlight the need for human-centered, participatory approaches to design and develop writing analytics tools.
COMPUTER ASSISTED LANGUAGE LEARNING
卷号:35|期号:8|页码:1838-1868
ISSN:0958-8221|收录类别:SSCI
语种
英语
来源机构
Tilburg University; University of Antwerp; Monash University; University of Technology Sydney; University of Technology Sydney; North West University - South Africa
资助机构
Australia Awards Endeavour Research Fellowship(Australian GovernmentDepartment of Industry, Innovation and Science)
资助信息
This work was supported by the Australia Awards Endeavour Research Fellowship.
被引频次(WOS)
9
被引频次(其他)
9
180天使用计数
12
2013以来使用计数
41
EISSN
1744-3210
出版年
2022-11-2
DOI
10.1080/09588221.2020.1839503
学科领域
循证教育学
关键词
Feedback learning analytics participatory consultation writing process writing tools
WOS学科分类
Education & Educational Research Linguistics Language & Linguistics