A Script for Conversational Reflection Guidance: A Field Study on Developing Reflection Competence With Apprentices

Wolfbauer, I (通讯作者),Know Ctr GmbH, A-8010 Graz, Austria.
2022-10-1
We present a script for conversational reflection guidance embedded in reflective practice. Rebo Junior, a nonadaptive conversational agent, was evaluated in a 12-week field study with apprentices. We analyzed apprentices' interactions with Rebo Junior in terms of reflectivity and measured the development of their reflection competence via reflective essays at three points in time during the field study. Reflection competence, a key competency for lifelong professional learning, becomes significantly higher by the third essay after repeated interactions with Rebo Junior (paired samples t-test t(13) = 3.00, p = 0.010 from Essay 1 to Essay 3). However, we also observed a significant decrease in reflectivity in the Rebo Junior interactions over time (paired samples t-test between the first and eighth interaction: t(7) = 2.50, p = 0.041). We attribute this decline to 1) the novelty of Rebo Junior wearing off (novelty effect) and 2) the apprentices learning the script and experiencing subsequent frustration due to the script not fading over time. Overall, this work 1) informs future design through the observation of consistent decreases in engagement over eight interactions with static scaffolding, 2) contributes a reflection script applicable for reflection on tasks that resemble future expected work tasks, a typical setting in lifelong professional learning, and 3) indicates increased reflection competence after repeated reflection guided by a conversational agent.
IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES
卷号:15|期号:5|页码:554-566
ISSN:1939-1382|收录类别:SCIE
语种
英语
来源机构
Graz University of Technology; Carnegie Mellon University
资助信息
This work was supported in part by the WKO, within the Austrian COMET Program-Competence Centers for Excellent Technologies-under the auspices of the Austrian Federal Ministry of Transport, Innovation and Technology, the Austrian Federal Ministry of Economy, Family and Youth, and by the State of Styria. COMET is managed by the Austrian Research Promotion Agency FFG, and in part by NSF under Grants IIS 1822831, 2100401, and 1917955.
被引频次(WOS)
0
被引频次(其他)
0
180天使用计数
3
2013以来使用计数
3
出版年
2022-10-1
DOI
10.1109/TLT.2022.3207226
学科领域
循证教育学
关键词
Reflection Task analysis Employment Human computer interaction Engineering profession Reflectivity Metals Adaptive and intelligent educational systems educational conversational agent interventionist field study reflection guidance vocational training
资助机构
WKO, within the Austrian COMET Program-Competence Centers for Excellent Technologies-under the Austrian Federal Ministry of Transport, Innovation and Technology Austrian Federal Ministry of Economy, Family and Youth State of Styria NSF(National Science Foundation (NSF))
WOS学科分类
Computer Science, Interdisciplinary Applications Education & Educational Research