Understanding socially shared regulated learning (SSRL) in collaborative problem-solving (CPS) is vital for fostering effective group learning and improving educational outcomes. In CPS, team members regulate cognition, metacognition, emotion, and behavior together, with this study specifically targeting socially shared metacognitive regulation (SSMR). Conducted over a 12-week Human-Computer Interaction course with 15 participants, the study focused on automating the identification of SSMR triggers during CPS. Currently, identifying these triggers through verbal interactions is a manual and challenging process. In this study, the speaker diarization method was used to identify the speaker, success-fully detecting speakers in most cases. Following this, a machine learning (ML) model was employed to identify the triggers of SSMR episodes from the transcribed data. By synthesizing understanding from SSMR literature and conducting a preliminary data analysis, criteria were developed to identify triggers of SSMR episodes. The ML model identified 1,396 triggers by analyzing 21,256 turns taken by learners from four teams. To further validate the ML model’s findings, a manual verification process was conducted on a 25% sample of the identified triggers. Manual validation indicated a moderate level of reliability in the automated identification process. The findings suggest that the criteria for identifying triggers are important and that the automated approach has the potential to streamline the process of identifying triggers from teams’ verbal interactions. The automatic identification of SSMR triggers shows promise in reducing the manual data analysis workload in SSMR research.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Unlocking the Triggers: Automating the Identification of Triggers of Socially Shared Metacognitive Regulation in Collaborative Problem-Solving

  • N.V.J.K Kartik,
  • Priyesh Gupta,
  • Vinayak,
  • Aarsh Desai,
  • Vishwas Badhe,
  • T S Ashwin,
  • Manjunath Vanahalli,
  • Ramkumar Rajendran

摘要

Understanding socially shared regulated learning (SSRL) in collaborative problem-solving (CPS) is vital for fostering effective group learning and improving educational outcomes. In CPS, team members regulate cognition, metacognition, emotion, and behavior together, with this study specifically targeting socially shared metacognitive regulation (SSMR). Conducted over a 12-week Human-Computer Interaction course with 15 participants, the study focused on automating the identification of SSMR triggers during CPS. Currently, identifying these triggers through verbal interactions is a manual and challenging process. In this study, the speaker diarization method was used to identify the speaker, success-fully detecting speakers in most cases. Following this, a machine learning (ML) model was employed to identify the triggers of SSMR episodes from the transcribed data. By synthesizing understanding from SSMR literature and conducting a preliminary data analysis, criteria were developed to identify triggers of SSMR episodes. The ML model identified 1,396 triggers by analyzing 21,256 turns taken by learners from four teams. To further validate the ML model’s findings, a manual verification process was conducted on a 25% sample of the identified triggers. Manual validation indicated a moderate level of reliability in the automated identification process. The findings suggest that the criteria for identifying triggers are important and that the automated approach has the potential to streamline the process of identifying triggers from teams’ verbal interactions. The automatic identification of SSMR triggers shows promise in reducing the manual data analysis workload in SSMR research.