Detecting cognitive presence in online learning environments helps understand and enhance educational interactions in online discussions. However, the lack of annotated data and class imbalance challenges building accurate machine-learning models for this task. This study explores the impact of oversampling techniques using GPT-4 and BERT for the automatic classification of cognitive presence in online discussion, aiming to address data scarcity and improve model generalization. We found that oversampling enhances classification accuracy and Cohen’s Kappa, reaching up to 0.59 and 0.40, respectively, for a small sample of the original dataset. These results highlight the potential of recent oversampling methods in improving the detection of cognitive presence, informing future research and practical applications in online education.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Impact of Oversampling Techniques on the Detection of Cognitive Presence

  • Vitor Rolim,
  • Cleon Xavier,
  • Luiz Rodrigues,
  • Newarney Costa,
  • Rafael Lins,
  • Dragan Gašević,
  • Rafael Mello

摘要

Detecting cognitive presence in online learning environments helps understand and enhance educational interactions in online discussions. However, the lack of annotated data and class imbalance challenges building accurate machine-learning models for this task. This study explores the impact of oversampling techniques using GPT-4 and BERT for the automatic classification of cognitive presence in online discussion, aiming to address data scarcity and improve model generalization. We found that oversampling enhances classification accuracy and Cohen’s Kappa, reaching up to 0.59 and 0.40, respectively, for a small sample of the original dataset. These results highlight the potential of recent oversampling methods in improving the detection of cognitive presence, informing future research and practical applications in online education.