<p>As video-based learning becomes increasingly ubiquitous, understanding how video cues impact learner’s deep cognitive engagement is critical. However, little is known about the nuanced, interactive effects of instructor’s vocal and visual signals in this context. Drawing on Emotions as Social Information (EASI) theory and social presence theory, this study investigates how instructors’ vocal cues (pitch level, intensity level, pitch variability, and intensity variability) exhibit curvilinear associations with learners’ deep cognitive engagement, and how instructor presence moderates these relationships. By analyzing 40,742 observations from the major video platform Bilibili, we reveal that pitch level, pitch variability, and intensity variability demonstrate inverted U-shaped associations with deep cognitive engagement, suggesting an optimal “sweet spot” of vocal expressiveness. In contrast, intensity level shows a U-shaped association. Crucially, instructor presence strengthens all these curvilinear associations, amplifying both their beneficial and detrimental sides. Our study advances research on cognitive engagement by providing multimodal evidence on how audio–visual cues jointly relate to deep cognitive engagement in video-based learning, and it offers actionable guidance for creators on regulating vocal delivery and visual presence in instructional videos.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Striking the right chord: how vocal and visual cues shape learners’ deep cognitive engagement in video-based learning

  • Ling Wang,
  • Zhao Pan,
  • Bin Wang

摘要

As video-based learning becomes increasingly ubiquitous, understanding how video cues impact learner’s deep cognitive engagement is critical. However, little is known about the nuanced, interactive effects of instructor’s vocal and visual signals in this context. Drawing on Emotions as Social Information (EASI) theory and social presence theory, this study investigates how instructors’ vocal cues (pitch level, intensity level, pitch variability, and intensity variability) exhibit curvilinear associations with learners’ deep cognitive engagement, and how instructor presence moderates these relationships. By analyzing 40,742 observations from the major video platform Bilibili, we reveal that pitch level, pitch variability, and intensity variability demonstrate inverted U-shaped associations with deep cognitive engagement, suggesting an optimal “sweet spot” of vocal expressiveness. In contrast, intensity level shows a U-shaped association. Crucially, instructor presence strengthens all these curvilinear associations, amplifying both their beneficial and detrimental sides. Our study advances research on cognitive engagement by providing multimodal evidence on how audio–visual cues jointly relate to deep cognitive engagement in video-based learning, and it offers actionable guidance for creators on regulating vocal delivery and visual presence in instructional videos.