Social pain refers to the negative emotional experiences individuals encounter during social interactions, such as misunderstanding, isolation, or rejection. If unresolved, these experiences can profoundly impact mental health. This study investigates children’s challenges in recognizing and expressing social pain, aiming to explore its components and triggers while providing insights for future scenario design and effective research. The study examines six typical social pain scenarios (low contribution, misunderstanding, rejection, helplessness, unfairness, and betrayal) through a two-stage experiment to systematically analyze the effects of emotional stimuli on emotion recognition and induction. In the first stage, four types of emotional stimuli were developed based on scripted scenarios: (1) facial expressions, (2) text descriptions of interactive scenario, (3) third-person narrative stories, and (4) multimodal integrated complete scripts. These stimuli were progressively layered, increasing the amount of emotional information. Nine participants sequentially observed the stimuli and assessed their emotional responses and recognition accuracy using subjective scales. The results showed a significant improvement in recognition rates with the accumulation of information. Facial expressions alone resulted in an average accuracy of 20.35%, while multimodal integrated complete scripts achieved the highest accuracy at 68.55%. The second stage tested the emotional induction and resonance effects of the multimodal integrated complete scripts, which demonstrated the best recognition performance in the first stage. Using AI-generated representations of six social pain scenarios, nine participants evaluated the emotional resonance of each scenario using subjective scales. The results indicated that the scenarios of helplessness and betrayal evoked the strongest emotional resonance (both scoring 4.11), while unfairness scored the lowest (2.78). Scenarios with strong emotional conflict and clear induction cues were more effective in enhancing emotional resonance. This study underscores the superiority of multimodal integrated complete scripts in emotional transmission and recognition, as well as the influence of multimodal stimuli on scenario validity and emotional induction. These findings offer a valuable foundation for designing mental health tools and simulating social pain scenarios, suggesting new directions for applying multimodal technology in effective education and interventions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Effect of Multimodal Emotional Stimuli on Social Pain Scenarios and Emotional Resonance

  • Ting-Yu Wu,
  • I-Jui Lee

摘要

Social pain refers to the negative emotional experiences individuals encounter during social interactions, such as misunderstanding, isolation, or rejection. If unresolved, these experiences can profoundly impact mental health. This study investigates children’s challenges in recognizing and expressing social pain, aiming to explore its components and triggers while providing insights for future scenario design and effective research. The study examines six typical social pain scenarios (low contribution, misunderstanding, rejection, helplessness, unfairness, and betrayal) through a two-stage experiment to systematically analyze the effects of emotional stimuli on emotion recognition and induction. In the first stage, four types of emotional stimuli were developed based on scripted scenarios: (1) facial expressions, (2) text descriptions of interactive scenario, (3) third-person narrative stories, and (4) multimodal integrated complete scripts. These stimuli were progressively layered, increasing the amount of emotional information. Nine participants sequentially observed the stimuli and assessed their emotional responses and recognition accuracy using subjective scales. The results showed a significant improvement in recognition rates with the accumulation of information. Facial expressions alone resulted in an average accuracy of 20.35%, while multimodal integrated complete scripts achieved the highest accuracy at 68.55%. The second stage tested the emotional induction and resonance effects of the multimodal integrated complete scripts, which demonstrated the best recognition performance in the first stage. Using AI-generated representations of six social pain scenarios, nine participants evaluated the emotional resonance of each scenario using subjective scales. The results indicated that the scenarios of helplessness and betrayal evoked the strongest emotional resonance (both scoring 4.11), while unfairness scored the lowest (2.78). Scenarios with strong emotional conflict and clear induction cues were more effective in enhancing emotional resonance. This study underscores the superiority of multimodal integrated complete scripts in emotional transmission and recognition, as well as the influence of multimodal stimuli on scenario validity and emotional induction. These findings offer a valuable foundation for designing mental health tools and simulating social pain scenarios, suggesting new directions for applying multimodal technology in effective education and interventions.