Assessment of Effectiveness of Emotion Perception through Music, Visual and Multimedia Stimuli
摘要
According to some research, combining audio-visual can enhance the emotion perception compared to only audio and video stimuli. Congruent audio-video multimedia leads to faster identification of emotions. However, research that attempts to examine the relation between moving images and music, especially in terms of congruent and incongruent conditions, is an area of neglect. The purpose of the study was to investigate the individual and combined effect (congruent and incongruent combinations) of audio and visual counterparts of movie clips on emotion perception. In this study, two pairs of contrasting clips (here, happy-sad) from Charlie Chaplin movie clips of 15 second duration were chosen. For experimental purpose, different types of audio-video combinations were created. The nature of integration was either congruent or incongruent. Original audio from the clips were removed and independent music clips both congruent and incongruent, were used to nullify the effect of exposure bias to original sound-tracks. Using these combinations, an audience response survey was conducted on four groups of participants (N=80), where visually and musically untrained participants were exposed to audio only, video only and multimedia clips in random order. Relevant responses were collected on a 5 point Likert scale. The study suggested that congruent condition was more effective than the incongruent condition for emotion perception. However, while for one congruent condition, emotion intensity perceived was higher than both audio and video clips, as hypothesized, in the other condition this was not the case. Further exploration is required to identify this variation.