Timing and Synchronization of Multimodal Signals in Explanations
摘要
Real-life explanations tend to be exchanged multimodally, and their expression needs to take into account the adequate sequencing and synchronization of the various modalities involved including speech, melodic/rhythmic structure and highlighting (aka prosody), manual gestures, head gestures, facial expressions, or posture changes, both within and between conversational partners. Whereas empirical research has not yet unfolded all details behind cross-modal synchronization, we know that a certain amount of it is a prerequisite for cross-modal signals to be integrated meaningfully, to increase the robustness of communication, to indicate the processing of an explanation, and to negotiate the seamless exchange of thoughts.