Creating and exploiting multimodal annotated corpora: the ToMA project
Multimodal corpora
Audio-visual prosody: perception, detection, and synthesis of prominence
Proceedings of the Third COST 2102 international training school conference on Toward autonomous, adaptive, and context-aware multimodal interfaces: theoretical and practical issues
Guest Editorial: Gesture and speech in interaction: An overview
Speech Communication
Hi-index | 0.00 |
This study aims at examining the links between marked structures in the syntactic and prosodic domains (fronting and focal accent), and the way the two types of contrast can be reinforced by gestures. It was conducted on a corpus of 1h30 of spoken French, involving three pairs of speakers in dialogues. Results show that although the tendency is for marked constructions both in syntax and prosody not to be reinforced by gestures, there is still a higher proportion of gesture reinforcing with prosodic marking than with syntactic fronting. The paper describes which eyebrow and head movements as well as hand gestures are more liable to accompany the two operations. Beyond these findings, the study gives an insight into the current models proposed in the literature for gesture-speech production.