Type-logical semantics
French Sign Language: Proposition of a Structural Explanation by Iconicity
GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Handbook of Spatial Logics
On factoring out a gesture typology from the Bielefeld speech-and-gesture-alignment corpus (SAGA)
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
| Hi-index | 0.00 |
The paper presents a formal framework to model the fusion of gesture meaning with the meaning of the co-occurring verbal fragment. The framework is based on the formalization of two simple concepts, intersectivity and iconicity, which form the core of most descriptive accounts of the interaction of the two modalities. The formalization is presented as an extension of a well-known framework for the analysis of meaning in natural language. We claim that a proper formalization of these two concepts is sufficient to provide a principled explanation of gestures accompanying different types of linguistic expressions. The formalization also aims at providing a general mechanism (iconicity) by which the meaning of gestures is extracted from their formal appearance.