The logic of typed feature structures
The logic of typed feature structures
A formal framework for linguistic annotation
Speech Communication - Special issue on speech annotation and corpus tools
A model for multimodal reference resolution
Computational Linguistics
IJCAI'85 Proceedings of the 9th international joint conference on Artificial intelligence - Volume 1
GrAF: a graph-based format for linguistic annotations
LAW '07 Proceedings of the Linguistic Annotation Workshop
Standoff coordination for multi-tool annotation in a dialogue corpus
LAW '07 Proceedings of the Linguistic Annotation Workshop
Bridging the gaps: interoperability for GrAF, GATE, and UIMA
ACL-IJCNLP '09 Proceedings of the Third Linguistic Annotation Workshop
Creating and exploiting multimodal annotated corpora: the ToMA project
Multimodal corpora
Multimodal annotation of conversational data
LAW IV '10 Proceedings of the Fourth Linguistic Annotation Workshop
| Hi-index | 0.00 |
We present in this paper a formal approach for the representation of multimodal information. This approach, thanks to the to use of typed feature structures and hypergraphs, generalizes existing ones (typically annotation graphs) in several ways. It first proposes an homogenous representation of different types of information (nodes and relations) coming from different domains (speech, gestures). Second, it makes it possible to specify constraints representing the interaction between the different modalities, in the perspective of developing multimodal grammars.