On the use of nonverbal speech sounds in human communication

Authors:
Nick Campbell
Affiliations:
National Institute of Information and Communications Technology and ATR Spoken Language Communication Research Laboratory, Keihanna Science City, Kyoto, Japan
Venue:
COST 2102'07 Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behaviours
Year:
2007

Citing 2
Cited 15

The IBM expressive text-to-speech synthesis system for American English

IEEE Transactions on Audio, Speech, and Language Processing
Conversational speech synthesis and the need for some laughter

IEEE Transactions on Audio, Speech, and Language Processing

Static and Dynamic Modelling for the Recognition of Non-verbal Vocalisations in Conversational Speech

PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Towards Annotation of Nonverbal Vocal Gestures in Slovak

Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction
Gaze and Gesture Activity in Communication

UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
Being bored? Recognising natural interest by extensive audiovisual integration for real-life application

Image and Vision Computing
Automatic nonverbal analysis of social interaction in small groups: A review

Image and Vision Computing
Tools and resources for visualising conversational-speech interaction

Multimodal corpora
Audiovisual alignment in a face-to-face conversation translation framework

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
Prosodic and temporal features for language modeling for dialog

Speech Communication
How low level observations can help to reveal the user's state in HCI

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Spotting laughter in natural multiparty conversations: A comparison of automatic online and offline approaches using audiovisual data

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special Issue on Affective Interaction in Natural Environments
Microintonation analysis of emotional speech

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Multimodal multilingual dictionary of gestures: digest

COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
Ten recent trends in computational paralinguistics

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems
Context-based conversational hand gesture classification in narrative interaction

Proceedings of the 15th ACM on International conference on multimodal interaction
Automatic identification of experts and performance prediction in the multimodal math data corpus through analysis of speech interaction

Proceedings of the 15th ACM on International conference on multimodal interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recent work investigating the interaction of the speech signal with the meaning of the verbal content has revealed interactions not yet modelled in either speech recognition technology or in contemporary linguistic science. In this paper we describe paralinguistic speech features that co-exist alongside linguistic content and propose a model of their function and usage, and discuss methods for incorporating them into real-world applications and devices.