A real-time Speech-interfaced System for Group Conversation Modeling

Authors:
Cesare Rocchi;Emanuele Principi;Simone Cifani;Rudy Rotili;Stefano Squartini;Francesco Piazza
Affiliations:
3MediaLabs, DIBET, Università Politecnica delle Marche, Via Brecce Bianche 1, 60131 Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Via Brecce Bianche 1, 60131 Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Via Brecce Bianche 1, 60131 Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Via Brecce Bianche 1, 60131 Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Via Brecce Bianche 1, 60131 Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Via Brecce Bianche 1, 60131 Ancona, Italy
Venue:
Proceedings of the 2009 conference on Neural Nets WIRN09: Proceedings of the 19th Italian Workshop on Neural Nets, Vietri sul Mare, Salerno, Italy, May 28--30 2009
Year:
2009

Citing 6
Cited 0

A Segment-Based Wordspotter Using Phonetic Filler Models

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2 - Volume 2
The museum visit: generating seamless personalized presentations on multiple devices

Proceedings of the 9th international conference on Intelligent user interfaces
Influencing social dynamics in meetings through a peripheral display

Proceedings of the 9th international conference on Multimodal interfaces
Fostering conversation after the museum visit: a WOZ study for a shared interface

AVI '08 Proceedings of the working conference on Advanced visual interfaces
The impact of increased awareness while face-to-face

Human-Computer Interaction
Keyword spotting based system for conversation fostering in tabletop scenarios: preliminary evaluation

HSI'09 Proceedings of the 2nd conference on Human System Interactions

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, a speech-interfaced system for fostering group conversations is presented. The system captures conversation keywords and shows visual stimuli on a tabletop display. A stimulus can be a feedback to the current conversation or a cue to discuss new topics. This work describes the overall system architecture and highlights details about the design choices of the overall system, with a particular focus on the real-time implementation issues. A suitable speech enhancement front-end and a keyword spotter have been integrated on a common software platform for real-time audio processing, namely Nu-Tech, resulting in a helpful and flexible architecture for real-world applications in group conversation modeling scenarios. Such system characteristics, jointly with some experimental results obtained from simulations on recorded speech data, seem to confirm the efficacy of the approach motivating the development of further features and the experimentation in new scenarios.