Keyword spotting based system for conversation fostering in tabletop scenarios: preliminary evaluation

Authors:
Emanuele Principi;Simone Cifani;Cesare Rocchi;Stefano Squartini;Francesco Piazza
Affiliations:
3MediaLabs, DIBET, Università Politecnica delle Marche, Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Ancona, Italy;3MediaLabs, DIBET, Università Politecnica delle Marche, Ancona, Italy
Venue:
HSI'09 Proceedings of the 2nd conference on Human System Interactions
Year:
2009

Citing 4
Cited 5

A Segment-Based Wordspotter Using Phonetic Filler Models

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2 - Volume 2
Influencing social dynamics in meetings through a peripheral display

Proceedings of the 9th international conference on Multimodal interfaces
Fostering conversation after the museum visit: a WOZ study for a shared interface

AVI '08 Proceedings of the working conference on Advanced visual interfaces
The impact of increased awareness while face-to-face

Human-Computer Interaction

A real-time Speech-interfaced System for Group Conversation Modeling

Proceedings of the 2009 conference on Neural Nets WIRN09: Proceedings of the 19th Italian Workshop on Neural Nets, Vietri sul Mare, Salerno, Italy, May 28--30 2009
Robust multi-stream keyword and non-linguistic vocalization detection for computationally intelligent virtual agents

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Environmental robust speech and speaker recognition through multi-channel histogram equalization

Neurocomputing
Keyword spotting exploiting Long Short-Term Memory

Speech Communication
Conversational speech recognition in non-stationary reverberated environments

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, a speech-interfaced system for fostering group conversations is proposed. The system captures conversation keywords, and shows visual stimuli in a tabletop display. A stimulus can be a feedback to the current conversation or a cue to discuss new topics. This work briefly describes the overall system architecture, and then explains details about the design choices and implementation of the Speech Processing Unit (SPU). The performance of the keyword spotter, part of the SPU, is measured in experiments carried out in a realistic scenario. Results demonstrate that the proposed SPU is suitable for tracking conversation topics and so fostering group conversations by visualizing appropriate stimuli.