A system for dynamic 3D visualisation of speech recognition paths

Authors:
Saturnino Luz;Masood Masoodian;Bill Rogers;Bo Zhang
Affiliations:
Trinity College Dublin, Ireland;The University of Waikato, Hamilton, New Zealand;The University of Waikato, Hamilton, New Zealand;The University of Waikato, Hamilton, New Zealand
Venue:
AVI '08 Proceedings of the working conference on Advanced visual interfaces
Year:
2008

Citing 4
Cited 2

Feedback strategies for error correction in speech recognition systems

International Journal of Man-Machine Studies
Modelling the effects of constraint upon speech-based human-computer interaction

International Journal of Human-Computer Studies
Multimodal error correction for speech user interfaces

ACM Transactions on Computer-Human Interaction (TOCHI)
Word graph based speech rcognition error correction by handwriting input

Proceedings of the 8th international conference on Multimodal interfaces

Interactive visualisation techniques for dynamic speech transcription, correction and training

Proceedings of the 9th ACM SIGCHI New Zealand Chapter's International Conference on Human-Computer Interaction: Design Centered HCI
Supporting collaborative transcription of recorded speech with a 3D game interface

KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part IV

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an interactive visualisation system that assists users of semi-automatic speech transcription systems to assess alternative recognition results in real time and provide feedback to the speech recognition back-end in an intuitive manner. This prototype uses the OpenGL libraries to implement an animated 3D visual representation of alternative recognition results generated by the Sphinx automatic speech recognition system. It is expected that displaying alternatives dynamically will facilitate early detection of recognition errors and encourage user interaction, which in turn can be used to improve future recognition performance.