MACH: my automated conversation coach

Authors:
Mohammed (Ehsan) Hoque;Matthieu Courgeon;Jean-Claude Martin;Bilge Mutlu;Rosalind W. Picard
Affiliations:
MIT, Cambridge, MA, USA;LIMSI-CNRS, Orsay Cedex, France;LIMSI-France, Orsay Cedex, USA;University of Wisconsin-Madison, Madison, WI, USA;MIT, Cambridge, MA, USA
Venue:
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Year:
2013

Citing 9
Cited 0

Embodied conversational agents: representation and intelligence in user interfaces

AI Magazine
Coding Facial Expressions with Gabor Wavelets

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Comprehensive Database for Facial Expression Analysis

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Real-Time Detection of Nodding and Head-Shaking by Directly Detecting and Tracking the "Between-Eyes"

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 10 - Volume 10
Impact of Expressive Wrinkles on Perception of a Virtual Character's Facial Expressions of Emotions

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Face detection with the modified census transform

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Virtual rapport

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Building Autonomous Sensitive Artificial Listeners

IEEE Transactions on Affective Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

MACH--My Automated Conversation coacH--is a novel system that provides ubiquitous access to social skills training. The system includes a virtual agent that reads facial expressions, speech, and prosody and responds with verbal and nonverbal behaviors in real time. This paper presents an application of MACH in the context of training for job interviews. During the training, MACH asks interview questions, automatically mimics certain behavior issued by the user, and exhibit appropriate nonverbal behaviors. Following the interaction, MACH provides visual feedback on the user's performance. The development of this application draws on data from 28 interview sessions, involving employment-seeking students and career counselors. The effectiveness of MACH was assessed through a weeklong trial with 90 MIT undergraduates. Students who interacted with MACH were rated by human experts to have improved in overall interview performance, while the ratings of students in control groups did not improve. Post-experiment interviews indicate that participants found the interview experience informative about their behaviors and expressed interest in using MACH in the future.