The word superiority effect in audiovisual speech perception

  • Authors:
  • Mathilde Fort;Elsa Spinelli;Christophe Savariaux;Sonia Kandel

  • Affiliations:
  • Université Pierre Mendès France, Laboratoire de Psychologie et NeuroCognition (CNRS UMR 5105), BP 47, 38040 Grenoble Cedex 9, France;Université Pierre Mendès France, Laboratoire de Psychologie et NeuroCognition (CNRS UMR 5105), BP 47, 38040 Grenoble Cedex 9, France and Institut Universitaire de France, 103, bd Saint-M ...;Université Stendhal, GIPSA-lab, Dpt. Parole et Cognition (CNRS UMR 5216), BP 25, 38040 Grenoble Cedex 9, France;Université Pierre Mendès France, Laboratoire de Psychologie et NeuroCognition (CNRS UMR 5105), BP 47, 38040 Grenoble Cedex 9, France and Institut Universitaire de France, 103, bd Saint-M ...

  • Venue:
  • Speech Communication
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Seeing the facial gestures of a speaker enhances phonemic identification in noise. The goal of this study was to assess whether the visual information regarding consonant articulation activates lexical representations. We conducted a phoneme monitoring task with word and pseudo-words in audio only (A) and audiovisual (AV) contexts with two levels of white noise masking the acoustic signal. The results confirmed that visual information enhances consonant detection in noisy conditions and also revealed that it accelerates the phoneme detection process. The consonants were detected faster in AV than in A only condition. Furthermore, when the acoustic signal was deteriorated, the consonant phonemes were better recognized when they were embedded in words rather than in pseudo-words in the AV condition. This provides evidence indicating that visual information on phoneme identity can contribute to lexical activation processes during word recognition.