Assessing the role of attention in the audiovisual integration of speech

  • Authors:
  • Jordi Navarra;Agnès Alsius;Salvador Soto-Faraco;Charles Spence

  • Affiliations:
  • Fundació Sant Joan de Déu, Hospital de Sant Joan de Déu-Serveis de Salut Mental, c/ Santa Rosa 39-57, Esplugues de Llobregat, 08950 Barcelona, Spain and Crossmodal Research Laborato ...;Departament de Psicologia Bísica, Universitat de Barcelona, Pg. Vall d'Hebron, 171, 08035 Barcelona, Spain;Institució Catalana de Recerca i Estudis Avançats (ICREA), c/ Passeig Lluís Companys 23, 08010 Barcelona, Spain and Departament de Tecnologies de la Informació i les Comunicaci ...;Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford OX1 3UD, UK

  • Venue:
  • Information Fusion
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Currently, one of the most controversial topics in the study of multisensory integration in humans (and in its implementation in the development of new technologies for human communication systems) concerns the question of whether or not attention is needed during (or can modulate) the integration of sensory signals that are presented in different sensory modalities. Here, we review the evidence on this question, focusing specifically on the integration of auditory and visual information during the perception of speech. Contrary to the mainstream view that has been prevalent for the last 30years or so, recent studies have now started to reveal that attentional resources are, in fact, recruited during audiovisual multisensory integration, at least under certain conditions. Finally, considering all of the available evidence, we discuss the extent to which audiovisual speech perception should be considered to represent a 'special' case of audiovisual, and more generally, of multisensory integration.