Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment

  • Authors:
  • E. C. Lalor;S. P. Kelly;C. Finucane;R. Burke;R. Smith;R. B. Reilly;G. McDarby

  • Affiliations:
  • School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, Dublin, Ireland;School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, Dublin, Ireland and The Cognitive Neurophysiology Laboratory, Nathan S. Kline Institute for Psychi ...;Medical Physics and Bioengineering, St. James's Hospital, Dublin, Ireland;EOC Operations Center, Microsoft Corporation, Dublin, Ireland;School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, Dublin, Ireland;School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, Dublin, Ireland;School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, Dublin, Ireland

  • Venue:
  • EURASIP Journal on Applied Signal Processing
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents the application of an effective EEG-based brain-computer interface design for binary control in a visually elaborate immersive 3D game. The BCI uses the steady-state visual evoked potential (SSVEP) generated in response to phase-reversing checkerboard patterns. Two power-spectrum estimation methods were employed for feature extraction in a series of offline classification tests. Both methods were also implemented during real-time game play. The performance of the BCI was found to be robust to distracting visual stimulation in the game and relatively consistent across six subjects, with 41 of 48 games successfully completed. For the best performing feature extraction method, the average real-time control accuracy across subjects was 89%. The feasibility of obtaining reliable control in such a visually rich environment using SSVEPs is thus demonstrated and the impact of this result is discussed.