Auditory feedback for brain computer interface management: an EEG data sonification approach

Authors:
Tomasz M. Rutkowski;Francois Vialatte;Andrzej Cichocki;Danilo P. Mandic;Allan Kardec Barros
Affiliations:
Laboratory for Advanced Brain Signal Processing, Brain Science Institute RIKEN, Japan;Laboratory for Advanced Brain Signal Processing, Brain Science Institute RIKEN, Japan;Laboratory for Advanced Brain Signal Processing, Brain Science Institute RIKEN, Japan;Department of Electrical and Electronic Engineering, Imperial College London, United Kingdom;Laboratory for Biological Information Processing, Universidade Federal do Maranhāo, Brazil
Venue:
KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
Year:
2006

Citing 1
Cited 5

EEG analysis in a telemedical virtual world

Future Generation Computer Systems - Special issue on ITIS—an international telemedical information society

EMD Approach to Multichannel EEG Data - The Amplitude and Phase Synchrony Analysis Technique

ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Theoretical and Methodological Issues
An auditory oddball based brain-computer interface system using multivariate EMD

ICIC'10 Proceedings of the Advanced intelligent computing theories and applications, and 6th international conference on Intelligent computing
Sparse bump sonification: a new tool for multichannel EEG diagnosis of mental disorders; application to the detection of the early stage of alzheimer's disease

ICONIP'06 Proceedings of the 13th international conference on Neural information processing - Volume Part III
A flexible method for envelope estimation in empirical mode decomposition

KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
On the role of auditory feedback in robot-assisted movement training after stroke: review of the literature

Computational Intelligence and Neuroscience

Quantified Score

Hi-index	0.00

Visualization

Abstract

An auditory feedback for Brain Computer Interface (BCI) applications is proposed. This is achieved based on the so-called sonification of the mental states of humans, captured by Electro-Encephalogram (EEG) recordings. Two time-frequency signal decomposition techniques, the Bump Modelling and Empirical Mode Decomposition (EMD), are used to map the EEG recordings onto musical scores. This auditory feedback proves to have extremely high potential in the development of on-line BCI interfaces. Examples based on the responses from visual stimuli support the analysis.