Recognizing Student Emotions using Brainwaves and Mouse Behavior Data

  • Authors:
  • Judith Azcarraga;Merlin Teodosia Suarez

  • Affiliations:
  • Center for Empathic Human-Computer Interactions, De La Salle University, Manila, Philippines;Center for Empathic Human-Computer Interactions, De La Salle University, Manila, Philippines

  • Venue:
  • International Journal of Distance Education Technologies
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Brainwaves EEG signals and mouse behavior information are shown to be useful in predicting academic emotions, such as confidence, excitement, frustration and interest. Twenty five college students were asked to use the Aplusix math learning software while their brainwaves signals and mouse behavior number of clicks, duration of each click, distance traveled by the mouse were automatically being captured. It is shown that by combining the extracted features from EEG signals with data representing mouse click behavior, the accuracy in predicting academic emotions substantially increases compared to using only features extracted from EEG signals or just mouse behavior alone. Furthermore, experiments were conducted to assess the prediction accuracy of the system at points during the learning session where several of the extracted features significantly deviate in value from their mean. The experiments confirm that the prediction performance increases as the number of feature values that deviate significantly from the mean increases.