Expertise estimation based on simple multimodal features

  • Authors:
  • Xavier Ochoa;Katherine Chiluiza;Gonzalo Méndez;Gonzalo Luzardo;Bruno Guamán;James Castells

  • Affiliations:
  • Escuela Superior Politécnica del Litoral, Guayaquil, Ecuador;Escuela Superior Politécnica del Litoral, Guayaquil, Ecuador;Escuela Superior Politécnica del Litoral, Guayaquil, Ecuador;Escuela Superior Politécnica del Litoral, Guayaquil, Ecuador;Escuela Superior Politécnica del Litoral, Guayaquil, Ecuador;Escuela Superior Politécnica del Litoral, Guayaquil, Ecuador

  • Venue:
  • Proceedings of the 15th ACM on International conference on multimodal interaction
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multimodal Learning Analytics is a field that studies how to process learning data from dissimilar sources in order to automatically find useful information to give feedback to the learning process. This work processes video, audio and pen strokes information included in the Math Data Corpus, a set of multimodal resources provided to the participants of the Second International Workshop on Multimodal Learning Analytics. The result of this processing is a set of simple features that could discriminate between experts and non-experts in groups of students solving mathematical problems. The main finding is that several of those simple features, namely the percentage of time that the students use the calculator, the speed at which the student writes or draws and the percentage of time that the student mentions numbers or mathematical terms, are good discriminators be- tween experts and non-experts students. Precision levels of 63% are obtained for individual problems and up to 80% when full sessions (aggregation of 16 problems) are analyzed. While the results are specific for the recorded settings, the methodology used to obtain and analyze the features could be used to create discriminations models for other contexts.