IEEE Transactions on Pattern Analysis and Machine Intelligence
Vocal communication of emotion: a review of research paradigms
Speech Communication - Special issue on speech and emotion
"How do you know that I don't understand?" A look at the future of intelligent tutoring systems
Computers in Human Behavior
Proceedings of the 2nd International Conference on Fun and Games
Computers in Human Behavior
| Hi-index | 0.00 |
Intelligent tutoring systems often make use of students' answers to adapt instruction or feedback on a task. In this paper, we explore the alternative possibility of adapting a system based on the perceived affective and cognitive state of a student. A system can potentially better adapt to the needs of each individual student by using non-verbal behavior. We used a new experimental paradigm inspired by 'brain training' software to collect primary school children's answers to easy and difficult arithmetic problems and made audiovisual recordings of their answers. Adult observers rated these films on perceived difficulty level. Results showed that adults were able to correctly interpret children's perceived level of difficulty, especially if they saw their face (compared to hearing their voice). They paid attention to features such as 'looking away', and 'frowning'. Then we checked whether we could also automatically predict if the posed problem was either easy or difficult based on the first second of their response. This 'thin-slice analysis' could correctly predict the difficulty level in 71% of all cases. When trained on sufficiently many recordings, Adaptive Tutoring Systems should be able to detect children's state and adapt the difficulty level of their learning materials accordingly.