Object-oriented software engineering
Object-oriented software engineering
Object-oriented modeling and design
Object-oriented modeling and design
Information Systems - Special issue on Databases: creation, management and utilization
Stereotypes, Student Models and Scrutability
ITS '00 Proceedings of the 5th International Conference on Intelligent Tutoring Systems
Multimodal Human Emotion/Expression Recognition
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Affective computing: challenges
International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Analysis of emotion recognition using facial expressions, speech and multimodal information
Proceedings of the 6th international conference on Multimodal interfaces
The quarks of object-oriented development
Communications of the ACM - Next-generation cyber forensics
Toward a decision-theoretic framework for affect recognition and user assistance
International Journal of Human-Computer Studies - Human-computer interaction research in the managemant information systems discipline
Interactive control of music using emotional body expressions
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Toward Emotional E-Commerce: The Customer Agent
KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part I
Combining Empirical Studies of Audio-Lingual and Visual-Facial Modalities for Emotion Recognition
KES '07 Knowledge-Based Intelligent Information and Engineering Systems and the XVII Italian Workshop on Neural Networks on Proceedings of the 11th International Conference
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
Emotional intelligence: constructing user stereotypes for affective bi-modal interaction
KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part I
Audio-Visual Affect Recognition
IEEE Transactions on Multimedia
Multimodal object oriented user interfaces in mobile affective interaction
Multimedia Tools and Applications
| Hi-index | 0.01 |
This paper focuses on the architecture of affective multimodal user interfaces that exist in e-learning applications. The OO (Object Oriented) approach has been adopted in order to combine evidence from multiple modalities of interaction and data from emotion stereotypes and classify them into well structured objects with their own properties and methods. The proposed architecture can be adopted in future multi-purpose emotion recognition systems with multiple modalities and improved emotion detection algorithms. Furthermore, the resulting emotion detection server is capable of using and handling transmitted information from different sources of data during human-computer interaction. The evaluation of the OO architecture for affective interaction by programmers and teachers revealed that there are considerable improvements in the resulting e-learning system, including easiness in adding a modality of interaction, better structure for the available multi-modal information and user friendlier environment for the human-computer interaction. The evaluation of the resulting system provided quite satisfactory results considering the proposed affective multimodal architecture.