Journal of Systems and Software
Information Systems - Special issue on Databases: creation, management and utilization
Stereotypes, Student Models and Scrutability
ITS '00 Proceedings of the 5th International Conference on Intelligent Tutoring Systems
Affective computing: challenges
International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Analysis of emotion recognition using facial expressions, speech and multimodal information
Proceedings of the 6th international conference on Multimodal interfaces
Mobile educational features in authoring tools for personalised tutoring
Computers & Education
The quarks of object-oriented development
Communications of the ACM - Next-generation cyber forensics
Toward a decision-theoretic framework for affect recognition and user assistance
International Journal of Human-Computer Studies - Human-computer interaction research in the managemant information systems discipline
Interactive control of music using emotional body expressions
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Feel the Difference: A Guide with Attitude!
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Toward Emotional E-Commerce: The Customer Agent
KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part I
Combining Empirical Studies of Audio-Lingual and Visual-Facial Modalities for Emotion Recognition
KES '07 Knowledge-Based Intelligent Information and Engineering Systems and the XVII Italian Workshop on Neural Networks on Proceedings of the 11th International Conference
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
Knowledge Engineering for Affective Bi-Modal Interaction in Mobile Devices
Proceedings of the 2008 conference on Knowledge-Based Software Engineering: Proceedings of the Eighth Joint Conference on Knowledge-Based Software Engineering
Affiliations, Emotion and the Mobile Phone
Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions
CheekTouch: an affective interaction technique while speaking on the mobile phone
CHI '10 Extended Abstracts on Human Factors in Computing Systems
On assisting a visual-facial affect recognition system with keyboard-stroke pattern information
Knowledge-Based Systems
Object oriented architecture for affective multimodal e-learning interfaces
Intelligent Decision Technologies
Emotional intelligence: constructing user stereotypes for affective bi-modal interaction
KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part I
Audio-Visual Affect Recognition
IEEE Transactions on Multimedia
A study of speech emotion recognition and its application to mobile services
UIC'07 Proceedings of the 4th international conference on Ubiquitous Intelligence and Computing
| Hi-index | 0.00 |
In this paper, we investigate an object oriented (OO) architecture for multimodal emotion recognition in interactive applications through mobile phones or handheld devices. Mobile phones are different from desktop computers since mobile phones are not performing any processing involving emotion recognition whereas desktop computers can perform such processing. In fact, in our approach, mobile phones have to pass all data collected to a server and then perform emotion recognition. The object oriented architecture that we have created, combines evidence from multiple modalities of interaction, namely the mobile device's keyboard and the mobile device's microphone, as well as data from emotion stereotypes. Moreover, the OO method classifies them into well structured objects with their own properties and methods. The resulting emotion detection server is capable of using and handling transmitted information from different mobile sources of multimodal data during human-computer interaction. As a test bed for the affective mobile interaction we have used an educational application that is incorporated into the mobile system.