E-Facetic: the integration of multimodal emotion expression for avatar through facial expression, acoustic and haptic

  • Authors:
  • Ahmad Hoirul Basori;Abdullah Bade;Mohd Shahrizal Sunar;Daut Daman;Nadzari Saari

  • Affiliations:
  • Universiti Teknologi Malaysia;Universiti Malaysia Sabah;Universiti Teknologi Malaysia;Universiti Teknologi Malaysia;Universiti Teknologi Malaysia

  • Venue:
  • Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Latest 3D humanoid models are merely able to produce emotion sensations through facial animation, gesture and voice. However, few of them are really concerned about manipulating haptic tactile emotion through vibration, especially on expressing 3D humanoid model emotion using common haptic device like joystick. In this paper, we have created a mapping approach to classify force power of vibration into particular emotion appearance. To justify our mapping process, the happiness mode is converted into low to medium vibration with short and long duration. The conducted experiment found out that the RGB values (1-255) can easily be mapped into given magnitude force (0-10000) as suggested by vibration frequency classification. The experiments give significant positive result which is able to drive avatar to give more realistic expression. All users have strong confidence rate on differentiating and recognizing emotion of users. From the user testing, we obtained 67% user give strong and very strong impression that our system gives stronger emotional expression than Alfred systems. 29 % user gives medium values to our system compare to Alfred system. Finally, around 5% users said that our system provides a little impression than Alfred system. Furthermore, we have found an interesting finding that all users agree that high vibration of joystick equivalent to anger emotion. Experiments also proved that user manages to have strong feeling and impression while they interact and communicate with EFACETIC. In the future, we believed that our proposed procedure will enhance the presence of avatar in the overall aspects of virtual reality, games or even serious games.