Virtual cognitive model for Miyazawa Kenji based on speech and facial images recognition

  • Authors:
  • Hamido Fujita;Jun Hakura;Masaki Kurematsu

  • Affiliations:
  • Faculty of Software and Information Science, Iwate Prefectural University, Iwate, Japan;Faculty of Software and Information Science, Iwate Prefectural University, Iwate, Japan;Faculty of Software and Information Science, Iwate Prefectural University, Iwate, Japan

  • Venue:
  • SSIP'06 Proceedings of the 6th WSEAS International Conference on Signal, Speech and Image Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we a representing a virtual interactive model based on cognitive model of Miyazawa Kenji. We created a computer model based on cognitive thinking of Kenji literature on story telling. The user can interact in real time with Virtual Kenji. The facial gestures been collected and analyzed through Motion capture system of six camera. These six camera has been used to collect all emotional facial gestures of several people who read one assigned Kenji experiment. These people have 50 markers of 3 mm size attached to all parts of face (lips, mouth, eyebrow, cheek, moustache, eyelash, forehead), the emotional linkage between these facials parts and cognitive emotion been analyzed and recorded. We created a database we called Facial recognition database based on Miyzawa Kenji cognitive model, Also we have speech synthesis part who also analyzed the emotional part of speech. These two parts is been presented on hologram that represents the actual character of Kenji who has face with gestures harmonize with speech and facial images generated by the system and interact with the human user based on collected response from the human user and inference by the system in real time.