Cross-Media Translation between Human Motions and Texts Based on Mental Image Directed Semantic Theory

  • Authors:
  • Mikio Amano;Daisuke Hironaka;Seio Oda;Valbona Barolli;Genci Capi;Masao Yokota

  • Affiliations:
  • Fukuoka Institute of Technology;Fukuoka Institute of Technology;Fukuoka Institute of Technology;Fukuoka Institute of Technology;Fukuoka Institute of Technology;Fukuoka Institute of Technology

  • Venue:
  • ICDCSW '05 Proceedings of the Seventh International Workshop on Multimedia Network Systems and Applications - Volume 07
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Mental Image Directed Semantic Theory (MIDST)has proposed a formal language L_md employed for many-sorted predicate logic and whose semantics is given based on an omnisensual mental image model so called "Loci in Attribute Spaces". This language can be used for intermediate knowledge representation of multimedia contents and has been applied to an integrated multimedia understanding system IMAGES-M. This paper presents brief sketches of L_md and IMAGES-M and focuses on bi-directional cross-media translation between human motions and texts by IMAGES-M.