Human activity language: grounding concepts with a linguistic framework

Authors:
Gutemberg Guerra-Filho;Yiannis Aloimonos
Affiliations:
Computer Vision Laboratory, Department of Computer Science, University of Maryland, College Park, MD;Computer Vision Laboratory, Department of Computer Science, University of Maryland, College Park, MD
Venue:
SAMT'06 Proceedings of the First international conference on Semantic and Digital Media Technologies
Year:
2006

Citing 9
Cited 0

Interactive control of avatars animated with human motion data

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Automated Derivation of Primitives for Movement Classification

Autonomous Robots
Unsupervised Analysis of Human Gestures

PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Markerless monocular motion capture using image features and physical constraints

CGI '05 Proceedings of the Computer Graphics International 2005
Identifying hierarchical structure in sequences: a linear-time algorithm

Journal of Artificial Intelligence Research
Automated gesture segmentation from dance sequences

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
An active learning framework for content-based information retrieval

IEEE Transactions on Multimedia
The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments

IEEE Transactions on Image Processing
Relevance feedback: a power tool for interactive content-based image retrieval

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have empirically discovered that the space of human actions has a linguistic framework. This is a sensory-motor space consisting of the evolution of the joint angles of the human body in movement. The space of human activity has its own phonemes, morphemes, and sentences. This has implications for conceptual grounding. We present a Human Activity Language (HAL) for symbolic non-arbitrary representation of visual and motor information. In phonology, we define atomic segments (kinetemes) that are used to compose human activity. We introduce the concept of a kinetological system and propose five basic properties for such a system: compactness, view-invariance, reproducibility, selectivity, and reconstructivity. In morphology, we extend sequential language learning to incorporate associative learning with our parallel learning approach. Parallel learning solves the problem of overgeneralization and is effective in identifying the kinetemes and active joints in a particular action. In syntax, we suggest four lexical categories for our Human Activity Language (noun, verb, adjective, and adverb). These categories are combined into sentences through syntax for human movement.