Natural Language Descriptions of Human Behavior from Video Sequences

Authors:
Carles Fernández Tena;Pau Baiget;Xavier Roca;Jordi Gonzàlez
Affiliations:
Computer Vision Centre, Edifici O. Campus UAB, 08193, Bellaterra, Spain;Computer Vision Centre, Edifici O. Campus UAB, 08193, Bellaterra, Spain;Computer Vision Centre, Edifici O. Campus UAB, 08193, Bellaterra, Spain;Institut de Robòtica i Informàtica Ind. UPC, 08028, Barcelona, Spain
Venue:
KI '07 Proceedings of the 30th annual German conference on Advances in Artificial Intelligence
Year:
2007

Citing 9
Cited 0

Visual surveillance in a dynamic and uncertain world

Artificial Intelligence - Special volume on computer vision
“F-Limette” fuzzy logic programming integrating metric temporal extensions

Journal of Symbolic Computation - Special issue: executable temporal logics
Building natural language generation systems

Building natural language generation systems
Natural Language Description of Human Activities from Video Images Based on Concept Hierarchy of Actions

International Journal of Computer Vision
Integration of Image Sequence Evaluation and Fuzzy Metric Temporal Logic Programming

KI '97 Proceedings of the 21st Annual German Conference on Artificial Intelligence: Advances in Artificial Intelligence
Representation of Behavioral Knowledge for Planning and Plan-Recognition in a Cognitive Vision System

KI '02 Proceedings of the 25th Annual German Conference on AI: Advances in Artificial Intelligence
Steps toward a cognitive vision system

AI Magazine
Natural language dialogue about moving objects in an automatically analyzed traffic scene

IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 1
Improving tracking by handling occlusions

ICAPR'05 Proceedings of the Third international conference on Pattern Recognition and Image Analysis - Volume Part II

Quantified Score

Hi-index	0.01

Visualization

Abstract

This contribution addresses the generation of textual descriptions in several natural languages for evaluation of human behavior in video sequences. The problem is tackled by converting geometrical information extracted from videos of the scenario into predicates in fuzzy logic formalism, which facilitates the internal representations of the conceptual data and allows the temporal analysis of situations in a deterministic fashion, by means of Situation Graph Trees (SGTs). The results of the analysis are stored in structures proposed by the Discourse Representation Theory (DRT), which facilitate a subsequent generation of natural language text. This set of tools has been proved to be perfectly suitable for the specified purpose.