Multi-agent activity recognition using observation decomposed hidden Markov model

  • Authors:
  • Xiaohui Liu;Chin-Seng Chua

  • Affiliations:
  • Nanyang Technological University, Singapore;Nanyang Technological University, Singapore

  • Venue:
  • ICVS'03 Proceedings of the 3rd international conference on Computer vision systems
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new approach of modeling/recognizing multi-agent activities from image sequences is presented. In recent years, Hidden Markov Models (HMMs) have been widely used to recognize activity units ranging from individual gestures to multi-people interactions. However, traditional HMMs meet many problems when the number of agents increases in the scene. One significant reason for this inability is the fact that HMMs require their 'observations' to be of fixed length and order. Unlike conventional HMMs, a new algorithm to model multi-agent activities is proposed. This has two sub-processes: one for modelling the activity based on decomposed observations and the other for recording the 'role' information of each agent in the activity. This new algorithm allows changing of the observations' length, and does not require initial agent assignment. The experimental results show that this algorithm is also robust when the agents' information is only partially represented.