Human action segmentation and recognition via motion and shape analysis

Authors:
Ling Shao;Ling Ji;Yan Liu;Jianguo Zhang
Affiliations:
Department of Electronic and Electrical Engineering, The University of Sheffield, UK;Philips Healthcare, Philips Electronics, The Netherlands;Department of Computing, Hong Kong Polytechnic University, Hong Kong;School of Computing, University of Dundee, UK
Venue:
Pattern Recognition Letters
Year:
2012

Citing 21
Cited 7

An integrated color-spatial approach to content-based image retrieval

Proceedings of the third ACM international conference on Multimedia
The visual analysis of human movement: a survey

Computer Vision and Image Understanding
Human motion analysis: a review

Computer Vision and Image Understanding
An introduction to support Vector Machines: and other kernel-based learning methods

An introduction to support Vector Machines: and other kernel-based learning methods
The Recognition of Human Movement Using Temporal Templates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Motion segmentation and pose recognition with motion history gradients

Machine Vision and Applications - Special issue: IEEE WACV
Color-spatial image indexing and applications

Color-spatial image indexing and applications
Recognizing Action at a Distance

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Recognizing Human Actions: A Local SVM Approach

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
On Space-Time Interest Points

International Journal of Computer Vision
Actions as Space-Time Shapes

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Scalable Recognition with a Vocabulary Tree

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Free viewpoint action recognition using motion history volumes

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Motion Histogram Analysis Based Key Frame Extraction for Human Action/Activity Representation

CRV '09 Proceedings of the 2009 Canadian Conference on Computer and Robot Vision
Learning atomic human actions using variable-length Markov models

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Behavior histograms for action recognition and human detection

Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
A descriptor combining MHI and PCOG for human motion classification

Proceedings of the ACM International Conference on Image and Video Retrieval
Object trajectory clustering via tensor analysis

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing

Action retrieval with relevance feedback on YouTube videos

Proceedings of the Third International Conference on Internet Multimedia Computing and Service
Letters: Dual-ellipse fitting approach for robust gait periodicity detection

Neurocomputing
Locality constrained representation based classification with spatial pyramid patches

Neurocomputing
Chinese shadow puppetry with an interactive interface using the kinect sensor

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
STV-based video feature processing for action recognition

Signal Processing
A line based pose representation for human action recognition

Image Communication
A template matching approach of one-shot-learning gesture recognition

Pattern Recognition Letters

Quantified Score

Hi-index	0.10

Visualization

Abstract

In this paper, we present an automated video analysis system which addresses segmentation and detection of human actions in an indoor environment, such as a gym. The system aims at segmenting different movements from the input video and recognizing the action types simultaneously. Two action segmentation techniques, namely color intensity based and motion based, are proposed. Both methods can efficiently segment periodic human movements into temporal cycles. We also apply a novel approach for human action recognition by describing human actions using motion and shape features. The descriptor contains both the local shape and its spatial layout information, therefore is more effective for action modeling and is suitable for detecting and recognizing a variety of actions. Experimental results show that the proposed action segmentation and detection algorithms are highly effective.