Spatiotemporal saliency for event detection and representation in the 3D wavelet domain: potential in human action recognition

Authors:
Konstantions Rapantzikos;Yannis Avrithis;Stefanos Kollias
Affiliations:
National Technical University of Athens, Zografou, Greece;National Technical University of Athens, Zografou, Greece;National Technical University of Athens, Zografou, Greece
Venue:
Proceedings of the 6th ACM international conference on Image and video retrieval
Year:
2007

Citing 15
Cited 4

Local Grayvalue Invariants for Image Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature Detection with Automatic Scale Selection

International Journal of Computer Vision
The Recognition of Human Movement Using Temporal Templates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Space-time Interest Points

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Affine-Invariant Local Descriptors and Neighborhood Statistics for Texture Recognition

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Using Temporal Coherence to Build Models of Animals

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Video Google: A Text Retrieval Approach to Object Matching in Videos

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Recognizing Human Actions: A Local SVM Approach

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Efficient Visual Event Detection Using Volumetric Features

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Detecting Irregularities in Images and in Video

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Actions as Space-Time Shapes

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
A Comparison of Affine Region Detectors

International Journal of Computer Vision
Statistical Analysis of Dynamic Actions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Local descriptors for spatio-temporal recognition

SCVMA'04 Proceedings of the First international conference on Spatial Coherence for Visual Motion Analysis

A survey on vision-based human action recognition

Image and Vision Computing
Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools

Image and Vision Computing
Application of 3D-wavelet statistics to video analysis

Multimedia Tools and Applications
Efficient descriptor tree growing for fast action recognition

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

Event detection and recognition is still one of the most active fields in computer vision, since the complexity of the dynamic events and the need for computational efficient solutions pose several difficulties. This paper addresses detection and representation of spatiotemporal salient regions using the 3D Discrete Wavelet Transform (DWT). We propose a framework to measure saliency based on the orientation selective bands of the 3D DWT and represent events using simple features of salient regions. We apply this method to human action recognition, test it on a large public video database consisting of six human actions and compare the results against an established method in the literature. Qualitative and quantitative evaluation indicates the potential of the proposed method to localize and represent human actions.