Learning to recognize video-based spatiotemporal events

Authors:
Harini Veeraraghavan;Nikolaos P. Papanikolopoulos
Affiliations:
General Electric Research and Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN;Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN
Venue:
IEEE Transactions on Intelligent Transportation Systems
Year:
2009

Citing 32
Cited 1

Learning context-free grammars from structural data in polynomial time

Theoretical Computer Science
Efficient learning of context-free grammars from positive structural examples

Information and Computation
Detection and Recognition of Periodic, Nonrigid Motion

International Journal of Computer Vision
Parameterized modeling and recognition of activities

Computer Vision and Image Understanding
Text Classification from Labeled and Unlabeled Documents using EM

Machine Learning - Special issue on information retrieval
Discovery and Segmentation of Activities in Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognition of Visual Activities and Interactions by Stochastic Parsing

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Recognition of Human Movement Using Temporal Templates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning k-Reversible Context-Free Grammars from Positive Structural Examples

ICML '02 Proceedings of the Nineteenth International Conference on Machine Learning
Inducing Probabilistic Grammars by Bayesian Model Merging

ICGI '94 Proceedings of the Second International Colloquium on Grammatical Inference and Applications
Recognizing multitasked activities from video using stochastic context-free grammar

Eighteenth national conference on Artificial intelligence
Cardboard People: A Parameterized Model of Articulated Image Motion

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Large-Scale Event Detection Using Semi-Hidden Markov Models

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Image Spaces and Video Trajectories: Using Isomap to Explore Video Sequences

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Reconstructing force-dynamic models from video sequences

Artificial Intelligence
Layered representations for learning and inferring office activity from multiple sensory channels

Computer Vision and Image Understanding - Special issue on event detection in video
Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Detection and Explanation of Anomalous Activities: Representing Activities as Bags of Event n-Grams

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Learning and Detecting Activities from Movement Trajectories Using the Hierarchical Hidden Markov Models

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Efficient Visual Event Detection Using Volumetric Features

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Learning Temporal Sequence Model from Partially Labeled Data

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Recognition of Composite Human Activities through Context-Free Grammar Based Representation

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Robust target detection and tracking through integration of motion, color, and geometry

Computer Vision and Image Understanding
Vehicle Class Recognition from Video-Based on 3D Curve Probes

ICCCN '05 Proceedings of the 14th International Conference on Computer Communications and Networks
Multiple agent event detection and representation in videos

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 1
Behavior classification by eigendecomposition of periodic motions

Pattern Recognition
Learning context-free grammars using tabular representations

Pattern Recognition
Evolutionary induction of stochastic context free grammars

Pattern Recognition
Detecting unusual activity in video

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Traffic monitoring and accident detection at intersections

IEEE Transactions on Intelligent Transportation Systems
Framework for real-time behavior interpretation from traffic video

IEEE Transactions on Intelligent Transportation Systems
Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video

IEEE Transactions on Intelligent Transportation Systems

An Improved Hierarchical Dirichlet Process-Hidden Markov Model and Its Application to Trajectory Modeling and Retrieval

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

A key research issue in activity recognition in real-world applications, such as in intelligent transportation systems (ITS), is to automatically learn robust models of activities that require minimal human training. In this paper, we contribute a novel approach for learning sequenced spatiotemporal activities in outdoor traffic intersections. Concretely, by representing the activities as sequences of actions, we contribute a semisupervised learning algorithm that learns activities as complete stochastic context-free grammars (SCFGs), namely, the grammar structure and the parameters. Our approach has been implemented and tested on real-world scenes, and we present experimental results of the grammar learning and activity recognition applied to data collection and traffic monitoring applications using video data.