Event Detection and Analysis from Video Streams

Authors:
Gérard Medioni;Isaac Cohen;François Brémond;Somboon Hongeng;Ramakant Nevatia
Affiliations:
Univ. of Southern California, Los Angeles;Univ. of Southern California, Los Angeles;Univ. of Southern California, Los Angeles;Univ. of Southern California, Los Angeles;Univ. of Southern California, Los Angeles
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2001

Citing 25
Cited 64

From image sequences towards conceptual descriptions

Image and Vision Computing
Three-dimensional computer vision: a geometric viewpoint

Three-dimensional computer vision: a geometric viewpoint
Visual surveillance in a dynamic and uncertain world

Artificial Intelligence - Special volume on computer vision
An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence
Creating full view panoramic image mosaics and environment maps

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
A Unified Approach to Moving Object Detection in 2D and 3D Scenes

IEEE Transactions on Pattern Analysis and Machine Intelligence
Issues of representing context illustrated by video-surveillance applications

International Journal of Human-Computer Studies - Special issue: using context in applications
Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications

International Journal of Computer Vision
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Detecting and Tracking Multiple Moving Objects Using Temporal Integration

ECCV '92 Proceedings of the Second European Conference on Computer Vision
Non-parametric Local Transforms for Computing Visual Correspondence

ECCV '94 Proceedings of the Third European Conference-Volume II on Computer Vision - Volume II
Visual Surveillance Monitoring and Watching

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume II - Volume II
W4S: A real-time system detecting and tracking people in 2 1/2D

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Real-time closed-world tracking

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Coupled hidden Markov models for complex action recognition

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Fast 3D Stabilization and Mosaic Construction

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Using geometric corners to build a 2D mosaic from a set of image

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
The Representation and Recognition of Human Movement Using Temporal Templates

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Human Action Detection Using PNF Propagation of Temporal Constraints

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Nonlinear PHMMs for the Interpretation of Parameterized Gesture

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Action Recognition Using Probabilistic Parsing

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Using Adaptive Tracking to Classify and Monitor Activities in a Site

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Moving Target Classification and Tracking from Real-time Video

WACV '98 Proceedings of the 4th IEEE Workshop on Applications of Computer Vision (WACV'98)
Mosaic based representations of video sequences and their applications

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Comparing and Evaluating Interest Points

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision

Robust tracking of human body parts for collaborative human computer interaction

Computer Vision and Image Understanding
A Tracking Framework for Collaborative Human Computer Interaction

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Baseline Detection and Localization for Invisible Omnidirectional Cameras

International Journal of Computer Vision - Special Issue on Omni-Directional Research in Japan
Qualitative Modelling and Analysis of Animal Behaviour

Applied Intelligence
Video-based event recognition: activity representation and probabilistic recognition methods

Computer Vision and Image Understanding - Special issue on event detection in video
Beyond Tracking: Modelling Activity and Understanding Behaviour

International Journal of Computer Vision
Detecting irregularity in videos using kernel estimation and KD trees

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Multimedia simplification for optimized MMS synthesis

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Background estimation under rapid gain change in thermal imagery

Computer Vision and Image Understanding
Memory-Based Attention Control for Activity Recognition at a Subway Station

IEEE MultiMedia
Learning, detection and representation of multi-agent events in videos

Artificial Intelligence
Occlusion analysis: Learning and utilising depth maps in object tracking

Image and Vision Computing
Representation of occurrences for road vehicle traffic

Artificial Intelligence
On the correspondence between objects and events for the diagnosis of situations in visual surveillance tasks

Pattern Recognition Letters
An event detection framework in video sequences based on hierarchic event structure perception

ISPRA'06 Proceedings of the 5th WSEAS International Conference on Signal Processing, Robotics and Automation
How close are we to solving the problem of automated visual surveillance?: A review of real-world surveillance, scientific progress and evaluative mechanisms

Machine Vision and Applications
Outlier Detection with Kernel Density Functions

MLDM '07 Proceedings of the 5th international conference on Machine Learning and Data Mining in Pattern Recognition
Categorizing bi-object video activities using bag of segments and causality features

VNBA '08 Proceedings of the 1st ACM workshop on Vision networks for behavior analysis
Using decision trees to recognize visual events

AREA '08 Proceedings of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams
Large-scale image sensing by a group of smart image sensors

Parallel Computing
Semantic event representation and recognition using syntactic attribute graph grammar

Pattern Recognition Letters
A framework for visualization and exploration of events

Information Visualization
Detecting motion patterns via direction maps with application to surveillance

Computer Vision and Image Understanding
A cognitive surveillance system for detecting incorrect traffic behaviors

Expert Systems with Applications: An International Journal
Semantic Activity Recognition

Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Semantic retrieval of events from indoor surveillance video databases

Pattern Recognition Letters
Unusual Activity Analysis in Video Sequences

RSFDGrC '07 Proceedings of the 11th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing
Effective semantic classification of consumer events for automatic content management

WSM '09 Proceedings of the first SIGMM workshop on Social media
Detecting video events based on action recognition in complex scenes using spatio-temporal descriptor

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Digital Video Event Detector Framework for Surveillance Applications

AVSS '09 Proceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance
Understanding video events: a survey of methods for automatic interpretation of semantic occurrences in video

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A human-centered multiple instance learning framework for semantic video retrieval

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Learning the Semantic Landscape: embedding scene knowledge in object tracking

Real-Time Imaging
Event detection for intelligent car park video surveillance

Real-Time Imaging
Volumetric Features for Video Event Detection

International Journal of Computer Vision
Learning to recognize complex actions using conditional random fields

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II
Understanding transit scenes: a survey on human behavior-recognition algorithms

IEEE Transactions on Intelligent Transportation Systems
Incremental unsupervised three-dimensional vehicle model learning from video

IEEE Transactions on Intelligent Transportation Systems
Detection of user-defined, semantically high-level, composite events, and retrieval of event queries

Multimedia Tools and Applications
Visual event recognition using decision trees

Multimedia Tools and Applications
Detecting and discriminating behavioural anomalies

Pattern Recognition
Cooperative object tracking and composite event detection with wireless embedded smart cameras

IEEE Transactions on Image Processing - Special section on distributed camera networks: sensing, processing, communication, and implementation
Multi-object particle filter tracking with automatic event analysis

Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams
Real time illumination invariant motion change detection

Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams
Anomaly detection over spatiotemporal object using adaptive piecewise model

PRICAI'10 Proceedings of the 11th Pacific Rim international conference on Trends in artificial intelligence
Recognizing pair-activities by causality analysis

ACM Transactions on Intelligent Systems and Technology (TIST)
Detecting unusual activity in video

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Optimal-flow minimum-cost correspondence assignment in particle flow tracking

Computer Vision and Image Understanding
Fast outlier detection for very large log data

Expert Systems with Applications: An International Journal
Event detection and fusion model for semantic interpretation of monitored scenarios within ASIMS architecture

IWINAC'11 Proceedings of the 4th international conference on Interplay between natural and artificial computation - Volume Part I
Human behavior clustering for anomaly detection

Frontiers of Computer Science in China
Trajectory Analysis and Semantic Region Modeling Using Nonparametric Hierarchical Bayesian Models

International Journal of Computer Vision
A scheme for the detection and tracking of people tuned for aerial image sequences

PIA'11 Proceedings of the 2011 ISPRS conference on Photogrammetric image analysis
Real-time business process monitoring method for prediction of abnormal termination using KNNI-based LOF prediction

Expert Systems with Applications: An International Journal
Pattern discovery for video surveillance

ISVC'05 Proceedings of the First international conference on Advances in Visual Computing
3D scene modeling for activity detection

ER'05 Proceedings of the 24th international conference on Perspectives in Conceptual Modeling
Incremental connectivity-based outlier factor algorithm

VoCS'08 Proceedings of the 2008 international conference on Visions of Computer Science: BCS International Academic Conference
Event detection in underwater domain by exploiting fish trajectory clustering

Proceedings of the 1st ACM international workshop on Multimedia analysis for ecological data
Exploratory search of long surveillance videos

Proceedings of the 20th ACM international conference on Multimedia
Intelligent multi-camera video surveillance: A review

Pattern Recognition Letters
Recognizing Human Group Behaviors with Multi-group Causalities

WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03
A review of motion analysis methods for human Nonverbal Communication Computing

Image and Vision Computing
Anomaly detection in large-scale data stream networks

Data Mining and Knowledge Discovery
A rule-based event detection system for real-life underwater domain

Machine Vision and Applications

Quantified Score

Hi-index	0.15

Visualization

Abstract

We present a system which takes as input a video stream obtained from an airborne moving platform and produces an analysis of the behavior of the moving objects in the scene. To achieve this functionality, our system relies on two modular blocks. The first one detects and tracks moving regions in the sequence. It uses a set of features at multiple scales to stabilize the image sequence, that is, to compensate for the motion of the observe, then extracts regions with residual motion and uses an attribute graph representation to infer their trajectories. The second module takes as input these trajectories, together with user-provided information in the form of geospatial context and goal context to instantiate likely scenarios. We present details of the system, together with results on a number of real video sequences and also provide a quantitative analysis of the results.