Human detection using oriented histograms of flow and appearance

Authors:
Navneet Dalal;Bill Triggs;Cordelia Schmid
Affiliations:
GRAVIR-INRIA, Montbonnot, France;GRAVIR-INRIA, Montbonnot, France;GRAVIR-INRIA, Montbonnot, France
Venue:
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
Year:
2006

Citing 15
Cited 93

Making large-scale support vector machine learning practical

Advances in kernel methods
The visual analysis of human movement: a survey

Computer Vision and Image Understanding
W4: Real-Time Surveillance of People and Their Activities

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Trainable System for Object Detection

International Journal of Computer Vision - special issue on learning and vision at the center for biological and computational learning, Massachusetts Institute of Technology
Example-Based Object Detection in Images by Components

IEEE Transactions on Pattern Analysis and Machine Intelligence
Stability of Phase Information

IEEE Transactions on Pattern Analysis and Machine Intelligence
An Algorithm for Data-Driven Bandwidth Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Determination of Optical Flow and its Discontinuities using Non-Linear Diffusion

ECCV '94 Proceedings of the Third European Conference-Volume II on Computer Vision - Volume II
Pattern Rejection

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Detecting Pedestrians Using Patterns of Motion and Appearance

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Recognizing Action at a Distance

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Pedestrian Detection in Crowded Scenes

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Automatic cascade training with perturbation bias

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition

A survey of advances in vision-based human motion capture and analysis

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words

International Journal of Computer Vision
Modelling Scenes Using the Activity within Them

Proceedings of the international conference on Spatial Cognition VI: Learning, Reasoning, and Talking about Space
Semantic object classes in video: A high-definition ground truth database

Pattern Recognition Letters
Contour-motion feature (CMF): A space-time approach for robust pedestrian detection

Pattern Recognition Letters
Learning articulated appearance models for tracking humans: A spectral graph matching approach

Image Communication
Segmentation and Recognition Using Structure from Motion Point Clouds

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Scale Invariant Action Recognition Using Compound Features Mined from Dense Spatio-temporal Corners

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
People detection in low-resolution video with non-stationary background

Image and Vision Computing
Co-occurrence Histograms of Oriented Gradients for Pedestrian Detection

PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
Detection and Segmentation of Multiple, Partially Occluded Objects by Grouping, Merging, Assigning Part Detection Responses

International Journal of Computer Vision
Mobile human-robot teaming with environmental tolerance

Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
A stochastic graph grammar for compositional object representation and recognition

Pattern Recognition
Seeing the Objects Behind the Dots: Recognition in Videos from a Moving Camera

International Journal of Computer Vision
Descriptive temporal template features for visual motion recognition

Pattern Recognition Letters
High-Level Fusion of Depth and Intensity for Pedestrian Classification

Proceedings of the 31st DAGM Symposium on Pattern Recognition
Social signal processing: Survey of an emerging domain

Image and Vision Computing
A comprehensive evaluation framework and a comparative study for human detectors

IEEE Transactions on Intelligent Transportation Systems
Optical Flow Based Detection in Mixed Human Robot Environments

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Common Motion Map Based on Codebooks

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Automatic online labeling images via co-active-learning

Proceedings of the First International Conference on Internet Multimedia Computing and Service
Category Level Object Segmentation by Combining Bag-of-Words Models with Dirichlet Processes and Random Fields

International Journal of Computer Vision
Human action detection via boosted local motion histograms

Machine Vision and Applications
Multiview pedestrian detection based on vector boosting

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Multi-posture human detection in video frames by motion contour matching

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
A cascade of feed-forward classifiers for fast pedestrian detection

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Compositional object recognition, segmentation, and tracking in video

EMMCVPR'07 Proceedings of the 6th international conference on Energy minimization methods in computer vision and pattern recognition
Behavior histograms for action recognition and human detection

Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Scene modelling and classification using learned spatial relations

COSIT'09 Proceedings of the 9th international conference on Spatial information theory
Human detection using motion and appearance based feature

ICICS'09 Proceedings of the 7th international conference on Information, communications and signal processing
Understanding transit scenes: a survey on human behavior-recognition algorithms

IEEE Transactions on Intelligent Transportation Systems
People detection and stereoscopic analysis using MAS

INES'10 Proceedings of the 14th international conference on Intelligent engineering systems
Human detection with a multi-sensors stereovision system

ICISP'10 Proceedings of the 4th international conference on Image and signal processing
Visual codebooks survey for video on-line processing

ICCVG'10 Proceedings of the 2010 international conference on Computer vision and graphics: Part I
Spatial-temporal granularity-tunable gradients partition (STGGP) descriptors for human detection

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Disparity statistics for pedestrian detection: combining appearance, motion and stereo

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Recognizing human action from a far field of view

WMVC'09 Proceedings of the 2009 international conference on Motion and video computing
Spatio-temporal optical flow statistics (STOFS) for activity classification

Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing
Pyramid binary pattern features for real-time pedestrian detection from infrared videos

Neurocomputing
Boosting part-sense multi-feature learners toward effective object detection

Computer Vision and Image Understanding
Human detection in video over large viewpoint changes

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Contextual information and covariance descriptors for people surveillance: an application for safety of construction workers

Journal on Image and Video Processing - Special issue on advanced video-based surveillance
A semantic world model for urban search and rescue based on heterogeneous sensors

RoboCup 2010
Fast human detection based on enhanced variable size HOG features

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Feature set search space for fuzzyboost learning

IbPRIA'11 Proceedings of the 5th Iberian conference on Pattern recognition and image analysis
People detection using color and depth images

MCPR'11 Proceedings of the Third Mexican conference on Pattern recognition
Fast human detection using a cascade of united hogs

ICSI'11 Proceedings of the Second international conference on Advances in swarm intelligence - Volume Part II
Automatic image annotation based on low-level features and classification of the statistical classes

RSFDGrC'11 Proceedings of the 13th international conference on Rough sets, fuzzy sets, data mining and granular computing
Feature selection for tracker-less human activity recognition

ICIAR'11 Proceedings of the 8th international conference on Image analysis and recognition - Volume Part I
A monocular human detection system based on EOH and oriented LBP features

ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Pedestrian detection and tracking using HOG and oriented-LBP features

NPC'11 Proceedings of the 8th IFIP international conference on Network and parallel computing
Structured Variable Selection with Sparsity-Inducing Norms

The Journal of Machine Learning Research
Building semantic scene models from unconstrained video

Computer Vision and Image Understanding
Markerless localization for blind users using computer vision and particle swarm optimization

EvoApplicatons'10 Proceedings of the 2010 international conference on Applications of Evolutionary Computation - Volume Part I
Agents and computer vision for processing stereoscopic images

HAIS'10 Proceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part II
Human Detection and Identification by Robots Using Thermal and Visual Information in Domestic Environments

Journal of Intelligent and Robotic Systems
On collaborative people detection and tracking in complex scenarios

Image and Vision Computing
Sparse Modeling of Human Actions from Motion Imagery

International Journal of Computer Vision
Action recognition based on the feature trajectories

ICIC'12 Proceedings of the 8th international conference on Intelligent Computing Theories and Applications
Time invariant gesture recognition by modelling body posture space

IEA/AIE'12 Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence
A survey of techniques for human detection in static images

Proceedings of the Second International Conference on Computational Science, Engineering and Information Technology
Video analysis for identifying human operation difficulties and faucet usability assessment

Neurocomputing
Topic based pose relevance learning in dance archives

Proceedings of the 21st ACM international conference on Information and knowledge management
Hand posture recognition with multiview descriptors

ACIVS'12 Proceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems
Trajectory-Based modeling of human actions with motion reference points

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
Visual code-sentences: a new video representation based on image descriptor sequences

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
Detecting interesting events using unsupervised density ratio estimation

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Evaluating the impact of frame rate on video based human action recognition

Proceedings of the 27th Conference on Image and Vision Computing New Zealand
A novel shape-based non-redundant local binary pattern descriptor for object detection

Pattern Recognition
Multimedia event detection using segment-based approach for motion feature

PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Novel and efficient pedestrian detection using bidirectional PCA

Pattern Recognition
An information retrieval approach to identifying infrequent events in surveillance video

Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Histogram of oriented normal vectors for object recognition with a depth sensor

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Action recognition using canonical correlation kernels

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Exploring dense trajectory feature and encoding methods for human interaction recognition

Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Knives are picked before slices are cut: recognition through activity sequence analysis

Proceedings of the 5th international workshop on Multimedia for cooking & eating activities
Abnormal crowd behavior detection and localization using maximum sub-sequence search

Proceedings of the 4th ACM/IEEE international workshop on Analysis and retrieval of tracked events and motion in imagery stream
Object class detection: A survey

ACM Computing Surveys (CSUR)
Detecting pedestrians on a Movement Feature Space

Pattern Recognition
Exploring STIP-based models for recognizing human interactions in TV videos

Pattern Recognition Letters
Detecting bipedal motion from correlated probabilistic trajectories

Pattern Recognition Letters
People reidentification in surveillance and forensics: A survey

ACM Computing Surveys (CSUR)
Pedestrian detection based on kernel discriminative sparse representation

Transactions on Edutainment IX
Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers

Advanced Engineering Informatics
A survey on recent object detection techniques useful for monocular vision-based planetary terrain classification

Robotics and Autonomous Systems
Matching mixtures of curves for human action recognition

Computer Vision and Image Understanding
Human interaction categorization by using audio-visual cues

Machine Vision and Applications
Multimedia Event Detection Using Segment-Based Approach for Motion Feature

Journal of Signal Processing Systems
Macrofeature layout selection for pedestrian localization and its acceleration using GPU

Computer Vision and Image Understanding
Weighted feature trajectories and concatenated bag-of-features for action recognition

Neurocomputing
Human limb segmentation in depth maps based on spatio-temporal Graph-cuts optimization

Journal of Ambient Intelligence and Smart Environments
Retina enhanced SURF descriptors for spatio-temporal concept detection

Multimedia Tools and Applications
Activity representation with motion hierarchies

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

Detecting humans in films and videos is a challenging problem owing to the motion of the subjects, the camera and the background and to variations in pose, appearance, clothing, illumination and background clutter. We develop a detector for standing and moving people in videos with possibly moving cameras and backgrounds, testing several different motion coding schemes and showing empirically that orientated histograms of differential optical flow give the best overall performance. These motion-based descriptors are combined with our Histogram of Oriented Gradient appearance descriptors. The resulting detector is tested on several databases including a challenging test set taken from feature films and containing wide ranges of pose, motion and background variations, including moving cameras and backgrounds. We validate our results on two challenging test sets containing more than 4400 human examples. The combined detector reduces the false alarm rate by a factor of 10 relative to the best appearance-based detector, for example giving false alarm rates of 1 per 20,000 windows tested at 8% miss rate on our Test Set 1.