The visual analysis of human movement: a survey
Computer Vision and Image Understanding
Learning in graphical models
Human motion analysis: a review
Computer Vision and Image Understanding
Graphical models for recognizing human interactions
Proceedings of the 1998 conference on Advances in neural information processing systems II
Learning Patterns of Activity Using Real-Time Tracking
IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognition of Visual Activities and Interactions by Stochastic Parsing
IEEE Transactions on Pattern Analysis and Machine Intelligence
From Gaze to Focus of Attention
VISUAL '99 Proceedings of the Third International Conference on Visual Information and Information Systems
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Recognition of Group Activities using Dynamic Probabilistic Networks
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Video-based event recognition: activity representation and probabilistic recognition methods
Computer Vision and Image Understanding - Special issue on event detection in video
ACM Computing Surveys (CSUR)
A survey of advances in vision-based human motion capture and analysis
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Behavior recognition via sparse spatio-temporal features
ICCCN '05 Proceedings of the 14th International Conference on Computer Communications and Networks
Machine Vision and Applications
Tracking the Visual Focus of Attention for a Varying Number of Wandering People
IEEE Transactions on Pattern Analysis and Machine Intelligence
Multimodal recognition of personality traits in social interactions
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
Semantic Representation and Recognition of Continued and Recursive Human Activities
International Journal of Computer Vision
IEEE Transactions on Pattern Analysis and Machine Intelligence
What are customers looking at?
AVSS '07 Proceedings of the 2007 IEEE Conference on Advanced Video and Signal Based Surveillance
Social signal processing: Survey of an emerging domain
Image and Vision Computing
Automatic nonverbal analysis of social interaction in small groups: A review
Image and Vision Computing
Towards surveillance video search by natural language query
Proceedings of the ACM International Conference on Image and Video Retrieval
IEEE Transactions on Multimedia
Space speaks: towards socially and personality aware visual surveillance
Proceedings of the 1st ACM international workshop on Multimodal pervasive video analysis
A generative score space for statistical dialog characterization in social signalling
SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
Group Activity Recognition by Gaussian Processes Estimation
ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Detecting Social Situations from Interaction Geometry
SOCIALCOM '10 Proceedings of the 2010 IEEE Second International Conference on Social Computing
Human activity analysis: A review
ACM Computing Surveys (CSUR)
Background subtraction for automated multisensor surveillance: a comprehensive review
EURASIP Journal on Advances in Signal Processing - Special issue on advanced image processing for defense and security applications
Detecting F-formations as dominant sets
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
A study on visual focus of attention recognition from head pose in a meeting room
MLMI'06 Proceedings of the Third international conference on Machine Learning for Multimodal Interaction
Abnormal crowd behavior detection by social force optimization
HBU'11 Proceedings of the Second international conference on Human Behavior Unterstanding
Modeling individual and group actions in meetings with layered HMMs
IEEE Transactions on Multimedia
A survey on visual surveillance of object motion and behaviors
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Learning semantic scene models from observing activity in visual surveillance
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Spatiotemporal Localization and Categorization of Human Actions in Unsegmented Image Sequences
IEEE Transactions on Image Processing
Machine Recognition of Human Activities: A Survey
IEEE Transactions on Circuits and Systems for Video Technology
Group Event Detection With a Varying Number of Group Members for Video Surveillance
IEEE Transactions on Circuits and Systems for Video Technology
Modeling focus of attention for meeting indexing based on multiple cues
IEEE Transactions on Neural Networks
Inferring social activities with mobile sensor networks
Proceedings of the 15th ACM on International conference on multimodal interaction
Hi-index | 0.01 |
The analysis of human activities is one of the most intriguing and important open issues for the automated video surveillance community. Since few years ago, it has been handled following a mere Computer Vision and Pattern Recognition perspective, where an activity corresponded to a temporal sequence of explicit actions (run, stop, sit, walk, etc.). Even under this simplistic assumption, the issue is hard, due to the strong diversity of the people appearance, the number of individuals considered (we may monitor single individuals, groups, crowd), the variability of the environmental conditions (indoor/outdoor, different weather conditions), and the kinds of sensors employed. More recently, the automated surveillance of human activities has been faced considering a new perspective, that brings in notions and principles from the social, affective, and psychological literature, and that is called Social Signal Processing (SSP). SSP employs primarily nonverbal cues, most of them are outside of conscious awareness, like face expressions and gazing, body posture and gestures, vocal characteristics, relative distances in the space and the like. This paper is the first review analyzing this new trend, proposing a structured snapshot of the state of the art and envisaging novel challenges in the surveillance domain where the cross-pollination of Computer Science technologies and Sociology theories may offer valid investigation strategies.