Extracting information from multimedia meeting collections
Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Context-aware computing for assistive meeting system
Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Hierarchical group process representation in multi-agent activity recognition
Image Communication
Automatic nonverbal analysis of social interaction in small groups: A review
Image and Vision Computing
Locating case discussion segments in recorded medical team meetings
SSCS '09 Proceedings of the third workshop on Searching spontaneous conversational speech
Discovering group nonverbal conversational patterns with topics
Proceedings of the 2009 international conference on Multimodal interfaces
Modeling dominance in group conversations using nonverbal activity cues
IEEE Transactions on Audio, Speech, and Language Processing - Special issue on multimodal processing in speech-based interactions
Group interaction analysis in dynamic context
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on human computing
Hierarchical control models for multimodal process modeling
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
An adaptive vision system toward implicit human computer interaction
UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
Online analysis of hierarchical events in meetings
UI-HCII'07 Proceedings of the 2nd international conference on Usability and internationalization
Segmentation, indexing, and retrieval for environmental and natural sounds
IEEE Transactions on Audio, Speech, and Language Processing
Integral framework for acquiring and evolving situations in smart environments
Journal of Ambient Intelligence and Smart Environments
Detecting and discriminating behavioural anomalies
Pattern Recognition
IEEE Transactions on Information Technology in Biomedicine
A generative score space for statistical dialog characterization in social signalling
SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Human activity analysis: A review
ACM Computing Surveys (CSUR)
Stochastic Representation and Recognition of High-Level Group Activities
International Journal of Computer Vision
A study on visual focus of attention recognition from head pose in a meeting room
MLMI'06 Proceedings of the Third international conference on Machine Learning for Multimodal Interaction
Survey on classifying human actions through visual sensors
Artificial Intelligence Review
Similarity measure for anomaly detection and comparing human behaviors
International Journal of Intelligent Systems
The nonverbal structure of patient case discussions in multidisciplinary medical team meetings
ACM Transactions on Information Systems (TOIS)
Modeling dominance effects on nonverbal behaviors using granger causality
Proceedings of the 14th ACM international conference on Multimodal interaction
Audio-visual fused online context analysis toward smart meeting room
UIC'07 Proceedings of the 4th international conference on Ubiquitous Intelligence and Computing
Parsing collective behaviors by hierarchical model with varying structure
Proceedings of the 20th ACM international conference on Multimedia
Information Sciences: an International Journal
International Journal of Computer Vision
Recognizing Human Group Behaviors with Multi-group Causalities
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03
A hybrid unsupervised/supervised model for group activity recognition
Proceedings of the 2013 International Symposium on Wearable Computers
Structured analysis of the ISI Atomic Pair Actions dataset using workflows
Pattern Recognition Letters
Hi-index | 0.00 |
We address the problem of recognizing sequences of human interaction patterns in meetings, with the goal of structuring them in semantic terms. The investigated patterns are inherently group-based (defined by the individual activities of meeting participants, and their interplay), and multimodal (as captured by cameras and microphones). By defining a proper set of individual actions, group actions can be modeled as a two-layer process, one that models basic individual activities from low-level audio-visual (AV) features,and another one that models the interactions. We propose a two-layer hidden Markov model (HMM) framework that implements such concept in a principled manner, and that has advantages over previous works. First, by decomposing the problem hierarchically, learning is performed on low-dimensional observation spaces, which results in simpler models. Second, our framework is easier to interpret, as both individual and group actions have a clear meaning, and thus easier to improve. Third, different HMMs can be used in each layer, to better reflect the nature of each subproblem. Our framework is general and extensible, and we illustrate it with a set of eight group actions, using a public 5-hour meeting corpus. Experiments and comparison with a single-layer HMM baseline system show its validity.