Recognition of Visual Activities and Interactions by Stochastic Parsing
IEEE Transactions on Pattern Analysis and Machine Intelligence
Coupled hidden Markov models for complex action recognition
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Georgia tech gesture toolkit: supporting experiments in gesture recognition
Proceedings of the 5th international conference on Multimodal interfaces
Workflow mining: a survey of issues and approaches
Data & Knowledge Engineering
Computers in Industry - Special issue: Process/workflow mining
Analyzing features for activity recognition
Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Activity recognition from accelerometer data
IAAI'05 Proceedings of the 17th conference on Innovative applications of artificial intelligence - Volume 3
GART: the gesture and activity recognition toolkit
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Automatic workflow monitoring in industrial environments
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
COSIT'11 Proceedings of the 10th international conference on Spatial information theory
Probabilistic latent semantic analysis
UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Machine learning for time interval petri nets
AI'05 Proceedings of the 18th Australian Joint conference on Advances in Artificial Intelligence
A Constrained Probabilistic Petri Net Framework for Human Activity Detection in Video*
IEEE Transactions on Multimedia
Egocentric activity monitoring and recovery
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
| Hi-index | 0.00 |
Live workflow monitoring and the resulting user interaction in industrial settings faces a number of challenges. A formal workflow may be unknown or implicit, data may be sparse and certain isolated actions may be undetectable given current visual feature extraction technology. This paper attempts to address these problems by inducing a structural workflow model from multiple expert demonstrations. When interacting with a naive user, this workflow is combined with spatial and temporal information, under a Bayesian framework, to give appropriate feedback and instruction. Structural information is captured by translating a Markov chain of actions into a simple place/transition petri-net. This novel petri-net structure maintains a continuous record of the current workbench configuration and allows multiple sub-sequences to be monitored without resorting to second order processes. This allows the user to switch between multiple sub-tasks, while still receiving informative feedback from the system. As this model captures the complete workflow, human inspection of safety critical processes and expert annotation of user instructions can be made. Activity classification and user instruction results show a significant on-line performance improvement when compared to the existing Hidden Markov Model or pLSA based state of the art. Further analysis reveals that the majority of our model's classification errors are caused by small de-synchronisation events rather than significant workflow deviations. We conclude with a discussion of the generalisability of the induced place/transition petri-net to other activity recognition tasks and summarise the developments of this model.