Detection and Recognition of Periodic, Nonrigid Motion
International Journal of Computer Vision
View-Invariant Analysis of Cyclic Motion
International Journal of Computer Vision
Robust Real-Time Periodic Motion Detection, Analysis, and Applications
IEEE Transactions on Pattern Analysis and Machine Intelligence
Dynamical system representation, generation, and recognition of basic oscillatory motion gestures
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
A Parallel Algorithm for Dynamic Gesture Tracking
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Gesture Cues for Conversational Interaction in Monocular Video
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Computer Vision for Television and Games
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Describing motion for recognition
ISCV '95 Proceedings of the International Symposium on Computer Vision
Finding Periodicity in Space and Time
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
The catchment feature model: a device for multimodal fusion and a bridge between signal and sense
EURASIP Journal on Applied Signal Processing
Visual and linguistic information in gesture classification
Proceedings of the 6th international conference on Multimodal interfaces
Periodic Motion Detection and Estimation via Space-Time Sampling
WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
Meeting room configuration and multiple camera calibration in meeting analysis
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Visual and linguistic information in gesture classification
ACM SIGGRAPH 2006 Courses
Tracking hand and finger movements for behaviour analysis
Pattern Recognition Letters
Tracking hand and finger movements for behaviour analysis
Pattern Recognition Letters - Special issue on vision for crime detection and prevention
Visual and linguistic information in gesture classification
ACM SIGGRAPH 2007 courses
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Context-based conversational hand gesture classification in narrative interaction
Proceedings of the 15th ACM on International conference on multimodal interaction
Hi-index | 0.00 |
To develop multimodal interfaces, one needs to understand the constraints underlying human communicative gesticulation and the kinds of features one may compute based on these underlying human characteristics.In this paper we address hand motion oscillatory gesture detection in natural speech and conversation. First, the hand motion trajectory signals are extracted from video. Second, a wavelet analysis based approach is presented to process the signals. In this approach, wavelet ridges are extracted from the responses of wavelet analysis for the hand motion trajectory signals, which can be used to characterize frequency properties of the hand motion signals. The hand motion oscillatory gestures can be extracted from these frequency properties. Finally, we relate the hand motion oscillatory gestures to the phases of speech and multimodal discourse analysis.We demonstrate the efficacy of the system on a real discourse dataset in which a subject described her action plan to an interlocutor. We extracted the oscillatory gestures from the x, y and z motion traces of both hands. We further demonstrate the power of gestural oscillation detection as a key to unlock the structure of the underlying discourse.