Real-Time Detection of Nodding and Head-Shaking by Directly Detecting and Tracking the "Between-Eyes"

Authors:
Shinjiro Kawato;Jun Ohya
Affiliations:
-;-
Venue:
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Year:
2000

Citing 0
Cited 27

A real-time head nod and shake detector

Proceedings of the 2001 workshop on Perceptive user interfaces
Robust real-time eye detection and tracking under variable lighting conditions and various face orientations

Computer Vision and Image Understanding - Special issue on eye detection and tracking
Head gesture recognition in intelligent interfaces: the role of context in improving recognition

Proceedings of the 11th international conference on Intelligent user interfaces
Head gestures for perceptual interfaces: The role of context in improving recognition

Artificial Intelligence
Color segmentation robust to brightness variations by using B-spline curve modeling

Pattern Recognition
Human eye sclera detection and tracking using a modified time-adaptive self-organizing map

Pattern Recognition
Context-based recognition during human interactions: automatic feature selection and encoding dictionary

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
A preliminary evaluation of head and facial feature tracking for input on mobile devices

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Robust real-time eye detection and tracking under variable lighting conditions and various face orientations

Computer Vision and Image Understanding - Special issue on eye detection and tracking
Co-occurrence graphs: contextual representation for head gesture recognition during multi-party interactions

Proceedings of the Workshop on Use of Context in Vision Processing
Confidence based gating of colour features for face authentication

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners

IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Skin detection using neighborhood information

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
A real-time attitude recognition by eye-tracking

Proceedings of the Third International Conference on Internet Multimedia Computing and Service
A robust and efficient algorithm for eye detection on gray intensity face

ICAPR'05 Proceedings of the Third international conference on Pattern Recognition and Image Analysis - Volume Part II
Real time head nod and shake detection using HMMs

KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
Head gesture recognition based on bayesian network

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part I
SVM-based selection of colour space experts for face authentication

ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools

Image and Vision Computing
3D Virtual worlds and the metaverse: Current status and future possibilities

ACM Computing Surveys (CSUR)
Feature local binary patterns with application to eye detection

Neurocomputing
MACH: my automated conversation coach

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
A literature survey on robust and efficient eye localization in real-life scenarios

Pattern Recognition
Video analysis of approach-avoidance behaviors of teenagers speaking with virtual agents

Proceedings of the 15th ACM on International conference on multimodal interaction
Context-based conversational hand gesture classification in narrative interaction

Proceedings of the 15th ACM on International conference on multimodal interaction
Detecting driver drowsiness using feature-level fusion and user-specific classification

Expert Systems with Applications: An International Journal
Development of head detection and tracking systems for visual surveillance

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.01

Visualization

Abstract

Among head gestures, nodding and head-shaking are very common and used often. Thus the detection of such gestures is basic to a visual understanding of human responses. However it is difficult to detect them in real-time, because nodding and head-shaking are fairly small and fast head movements.In this paper, we propose an approach for detecting nodding and head-shaking in real time from a single color video stream by directly detecting and tracking a point between the eyes, or what we call the "between-eyes". Along a circle of a certain radius centered at the "between-eyes", the pixel value has two cycles of bright parts (forehead and nose bridge) and dark parts (eyes and brows). The output of the proposed circle-frequency filter has a local maximum at these characteristic points. To distinguish the true "between-eyes" from similar characteristic points in other face parts, we do a confirmation with eye detection.Once the "between-eyes" is detected, a small area around it is copied as a template and the system enters the tracking mode. Combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/sec rate without special hardware. By analyzing the movement of the point, we can detect nodding and head-shaking. Some experimental results are shown.