Eyes alive

Authors:
Sooha Park Lee;Jeremy B. Badler;Norman I. Badler
Affiliations:
University of Pennsylvania;The Smith-Kettlewell Eye Research Institute;University of Pennsylvania
Venue:
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Year:
2002

Citing 16
Cited 62

A Computational Approach to Edge Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Making faces

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
An anthropometric face model using variational techniques

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Where to look? Automating attending behaviors of virtual human characters

Proceedings of the third annual conference on Autonomous Agents
Voice puppetry

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
BEAT: the Behavior Expression Animation Toolkit

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Why conversational agents should catch the eye

CHI '00 Extended Abstracts on Human Factors in Computing Systems
Animating facial expressions

SIGGRAPH '81 Proceedings of the 8th annual conference on Computer graphics and interactive techniques
Facial expression recognition using a dynamic model and motion energy

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
A parametric model for human faces.

A parametric model for human faces.

FacEMOTE: qualitative parametric modifiers for facial animations

Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Practical eye movement model using texture synthesis

ACM SIGGRAPH 2003 Sketches & Applications
Speaking with hands: creating animated conversational characters from recordings of human performance

ACM SIGGRAPH 2004 Papers
Synthesizing animations of human manipulation tasks

ACM SIGGRAPH 2004 Papers
Automated Eye Motion Using Texture Synthesis

IEEE Computer Graphics and Applications
Automatic determination of facial muscle activations from sparse motion capture marker data

ACM SIGGRAPH 2005 Papers
Expressive speech-driven facial animation

ACM Transactions on Graphics (TOG)
Do you see what eyes see?: implementing inattentional blindness

Lecture Notes in Computer Science
Where do they look?: Gaze behaviors of multiple users interacting with an embodied conversational agent

Lecture Notes in Computer Science
Meticulously Detailed Eye Region Model and Its Application to Analysis of Facial Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Measuring gaze direction perception capability of humans to design human centered communication systems

Presence: Teleoperators and Virtual Environments
Recognizing gaze aversion gestures in embodied conversational discourse

Proceedings of the 8th international conference on Multimodal interfaces
Is a 3-D image necessary to determine eye gaze?

Journal of Computing Sciences in Colleges
An assessment of eye-gaze potential within immersive virtual environments

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Gaze Patterns during Face-to-Face Interaction

WI-IATW '07 Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops
Effects of avatar's blinking animation on person impressions

GI '08 Proceedings of graphics interface 2008
Providing expressive gaze to virtual animated characters in interactive applications

Computers in Entertainment (CIE) - SPECIAL ISSUE: Media Arts
A model of gaze for the purpose of emotional expression in virtual embodied agents

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
Emotionally Expressive Head and Body Movement During Gaze Shifts

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Scrutinizing Natural Scenes: Controlling the Gaze of an Embodied Conversational Agent

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Automatic Generation of Expressive Gaze in Virtual Animated Characters: From Artists Craft to a Behavioral Animation Model

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Analyzing Gaze During Face-to-Face Interaction

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
The Relation between Gaze Behavior and the Attribution of Emotion: An Empirical Study

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
IGaze: Studying Reactive Gaze Behavior in Semi-immersive Human-Avatar Interactions

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments

Proceedings of the 2008 ACM conference on Computer supported cooperative work
Communicating Eye Gaze across a Distance without Rooting Participants to the Spot

DS-RT '08 Proceedings of the 2008 12th IEEE/ACM International Symposium on Distributed Simulation and Real-Time Applications
Animating Speech in Games

Motion in Games
E-Drama: Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters

International Journal of Artificial Intelligence in Education
Towards Facial Gestures Generation by Speech Signal Analysis Using HUGE Architecture

Multimodal Signals: Cognitive and Algorithmic Issues
Photorealistic models for pupil light reflex and iridal pattern deformation

ACM Transactions on Graphics (TOG)
On uniform resampling and gaze analysis of bidirectional texture functions

ACM Transactions on Applied Perception (TAP)
Animating Idle Gaze in Public Places

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
A saliency-based method of simulating visual attention in virtual scenes

Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology
Providing expressive eye movement to virtual agents

Proceedings of the 2009 international conference on Multimodal interfaces
An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behavior

Computers in Entertainment (CIE) - SPECIAL ISSUE: Games
Glances, glares, and glowering: how should a virtual human express emotion through gaze?

Autonomous Agents and Multi-Agent Systems
Anatomy-based face reconstruction for animation using multi-layer deformation

Journal of Visual Languages and Computing
Gaze, conversational agents and face-to-face communication

Speech Communication
From annotated multimodal corpora to simulated human-like behaviors

ZiF'06 Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans
Comparing and evaluating real time character engines for virtual environments

Presence: Teleoperators and Virtual Environments
Experimental platform for Wizard-of-Oz evaluations of biomimetic active vision in robots

ROBIO'09 Proceedings of the 2009 international conference on Robotics and biomimetics
Towards an expressive virtual tutor: an implementation of a virtual tutor based on an empirical study of non-verbal behaviour

Proceedings of the 2010 ACM workshop on Surreal media and virtual cloning
Graphics for Serious Games: A head movement propensity model for animating gaze shifts and blinks of virtual characters

Computers and Graphics
Discovering eye gaze behavior during human-agent conversation in an interactive storytelling application

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Realistic emotional gaze and head behavior generation based on arousal and dominance factors

MIG'10 Proceedings of the Third international conference on Motion in games
Interacting with a gaze-aware virtual character

Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction
Modeling and animating eye blinks

ACM Transactions on Applied Perception (TAP)
The SignCom system for data-driven animation of interactive virtual signers: Methodology and Evaluation

ACM Transactions on Interactive Intelligent Systems (TiiS)
Conversational gaze mechanisms for humanlike robots

ACM Transactions on Interactive Intelligent Systems (TiiS)
Visual attention and eye gaze during multiparty conversations with distractions

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
[HUGE]: universal architecture for statistically based HUman GEsturing

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Embodied conversational agents: computing and rendering realistic gaze patterns

PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
Intelligent content production for a virtual speaker

IMTCI'04 Proceedings of the Second international conference on Intelligent Media Technology for Communicative Intelligence
An example-based motion synthesis technique for locomotion and object manipulation

I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Reactive virtual creatures for dexterous physical interactions

MIG'11 Proceedings of the 4th international conference on Motion in Games
Building a character animation system

MIG'11 Proceedings of the 4th international conference on Motion in Games
Eyecatch: simulating visuomotor coordination for object interception

ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Designing effective gaze mechanisms for virtual agents

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Emotional eye movement generation based on Geneva Emotion Wheel for virtual agents

Journal of Visual Languages and Computing
Short paper: exploring the object relevance of a gaze animation model

EGVE - JVRC'11 Proceedings of the 17th Eurographics conference on Virtual Environments & Third Joint Virtual Reality
A head-eye coordination model for animating gaze shifts of virtual characters

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

For an animated human face model to appear natural it should produce eye movements consistent with human ocular behavior. During face-to-face conversational interactions, eyes exhibit conversational turn-taking and agent thought processes through gaze direction, saccades, and scan patterns. We have implemented an eye movement model based on empirical models of saccades and statistical models of eye-tracking data. Face animations using stationary eyes, eyes with random saccades only, and eyes with statistically derived saccades are compared, to evaluate whether they appear natural and effective while communicating.