Flocks, herds and schools: A distributed behavioral model
SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Decision estimation and classification: an introduction to pattern recognition and related topics
Decision estimation and classification: an introduction to pattern recognition and related topics
Made-up minds: a constructivist approach to artificial intelligence
Made-up minds: a constructivist approach to artificial intelligence
Reinforcement learning architectures for animats
Proceedings of the first international conference on simulation of adaptive behavior on From animals to animats
Technical Note: \cal Q-Learning
Machine Learning
Fundamentals of speech recognition
Fundamentals of speech recognition
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Artificial fishes: physics, locomotion, perception, behavior
SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Multi-level direction of autonomous creatures for real-time virtual environments
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Automated learning of muscle-actuated locomotion through control abstraction
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Improv: a system for scripting interactive actors in virtual worlds
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Adapting simulated behaviors for new characters
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Creatures: artificial life autonomous software agents for home entertainment
AGENTS '97 Proceedings of the first international conference on Autonomous agents
An introduction to natural computation
An introduction to natural computation
NeuroAnimator: fast neural network emulation and control of physics-based models
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Retargetting motion to new characters
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Cognitive modeling: knowledge, reasoning and planning for intelligent characters
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Motivation driven learning for interactive synthetic characters
AGENTS '00 Proceedings of the fourth international conference on Autonomous agents
Composable controllers for physics-based character animation
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
AI Game Programming Wisdom
AI Game Programming Wisdom
Machine Learning
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
Verbs and Adverbs: Multidimensional Motion Interpolation
IEEE Computer Graphics and Applications
Expectation Maximization for Weakly Labeled Data
ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Interactive Training for Synthetic Characters
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Learning in embedded systems
A layered brain architecture for synthetic creatures
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Robot's play: interactive games with sociable machines
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
System for authoring highly interactive, personality-rich interactive characters
SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Precomputing avatar behavior from human motion data
SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Affective Learning — A Manifesto
BT Technology Journal
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Fast multi-level adaptation for interactive autonomous characters
ACM Transactions on Graphics (TOG)
Robot's play: interactive games with sociable machines
Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology
Imitation as a first step to social learning in synthetic characters: a graph-based approach
Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation
Autonomous virtual agents learning a cognitive model and evolving
Lecture Notes in Computer Science
Teaching virtual characters how to use body language
Lecture Notes in Computer Science
Precomputing avatar behavior from human motion data
Graphical Models - Special issue on SCA 2004
Human-scale haptic interaction with a reactive virtual human in a real-time physics simulator
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Learnable behavioural model for autonomous virtual agents: low-level learning
AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
Untethered robotic play for repetitive physical tasks
Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology
Human scale haptic interaction with a reactive virtual human in a realtime physics simulator
Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology
Integrate and conquer: the next generation of intelligent avatars
Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology
Imitation and social intelligence for synthetic characters
SIGGRAPH '04 ACM SIGGRAPH 2004 Sketches
ACM SIGGRAPH 2002 conference abstracts and applications
A decision network framework for the behavioral animation of virtual humans
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Teachable robots: Understanding human teaching behavior to build more effective robot learners
Artificial Intelligence
ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Theoretical and Methodological Issues
Video agent: interactive autonomous agents generated from real-world creatures
Proceedings of the 2008 ACM symposium on Virtual reality software and technology
Agent's actions as a classification criteria for the state space in a learning from rewards system
Journal of Experimental & Theoretical Artificial Intelligence
Connection Science - Social Learning in Embodied Agents
Crafting game-models using reactive system design
Future Play '08 Proceedings of the 2008 Conference on Future Play: Research, Play, Share
Learning about objects with human teachers
Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
How people talk when teaching a robot
Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
Modeling emotional action for social characters
The Knowledge Engineering Review
Perspective taking: an organizing principle for learning in human-robot interaction
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Interactively shaping agents via human reinforcement: the TAMER framework
Proceedings of the fifth international conference on Knowledge capture
Machine learning in digital games: a survey
Artificial Intelligence Review
Virtual reality and mixed reality for virtual learning environments
Computers and Graphics
An integrated approach to emotional speech and gesture synthesis in humanoid robots
Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots
Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human
Teaching a pet-robot to understand user feedback through interactive virtual training tasks
Autonomous Agents and Multi-Agent Systems
Transparent active learning for robots
Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Interactive robot task learning
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Combining manual feedback with subsequent MDP reward signals for reinforcement learning
Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
Bosu: a physical programmable design tool for transformability with soft mechanics
Proceedings of the 8th ACM Conference on Designing Interactive Systems
Exploiting social partners in robot learning
Autonomous Robots
Integrating reinforcement learning with human demonstrations of varying ability
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
An emotion model for virtual agents with evolvable motivation
Transactions on edutainment VI
Teachable characters: user studies, design principles, and learning performance
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Building a believable character for real-time virtual environments
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
Collaborative virtual learning environment using synthetic characters
ICWL'05 Proceedings of the 4th international conference on Advances in Web-Based Learning
E-Learning environment based on intelligent synthetic characters
ICCSA'05 Proceedings of the 2005 international conference on Computational Science and Its Applications - Volume Part IV
Timing multimodal turn-taking for human-robot cooperation
Proceedings of the 14th ACM international conference on Multimodal interaction
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Planning interactive task for intelligent characters
Computer Animation and Virtual Worlds
Manipulating mental states through physical action
ICSR'12 Proceedings of the 4th international conference on Social Robotics
Game designers training first person shooter bots
AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
Using informative behavior to increase engagement in the tamer framework
Proceedings of the 2013 international conference on Autonomous agents and multi-agent systems
Socially guided intrinsic motivation for robot learning of motor skills
Autonomous Robots
Intelligent virtual humans with autonomy and personality: State-of-the-art
Intelligent Decision Technologies
Hi-index | 0.00 |
The ability to learn is a potentially compelling and important quality for interactive synthetic characters. To that end, we describe a practical approach to real-time learning for synthetic characters. Our implementation is grounded in the techniques of reinforcement learning and informed by insights from animal training. It simplifies the learning task for characters by (a) enabling them to take advantage of predictable regularities in their world, (b) allowing them to make maximal use of any supervisory signals, and (c) making them easy to train by humans.We built an autonomous animated dog that can be trained with a technique used to train real dogs called "clicker training". Capabilities demonstrated include being trained to recognize and use acoustic patterns as cues for actions, as well as to synthesize new actions from novel paths through its motion space.A key contribution of this paper is to demonstrate that by addressing the three problems of state, action, and state-action space discovery at the same time, the solution for each becomes easier. Finally, we articulate heuristics and design principles that make learning practical for synthetic characters.