Creating Interactive Virtual Humans: Some Assembly Required
IEEE Intelligent Systems
International Journal of Human-Computer Studies - Special issue: Subtle expressivity for characters and robots
Real faces and robot faces: The effects of representation on computer-mediated communication
International Journal of Human-Computer Studies
The effect of dynamics on identifying basic emotions from synthetic and natural faces
International Journal of Human-Computer Studies
Evaluation of Justina: A Virtual Patient with PTSD
IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Affective interaction: How emotional agents affect users
International Journal of Human-Computer Studies
An Introduction to MultiAgent Systems
An Introduction to MultiAgent Systems
Border Security Credibility Assessments via Heterogeneous Sensor Fusion
IEEE Intelligent Systems
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Perceiving visual emotions with speech
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Evaluating humanoid synthetic agents in e-retail applications
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
EACL 2012 Proceedings of the Workshop on Computational Approaches to Deception Detection
The role of theory in gender and information systems research
Information and Organization
Hi-index | 0.00 |
We have created an automated kiosk that uses embodied intelligent agents to interview individuals and detect changes in arousal, behavior, and cognitive effort by using psychophysiological information systems. In this paper, we describe the system and propose a unique class of intelligent agents, which are described as Special Purpose Embodied Conversational Intelligence with Environmental Sensors (SPECIES). SPECIES agents use heterogeneous sensors to detect human physiology and behavior during interactions, and they affect their environment by influencing human behavior using various embodied states (i.e., gender and demeanor), messages, and recommendations. Based on the SPECIES paradigm, we present three studies that evaluate different portions of the model, and these studies are used as foundational research for the development of the automated kiosk. The first study evaluates human-computer interaction and how SPECIES agents can change perceptions of information systems by varying appearance and demeanor. Instantiations that had the agents embodied as males were perceived as more powerful, while female embodied agents were perceived as more likable. Similarly, smiling agents were perceived as more likable than neutral demeanor agents. The second study demonstrated that a single sensor measuring vocal pitch provides SPECIES with environmental awareness of human stress and deception. The final study ties the first two studies together and demonstrates an avatar-based kiosk that asks questions and measures the responses using vocalic measurements.