AffectAura: an intelligent system for emotional memory

Authors:
Daniel McDuff;Amy Karlson;Ashish Kapoor;Asta Roseway;Mary Czerwinski
Affiliations:
MIT Media Lab, Cambridge, MA, USA;Microsoft Research, Redmond, Washington, United States;Microsoft Research, Redmond, Washington, United States;Microsoft Research, Redmond, Washington, United States;Microsoft Research, Redmond, Washington, United States
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2012

Citing 15
Cited 11

Active shape models—their training and application

Computer Vision and Image Understanding
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
StartleCam: A Cybernetic Wearable Camera

ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
On artificial bandwidth extension of telephone speech

Signal Processing - Special section: Hans Wilhelm Schüßler celebrates his 75th birthday
Examining task engagement in sensor-based statistical models of human interruptibility

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Affect: from information to interaction

Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility
Multimodal affect recognition in learning environments

Proceedings of the 13th annual ACM international conference on Multimedia
Invited Talk: An Exploratory Social-Emotional Prosthetic for Autism Spectrum Disorders

BSN '06 Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks
Visualizing email content: portraying relationships from conversational histories

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Understanding memory triggers for task tracking

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Experiencing the Affective Diary

Personal and Ubiquitous Computing
Data portraits

ACM SIGGRAPH 2010 Art Gallery
Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal Space

IEEE Transactions on Affective Computing
Visualization of Time-Oriented Data

Visualization of Time-Oriented Data
Real-time human pose recognition in parts from single depth images

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition

Understanding affect in the workplace via social media

Proceedings of the 2013 conference on Computer supported cooperative work
Informing intelligent user interfaces by inferring affective states from body postures in ubiquitous computing environments

Proceedings of the 2013 international conference on Intelligent user interfaces
Echoes from the past: how technology mediated reflection improves well-being

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Personal informatics and reflection: a critical examination of the nature of reflection

CHI '13 Extended Abstracts on Human Factors in Computing Systems
Towards emotional awareness in software development teams

Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering
MoodWings: a wearable biofeedback device for real-time stress intervention

Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments
Capturing the mood: facebook and face-to-face encounters in the workplace

Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
"Moon Phrases": a social media faciliated tool for emotional reflection and wellness

Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare
Enabling self-reflection with LifelogExplorer: generating simple views from complex data

Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare
Lifestyle stories: correlating user information through a story-inspired paradigm

Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare
Exploiting linked data to create rich human digital memories

Computer Communications

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present AffectAura, an emotional prosthetic that allows users to reflect on their emotional states over long periods of time. We designed a multimodal sensor set-up for continuous logging of audio, visual, physiological and contextual data, a classification scheme for predicting user affective state and an interface for user reflection. The system continuously predicts a user's valence, arousal and engage-ment, and correlates this with information on events, communications and data interactions. We evaluate the interface through a user study consisting of six users and over 240 hours of data, and demonstrate the utility of such a reflection tool. We show that users could reason forward and backward in time about their emotional experiences using the interface, and found this useful.