Multimodal archiving, real-time annotation and information visualization in a biofeedback system for stroke patient rehabilitation

Authors:
Weiwei Xu;Yinpeng Chen;Hari Sundaram;Thanassis Rikakis
Affiliations:
Arizona State University;Arizona State University;Arizona State University;Arizona State University
Venue:
Proceedings of the 3rd ACM workshop on Continuous archival and retrival of personal experences
Year:
2006

Citing 9
Cited 5

LifeLines: visualizing personal histories

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using Web annotations for asynchronous collaboration around documents

CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
The use of visual information in shared visual spaces: informing the development of virtual co-presence

CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
MyLifeBits: fulfilling the Memex vision

Proceedings of the tenth ACM international conference on Multimedia
Photo annotation on a camera phone

CHI '04 Extended Abstracts on Human Factors in Computing Systems
A collaborative annotation system for data visualization

Proceedings of the working conference on Advanced visual interfaces
Asynchronous collaborative writing through annotations

CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
Effects of task properties, partner actions, and message content on eye gaze patterns in a collaborative task

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SenseCam: a retrospective memory aid

UbiComp'06 Proceedings of the 8th international conference on Ubiquitous Computing

Media adaptation framework in biofeedback system for stroke patient rehabilitation

Proceedings of the 15th international conference on Multimedia
A dynamic decision network framework for online media adaptation in stroke rehabilitation

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Comparing Usage Performance on Mobile Applications

Groupware: Design, Implementation, and Use
Ubiquitous Computing for Capture and Access

Foundations and Trends in Human-Computer Interaction
Fear therapy for children: a mobile approach

Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present our work on a system to support real-time multimodal archiving, collaborative annotation and offline information visualization for a biofeedback stroke-rehabilitation application. Our archiving / annotation / visualization system can play a critical role in the long-term biofeedback stroke therapy by supporting cooperative data analysis and media feedback as well as by providing the therapist with insight into computing-supported therapy. There are three contributions of this paper: (a) the design of a robust archiving system that archives in real time parametric model data (motion capture, motion analysis and audio / visual synthesis parameters) as well as audio / video from the biofeedback environment. (b) a web-based annotation tool designed with low cognitive load (c) a hierarchical information visualization tool that enables the therapist and other team members to examine quantitative motion analysis of subject performance with the context of media feedback, thus enabling collaborative insights. Our user studies indicate that the system performs well.