Survey measures for evaluation of cognitive assistants

Authors:
Aaron Steinfeld;Pablo-Alejandro Quinones;John Zimmerman;S. Rachael Bennett;Dan Siewiorek
Affiliations:
Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA
Venue:
PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems
Year:
2007

Citing 8
Cited 3

Coordination, overload and team performance: effects of team communication strategies

CSCW '98 Proceedings of the 1998 ACM conference on Computer supported cooperative work
An adaptive stock tracker for personalized trading advice

Proceedings of the 8th international conference on Intelligent user interfaces
Simulation of a Vehicle Traffic Control Network Using a Fuzzy Classifier System

SS '02 Proceedings of the 35th Annual Simulation Symposium
Using on-line surveys to measure three key constructs of the quality of human-computer interaction in web sites: psychometric properties and implications

International Journal of Human-Computer Studies
Automatic extraction of titles from general documents using machine learning

Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries
Machine Learning for Clinical Diagnosis from Functional Magnetic Resonance Imaging

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
A hybrid learning system for recognizing user tasks from desktop activities and email messages

Proceedings of the 11th international conference on Intelligent user interfaces
Evaluation of an integrated multi-task machine learning system with humans in the loop

PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems

RADAR: a personal assistant that learns to reduce email overload

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
Evaluation of an integrated multi-task machine learning system with humans in the loop

PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems
Agent-assisted task management that reduces email overload

Proceedings of the 15th international conference on Intelligent user interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

A survey designed to measure subject perception of benefit, ease of use, usefulness, collaboration, disorientation, flow, and assistance was used to evaluate two releases of an integrated machine learning cognitive assistance system. The design and validity of this evaluation survey is discussed in the context of an information overload experiment.