Plans and situated actions: the problem of human-machine communication
Plans and situated actions: the problem of human-machine communication
Why CSCW applications fail: problems in the design and evaluationof organizational interfaces
CSCW '88 Proceedings of the 1988 ACM conference on Computer-supported cooperative work
Looking at ourselves: an examination of the social organisation of two research laboratories
CSCW '92 Proceedings of the 1992 ACM conference on Computer-supported cooperative work
Getting around the task-artifact cycle: how to make claims and design by scenario
ACM Transactions on Information Systems (TOIS)
Usability inspection methods
Exploring obstacles: integrating CSCW in evolving organisations
CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Moving out from the control room: ethnography in system design
CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Situated evaluation for cooperative systems
CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Technological frames: making sense of information technology in organizations
ACM Transactions on Information Systems (TOIS) - Special issue on social science perspectives on IS
Scenario-based design: envisioning work and technology in system development
Scenario-based design: envisioning work and technology in system development
A usability study of awareness widgets in a shared workspace groupware system
CSCW '96 Proceedings of the 1996 ACM conference on Computer supported cooperative work
Evaluating usability evaluation techniques
ACM Computing Surveys (CSUR) - Special issue: position statements on strategic directions in computing research
The Use of Cooperation Scenarios in the Design and Evaluation of a CSCW System
IEEE Transactions on Software Engineering
Making Use of Scenarios for Validating Analysis and Design
IEEE Transactions on Software Engineering
Social, individual and technological issues for groupware calendar systems
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Evaluation for collaborative systems
ACM Computing Surveys (CSUR)
Process descriptions as organisational accounting devices: the dual use of workflow technologies
GROUP '01 Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work
A comparison of usage evaluation and inspection methods for assessing groupware usability
GROUP '01 Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work
Usability engineering: scenario-based development of human-computer interaction
Usability engineering: scenario-based development of human-computer interaction
Groupware walkthrough: adding context to groupware usability evaluation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Making Use: Scenario-Based Design of Human-Computer Interactions
Making Use: Scenario-Based Design of Human-Computer Interactions
Trouble with Computers: Usefulness, Usability, and Productivity
Trouble with Computers: Usefulness, Usability, and Productivity
Usability Engineering
Empirical development of a heuristic evaluation methodology for shared workspace groupware
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
Scenario-Based Analysis of Software Architecture
IEEE Software
Notification and awareness: synchronizing task-oriented collaborative activity
International Journal of Human-Computer Studies - Notification user interfaces
The intellectual challenge of CSCW: the gap between social requirements and technical feasibility
Human-Computer Interaction
"...real, concrete facts about what works...": integrating evaluation and design through patterns
GROUP '05 Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work
How do design and evaluation interrelate in HCI research?
DIS '06 Proceedings of the 6th conference on Designing Interactive systems
Collaborative architecture design and evaluation
DIS '06 Proceedings of the 6th conference on Designing Interactive systems
Exploring the interrelationships between the design and evaluation of interactive systems
DIS '06 Proceedings of the 6th conference on Designing Interactive systems
The potential impact of 3d telepresence technology on task performance in emergency trauma care
Proceedings of the 2007 international ACM conference on Supporting group work
Evaluating a Mobile Emergency Response System
Groupware: Design, Implementation, and Use
A factor analytic approach towards determining mobile tourism services
Proceedings of the 11th International Conference on Electronic Commerce
Scenario-based assessment of learning experiences
FIE'09 Proceedings of the 39th IEEE international conference on Frontiers in education conference
Teaching privacy with ubicomp scenarios in HCI classes
OZCHI '09 Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7
Use case evaluation (UCE): a method for early usability evaluation in software development
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
Evaluation methods for groupware systems
CRIWG'07 Proceedings of the 13th international conference on Groupware: design implementation, and use
Structuring dimensions for collaborative systems evaluation
ACM Computing Surveys (CSUR)
| Hi-index | 0.00 |
We report on the use of scenario-based methods for evaluating collaborative systems. We describe the method, the case study where it was applied, and provide results of its efficacy in the field. The results suggest that scenario-based evaluation is effective in helping to focus evaluation efforts and in identifying the range of technical, human, organizational and other contextual factors that impact system success. The method also helps identify specific actions, for example, prescriptions for design to enhance system effectiveness. However, we found the method somewhat less useful for identifying the measurable benefits gained from a CSCW implementation, which was one of our primary goals. We discuss challenges faced applying the technique, suggest recommendations for future research, and point to implications for practice.