A comparison of usage evaluation and inspection methods for assessing groupware usability
GROUP '01 Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work
Empirical development of a heuristic evaluation methodology for shared workspace groupware
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
The CSCW Lab for Groupware Evaluation
CRIWG '02 Proceedings of the 8th International Workshop on Groupware: Design, Implementation and Use
Evaluating a scientific collaboratory: Results of a controlled experiment
ACM Transactions on Computer-Human Interaction (TOCHI)
WETICE '03 Proceedings of the Twelfth International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises
E-MAGINE: The Development of an Evaluation Method to Assess Groupware Applications
WETICE '03 Proceedings of the Twelfth International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises
WETICE '03 Proceedings of the Twelfth International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises
Evaluating computer-supported cooperative work: models and frameworks
CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
A new direction for log file analysis in CSCL: experiences with a spatio-temporal metric
CSCL '05 Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years!
Supporting multiple viewpoints in collaborative graphical editing
Multimedia Tools and Applications
Desafios para testes de usuários em sistemas colaborativos - lições de um estudo de caso
IHC '06 Proceedings of VII Brazilian symposium on Human factors in computing systems
A learning evaluation framework to support the schoolsenses@internet project
WBED'07 Proceedings of the sixth conference on IASTED International Conference Web-Based Education - Volume 2
Usability evaluation considered harmful (some of the time)
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A conceptual framework for designing and conducting groupware evaluations
International Journal of Computer Applications in Technology
Empirical evaluation in Computer Science research published by ACM
Information and Software Technology
Groupware: Design, Implementation, and Use
The needlework in evaluating a CSCL system: the evaluand oriented responsive evaluation model
CSCL'09 Proceedings of the 9th international conference on Computer supported collaborative learning - Volume 1
HCD 09 Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009
Remote Hands-On Experience: Distributed Collaboration with Augmented Reality
EC-TEL '09 Proceedings of the 4th European Conference on Technology Enhanced Learning: Learning in the Synergy of Multiple Disciplines
Usability of multilingual communication tools
UI-HCII'07 Proceedings of the 2nd international conference on Usability and internationalization
Evaluation methods for groupware systems
CRIWG'07 Proceedings of the 13th international conference on Groupware: design implementation, and use
Strategies and taxonomy, tailoring your CSCW evaluation
CRIWG'09 Proceedings of the 15th international conference on Groupware: design, implementation, and use
Efficient graph partitioning algorithms for collaborative grid workflow developer environments
EuroPar'10 Proceedings of the 16th international Euro-Par conference on Parallel processing: Part I
Comparing user experience and performance in secondlife and blackboard
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Protecting the consistency of workflow applications in collaborative development environments
Future Generation Computer Systems
Social interaction regulation in virtual web environments using the Social Theatres model
Journal of Network and Computer Applications
Structuring dimensions for collaborative systems evaluation
ACM Computing Surveys (CSUR)
CRIWG'06 Proceedings of the 12th international conference on Groupware: design, implementation, and use
Investigating user experience in Second Life for collaborative learning
International Journal of Human-Computer Studies
International Journal of Information Management: The Journal for Information Professionals
Proceedings of the Designing Interactive Systems Conference
Caracterização das adaptações em métodos de avaliação para aplicações colaborativas
Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems
Repositório Virtual para Catalogação de Métodos de Avaliação para Sistemas Colaborativos
Proceedings of the X Brazilian Symposium in Collaborative Systems
Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems
Hi-index | 0.00 |
A better understanding of how groupware systems have been evaluated in the past can help to frame the discussion of what methods and techniques should be considered for future evaluations. We reviewed all papers from the ACM CSCW conference (1990-1998) that introduced or evaluated a groupware system. Forty-five papers were included in the review. The main findings are that almost one-third of the groupware systems were not evaluated in any formal way, that only about one-quarter of the articles included evaluations in a real-world setting, and that a wide variety of evaluation techniques are in use. Our main conclusions from the review are that more attention must be paid to evaluating groupware systems and that there is room for additional evaluation techniques that are simple and low in cost.