A specification language for direct-manipulation user interfaces
ACM Transactions on Graphics (TOG) - Special issue on user interface software
Developing user interfaces: ensuring usability through product & process
Developing user interfaces: ensuring usability through product & process
A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Instructions and descriptions: some cognitive aspects of programming and similar activities
AVI '00 Proceedings of the working conference on Advanced visual interfaces
Task based groupware design: putting theory into practice
DIS '00 Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques
Maintaining knowledge about temporal intervals
Communications of the ACM
Supporting presence in collaborative environments by haptic force feedback
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction and collaborative virtual environments
Life Cycle Support in the ADA Environment
Life Cycle Support in the ADA Environment
CTTE: support for developing and analyzing task models for interactive system design
IEEE Transactions on Software Engineering
Lessons from the lighthouse: collaboration in a shared mixed reality system
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Introduction to Groupware Task Analysis
TAMODIA '02 Proceedings of the First International Workshop on Task Models and Diagrams for User Interface Design
ACM Transactions on Computer-Human Interaction (TOCHI)
TAMODIA '04 Proceedings of the 3rd annual conference on Task models and diagrams
Collaborative coupling over tabletop displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the working conference on Advanced visual interfaces
SIDES: a cooperative tabletop computer game for social skills development
CSCW '06 Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work
Challenges in the analysis of multimodal messaging
CSCW '06 Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work
A tangible user interface for multi-user awareness systems
Proceedings of the 1st international conference on Tangible and embedded interaction
Shared data modeling with UML-G
International Journal of Computer Applications in Technology
Exploring true multi-user multimodal interaction over a digital table
Proceedings of the 7th ACM conference on Designing interactive systems
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Visual information as a conversational resource in collaborative physical tasks
Human-Computer Interaction
Navigation modes for combined table/screen 3D scene rendering
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
A framework for the combination and characterization of output modalities
DSV-IS'00 Proceedings of the 7th international conference on Design, specification, and verification of interactive systems
Collaborative social structures and task modelling integration
DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
Mutual awareness in collocated and distant collaborative tasks using shared interfaces
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
A conceptual and methodological framework for modeling interactive groupware applications
CRIWG'06 Proceedings of the 12th international conference on Groupware: design, implementation, and use
e-COMM, un éditeur pour spécifier l'interaction multimodale et multiutilisateur
Conference Internationale Francophone sur I'Interaction Homme-Machine
Modeling task transitions to help designing for better situation awareness
Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems
Improving support for visual task modelling
HCSE'12 Proceedings of the 4th international conference on Human-Centered Software Engineering
| Hi-index | 0.00 |
Multi-user multimodal interactive systems involve multiple users that can use multiple interaction modalities. Although multi-user multimodal systems are becoming more prevalent (especially multimodal systems involving multitouch surfaces), their design is still ad-hoc without properly keeping track of the design process. Addressing this issue of lack of design tools for multi-user multimodal systems, we present the COMM (Collaborative and MultiModal) notation and its on-line editor for specifying multi-user multimodal interactive systems. Extending the CTT notation, the salient features of the COMM notation include the concepts of interactive role and modal task as well as a refinement of the temporal operators applied to tasks using the Allen relationships. A multimodal military command post for the control of unmanned aerial vehicles (UAV) by two operators is used to illustrate the discussion.