Sharing views and interactions with single-user applications
COCS '90 Proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on Office information systems
Findings from observational studies of collaborative work
International Journal of Man-Machine Studies - Computer-supported cooperative work and groupware. Part 1
Integration of interpersonal space and shared workspace: ClearBoard design and experiments
ACM Transactions on Information Systems (TOIS)
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Human-computer interaction (2nd ed.)
Human-computer interaction (2nd ed.)
Design for individuals, design for groups: tradeoffs between power and workspace awareness
CSCW '98 Proceedings of the 1998 ACM conference on Computer supported cooperative work
Ten myths of multimodal interaction
Communications of the ACM
Creating tangible interfaces by augmenting physical objects with multimodal language
Proceedings of the 6th international conference on Intelligent user interfaces
DiamondTouch: a multi-user touch technology
Proceedings of the 14th annual ACM symposium on User interface software and technology
SmartSkin: an infrastructure for freehand manipulation on interactive surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Customizable physical interfaces for interacting with conventional applications
Proceedings of the 15th annual ACM symposium on User interface software and technology
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Multimodal Interaction During Multiparty Dialogues: Initial Results
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays
Proceedings of the 16th annual ACM symposium on User interface software and technology
ACM Transactions on Computer-Human Interaction (TOCHI)
Beyond "social protocols": multi-user coordination policies for co-located groupware
CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
Roles of Orientation in Tabletop Collaboration: Comprehension, Coordination and Communication
Computer Supported Cooperative Work
Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces
TABLETOP '06 Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems
Empirical investigation into the effect of orientation on text readability in tabletop displays
ECSCW'05 Proceedings of the ninth conference on European Conference on Computer Supported Cooperative Work
Multimodal interactive maps: designing for human performance
Human-Computer Interaction
Informing the Design of Direct-Touch Tabletops
IEEE Computer Graphics and Applications
Multi-user, multi-display interaction with a single-user, single-display geospatial application
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Proceedings of the 8th international conference on Multimodal interfaces
Tangible tiles: design and evaluation of a tangible user interface in a collaborative tabletop setup
OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
How pairs interact over a multimodal digital table
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal multiplayer tabletop gaming
Computers in Entertainment (CIE) - Interactive TV
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
Exploring true multi-user multimodal interaction over a digital table
Proceedings of the 7th ACM conference on Designing interactive systems
Comparing Mixed Interactive Systems for Navigating 3D Environments in Museums
Interactive Systems. Design, Specification, and Verification
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
From Desktop to Tabletop: Migrating the User Interface of AgilePlanner
HCSE-TAMODIA '08 Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams
Supporting medical conversations between deaf and hearing individuals with tabletop displays
Proceedings of the 2008 ACM conference on Computer supported cooperative work
User-defined gestures for surface computing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Territorial coordination and workspace awareness in remote tabletop collaboration
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluating advanced interaction techniques for navigating Google Earth
BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2
Potential Limitations of Multi-touch Gesture Vocabulary: Differentiation, Adoption, Fatigue
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
TACTUS: A Hardware and Software Testbed for Research in Multi-Touch Interaction
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Analysis of natural gestures for controlling robot teams on multi-touch tabletop surfaces
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Hand distinction for multi-touch tabletop interaction
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Supporting medical communication with a multimodal surface computer
CHI '10 Extended Abstracts on Human Factors in Computing Systems
COMM notation for specifying collaborative and multimodal interactive systems
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Understanding users' preferences for surface gestures
Proceedings of Graphics Interface 2010
The booTable experience: iterative design and prototyping of an alternative interactive tabletop
Proceedings of the 8th ACM Conference on Designing Interactive Systems
e-COMM, un éditeur pour spécifier l'interaction multimodale et multiutilisateur
Conference Internationale Francophone sur I'Interaction Homme-Machine
Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability testing of the interaction of novices with a multi-touch table in semi public space
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
Multimodal, touchless interaction in spatial augmented reality environments
ICDHM'11 Proceedings of the Third international conference on Digital human modeling
Speak up your mind: using speech to capture innovative ideas on interactive surfaces
Proceedings of the 10th Brazilian Symposium on on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction
A pattern language for interactive tabletops in collaborative workspaces
Proceedings of the 15th European Conference on Pattern Languages of Programs
Mutual engagement and collocation with shared representations
International Journal of Human-Computer Studies
| Hi-index | 0.00 |
Co-located collaborators often work over physical tabletops with rich geospatial information. Previous research shows that people use gestures and speech as they interact with artefacts on the table and communicate with one another. With the advent of large multi-touch surfaces, developers are now applying this knowledge to create appropriate technical innovations in digital table design. Yet they are limited by the difficulty of building a truly useful collaborative application from the ground up. In this paper, we circumvent this difficulty by: (a) building a multimodal speech and gesture engine around the Diamond Touch multi-user surface, and (b) wrapping existing, widely-used off-the-shelf single-user interactive spatial applications with a multimodal interface created from this engine. Through case studies of two quite different geospatial systems -- Google Earth and Warcraft III -- we show the new functionalities, feasibility and limitations of leveraging such single-user applications within a multi user, multimodal tabletop. This research informs the design of future multimodal tabletop applications that can exploit single-user software conveniently available in the market. We also contribute (1) a set of technical and behavioural affordances of multimodal interaction on a tabletop, and (2) lessons learnt from the limitations of single user applications.