Exploring gesture-based interaction techniques in multi-display environments with mobile phones and a multi-touch table

Authors:
Tanja Döring;Alireza Sahami Shirazi;Albrecht Schmidt
Affiliations:
University of Duisburg-Essen, Germany;University of Duisburg-Essen, Germany;University of Duisburg-Essen, Germany
Venue:
Proceedings of the International Conference on Advanced Visual Interfaces
Year:
2010

Citing 0
Cited 7

Evaluating a smart working environment with a digital card game prototype

Proceedings of the ACM 2011 conference on Computer supported cooperative work
Mobile multitouch for creating narratives

Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments
Eliciting usable gestures for multi-display environments

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
MobiSurf: improving co-located collaboration through integrating mobile devices and interactive surfaces

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Natural interaction for card games on multiple devices

Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Using multiple sensors for reliable markerless identification through supervised learning

Machine Vision and Applications
From the private into the public: privacy-respecting mobile interaction techniques for sharing data on surfaces

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we explore the potential of combining shared and interactive displays (e.g. a multi-touch table) with personal devices (e.g. mobile phones) as an important class of heterogeneous multi-display environments. Within six case studies applications and interactions were invented and implemented that utilize the potential of such heterogeneous multi-display environments. We were in particular interested how to design systems that include interaction across different displays and how to manage public and private information in a group setting. One case study, a digital card game, highlights these design challenges. We explore different natural ways of interaction, including touching the table as well as motion gestures with mobile phones. With this application we provide a use case to discuss gestures combining mobile phones with tabletop surfaces, as well as to explore a private-public display setting. First results showed that combining tables and mobile phones provide a suitable and understandable way for interaction in these settings.