A cross-device interaction style for mobiles and surfaces

Authors:
Dominik Schmidt;Julian Seifert;Enrico Rukzio;Hans Gellersen
Affiliations:
Lancaster University, UK;University of Duisburg-Essen, Germany;University of Duisburg-Essen, Germany and Lancaster University, UK;Lancaster University, UK
Venue:
Proceedings of the Designing Interactive Systems Conference
Year:
2012

Citing 35
Cited 8

Situated information spaces and spatially aware palmtop computers

Communications of the ACM - Special issue on computer augmented environments: back to the real world
Dual device user interface design: PDAs and interactive television

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Rockin'Mouse: integral 3D manipulation on a plane

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Pick-and-drop: a direct manipulation technique for multiple computer environments

Proceedings of the 10th annual ACM symposium on User interface software and technology
A multiple device approach for supporting whiteboard-based interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Augmented surfaces: a spatially continuous work space for hybrid computing environments

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Using handhelds and PCs together

Communications of the ACM
DiamondTouch: a multi-user touch technology

Proceedings of the 14th annual ACM symposium on User interface software and technology
Interacting at a distance: measuring the performance of laser pointers and other devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
People, places, things: web presence for the real world

Mobile Networks and Applications
A three-state model of graphical input

INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
Fostering a Symbiotic Handheld Environment

Computer
Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays

Proceedings of the 16th annual ACM symposium on User interface software and technology
C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal

Proceedings of the 17th annual ACM symposium on User interface software and technology
Individual audio channels with single display groupware: effects on communication and task strategy

CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
Sweep and point and shoot: phonecam-based interactions for large public displays

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Modal spaces: spatial multiplexing to mediate direct-touch input on large displays

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Exploring non-speech auditory feedback at an interactive multi-user tabletop

GI '05 Proceedings of Graphics Interface 2005
Informing the Design of Direct-Touch Tabletops

IEEE Computer Graphics and Applications
User interface façades: towards fully adaptable user interfaces

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking

GI '07 Proceedings of Graphics Interface 2007
Touch & interact: touch-based interaction of mobile phones with displays

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
A privacy-respectful input method for public terminals

Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Spatially aware handhelds for high-precision tangible interaction with large displays

Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Smart Phone Interaction with Registered Displays

IEEE Pervasive Computing
Supporting casual interactions between board games on public tabletop displays and mobile devices

Personal and Ubiquitous Computing
Multi-touch authentication on tabletops

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Touch projector: mobile interaction through video

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PhoneTouch: a technique for direct phone interaction on surfaces

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
HandsDown: hand-contour-based user identification for interactive surfaces

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
IdLenses: dynamic personal areas on shared surfaces

ACM International Conference on Interactive Tabletops and Surfaces
FlashLight: optical communication between mobile phones and interactive tabletops

ACM International Conference on Interactive Tabletops and Surfaces
Distinguishing multiple smart-phone interactions on a multi-touch wall display using tilt correlation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Attach me, detach me, assemble me like you work

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
iDwidgets: parameterizing widgets by user identity

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction

Reflections: a year spent with an interactive desk

interactions
Seamless integration of mobile devices into interactive surface environments

Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Interaction techniques for creating and exchanging content with public displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Personal clipboards for individual copy-and-paste on shared multi-user surfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Cross-device eye-based interaction

Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology
MobiZone: personalized interaction with multiple items on interactive surfaces

Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
Eye drop: an interaction concept for gaze-supported point-to-point content transfer

Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
From the private into the public: privacy-respecting mobile interaction techniques for sharing data on surfaces

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Natural forms of interaction have evolved for personal devices that we carry with us (mobiles) as well as for shared interactive displays around us (surfaces) but interaction across the two remains cumbersome in practice. We propose a novel cross-device interaction style for mobiles and surfaces that uses the mobile for tangible input on the surface in a stylus-like fashion. Building on the direct manipulation that we can perform on either device, it facilitates fluid and seamless interaction spanning across device boundaries. We provide a characterization of the combined interaction style in terms of input, output, and contextual attributes, and demonstrate its versatility by implementation of a range of novel interaction techniques for mobile devices on interactive surfaces.