Your phone or mine?: fusing body, touch and device sensing for multi-user device-display interaction

Authors:
Mahsan Rofouei;Andrew Wilson;A.J. Brush;Stewart Tansley
Affiliations:
Microsoft Research, Redmond, Washington & University of California, Los Angeles, Los Angeles, California, United States;Microsoft Research, Redmond, Washington, United States;Microsoft Research, Redmond, Washington, United States;Microsoft Research, Redmond, Washington, United States
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2012

Citing 9
Cited 3

DiamondTouch: a multi-user touch technology

Proceedings of the 14th annual ACM symposium on User interface software and technology
Territoriality in collaborative tabletop workspaces

CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking

ACHI '08 Proceedings of the First International Conference on Advances in Computer-Human Interaction
SnapAndGrab: accessing and sharing contextual multi-media content using bluetooth enabled camera phones and large situated displays

CHI '08 Extended Abstracts on Human Factors in Computing Systems
Touch & connect and touch & select: interacting with a computer by touching it with a mobile phone

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Search on surfaces: Exploring the potential of interactive tabletops for collaborative search tasks

Information Processing and Management: an International Journal
PhoneTouch: a technique for direct phone interaction on surfaces

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Distinguishing multiple smart-phone interactions on a multi-touch wall display using tilt correlation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Medusa: a proximity-aware multi-touch tabletop

Proceedings of the 24th annual ACM symposium on User interface software and technology

Personal clipboards for individual copy-and-paste on shared multi-user surfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CameraMatch: automatic recognition of subjects using smartphones-toward entertaining photo sessions

CHI '13 Extended Abstracts on Human Factors in Computing Systems
SWINGNAGE: gesture-based mobile interactions on distant public displays

Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Quantified Score

Hi-index	0.01

Visualization

Abstract

Determining who is interacting with a multi-user interactive touch display is challenging. We describe a technique for associating multi-touch interactions to individual users and their accelerometer-equipped mobile devices. Real-time device accelerometer data and depth camera-based body tracking are compared to associate each phone with a particular user, while body tracking and touch contacts positions are compared to associate a touch contact with a specific user. It is then possible to associate touch contacts with devices, allowing for more seamless device-display multi-user interactions. We detail the technique and present a user study to validate and demonstrate a content exchange application using this approach.