Point & control -- interaction in smart environments: you only click twice

Authors:
Matthias Budde;Matthias Berning;Christopher Baumgärtner;Florian Kinn;Timo Kopf;Sven Ochs;Frederik Reiche;Till Riedel;Michael Beigl
Affiliations:
Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany;Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
Venue:
Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Year:
2013

Citing 7
Cited 2

Prototype implementations for a universal remote console specification

CHI '02 Extended Abstracts on Human Factors in Computing Systems
Point & Click - Interaction in Smart Environments

HUC '99 Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing
Operating appliances with mobile phones: strengths and limits of a universal interaction device

PERVASIVE'07 Proceedings of the 5th international conference on Pervasive computing
MagicPhone: pointing & interacting

Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Adjunct
Enhancing interaction with smart objects through mobile devices

Proceedings of the 9th ACM international symposium on Mobility management and wireless access
PICOntrol: using a handheld projector for direct control of physical devices through visible light

Proceedings of the 25th annual ACM symposium on User interface software and technology
MISO: a context-sensitive multimodal interface for smart objects based on hand gestures and finger snaps

Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

Using a 2DST waveguide for usable, physically constrained out-of-band Wi-Fi authentication

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
jActivity: supporting mobile web developers with HTML5/JavaScript based human activity recognition

Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

This work presents a system that makes use of the Microsoft Kinect to enable Point&Click interaction for the control of appliances in smart environments. A backend server determines through collision detection which device the user is pointing at and sends the respective control interface to the user's smartphone. Any commands the user issues are then sent back to the server which in turn controls the appliance. New devices can either be registered manually or using markers such as QR codes to identify them and get their position at the same time. The video demonstrates the interaction concept and our technical implementation.