Whole-home gesture recognition using wireless signals

Authors:
Qifan Pu;Sidhant Gupta;Shyamnath Gollakota;Shwetak Patel
Affiliations:
University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA
Venue:
Proceedings of the 19th annual international conference on Mobile computing & networking
Year:
2013

Citing 16
Cited 3

The magic carpet: physical sensing for immersive environments

CHI EA '97 CHI '97 Extended Abstracts on Human Factors in Computing Systems
Challenges: device-free passive localization for wireless environments

Proceedings of the 13th annual ACM international conference on Mobile computing and networking
Zigzag decoding: combating hidden terminals in wireless networks

Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Radio Tomographic Imaging with Wireless Networks

IEEE Transactions on Mobile Computing
Skinput: appropriating the body as an input surface

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Fine-grained channel access in wireless LAN

Proceedings of the ACM SIGCOMM 2010 conference
Achieving single channel, full duplex wireless communication

Proceedings of the sixteenth annual international conference on Mobile computing and networking
Random access heterogeneous MIMO networks

Proceedings of the ACM SIGCOMM 2011 conference
Clearing the RF smog: making 802.11n robust to cross-technology interference

Proceedings of the ACM SIGCOMM 2011 conference
Towards fine-grained radio-based indoor location

Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications
Real-time human pose recognition in parts from single depth images

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Humantenna: using the body as an antenna for real-time whole-body interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SoundWave: using the doppler effect to sense gestures

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
You are facing the Mona Lisa: spot localization using PHY layer information

Proceedings of the 10th international conference on Mobile systems, applications, and services
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor

Proceedings of the 25th annual ACM symposium on User interface software and technology
ArrayTrack: a fine-grained indoor location system

nsdi'13 Proceedings of the 10th USENIX conference on Networked Systems Design and Implementation

Leveraging RF-channel fluctuation for activity recognition: Active and passive systems, continuous and RSSI-based signal features

Proceedings of International Conference on Advances in Mobile Computing & Multimedia
Bringing gesture recognition to all devices

NSDI'14 Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation
3D tracking via body radio reflections

NSDI'14 Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents WiSee, a novel gesture recognition system that leverages wireless signals (e.g., Wi-Fi) to enable whole-home sensing and recognition of human gestures. Since wireless signals do not require line-of-sight and can traverse through walls, WiSee can enable whole-home gesture recognition using few wireless sources. Further, it achieves this goal without requiring instrumentation of the human body with sensing devices. We implement a proof-of-concept prototype of WiSee using USRP-N210s and evaluate it in both an office environment and a two- bedroom apartment. Our results show that WiSee can identify and classify a set of nine gestures with an average accuracy of 94%.