Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Sensing techniques for mobile interaction
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns
IEEE Transactions on Pattern Analysis and Machine Intelligence
Ego-Motion and Omnidirectional Cameras
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
First Steps Towards Handheld Augmented Reality
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
A camera-based interface for interaction with mobile handheld computers
Proceedings of the 2005 symposium on Interactive 3D graphics and games
Mixed interaction space: designing for camera based interaction with mobile devices
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Foot-based mobile interaction with games
Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology
Just-for-us: a context-aware mobile information system facilitating sociality
Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
ISeeU: camera-based user interface for a handheld computer
Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
Improving selection of off-screen targets with hopping
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
TinyMotion: camera phone based interaction methods
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Robust computer vision-based detection of pinching for one and two-handed gesture input
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
A survey of skin-color modeling and detection methods
Pattern Recognition
Strategies for accelerating on-line learning of hotkeys
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Vision-based hand pose estimation: A review
Computer Vision and Image Understanding
Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes
Proceedings of the 20th annual ACM symposium on User interface software and technology
Context-Aware Computing Applications
WMCSA '94 Proceedings of the 1994 First Workshop on Mobile Computing Systems and Applications
SideSight: multi-"touch" interaction around small devices
Proceedings of the 21st annual ACM symposium on User interface software and technology
Description of interest regions with local binary patterns
Pattern Recognition
One-handed interaction with augmented virtual objects on mobile devices
VRCAI '08 Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
Hoverflow: exploring around-device interaction with IR distance sensors
Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Hand gesture recognition using a neural network shape fitting technique
Engineering Applications of Artificial Intelligence
Usable gestures for mobile interfaces: evaluating social acceptability
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Protractor: a fast and accurate gesture recognizer
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GesText: accelerometer-based gestural text-entry systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Two-frame motion estimation based on polynomial expansion
SCIA'03 Proceedings of the 13th Scandinavian conference on Image analysis
A survey of mobile phone sensing
IEEE Communications Magazine
CAMB: context-aware mobile browser
Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia
Proxemic interaction: designing for a proximity and orientation-aware environment
ACM International Conference on Interactive Tabletops and Surfaces
6D hands: markerless hand-tracking for computer aided design
Proceedings of the 24th annual ACM symposium on User interface software and technology
Vision-Based interpretation of hand gestures for remote control of a computer mouse
ECCV'06 Proceedings of the 2006 international conference on Computer Vision in Human-Computer Interaction
iRotate: automatic screen rotation based on face orientation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Determining the orientation of proximate mobile devices using their back facing camera
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ORB: An efficient alternative to SIFT or SURF
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Carpus: a non-intrusive user identification technique for interactive surfaces
Proceedings of the 25th annual ACM symposium on User interface software and technology
Magic finger: always-available input through finger instrumentation
Proceedings of the 25th annual ACM symposium on User interface software and technology
GaussSense: attachable stylus sensing using magnetic sensor grid
Proceedings of the 25th annual ACM symposium on User interface software and technology
Improvement of smartphone interface using an AR marker
Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CrashAlert: enhancing peripheral alertness for eyes-busy mobile interaction while walking
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.00 |
Mobile devices are endowed with significant sensing capabilities. However, their ability to 'see' their surroundings, during active use, is limited. We present Surround-See, a self-contained smartphone equipped with an omni-directional camera that enables peripheral vision around the device to augment daily mobile tasks. Surround-See provides mobile devices with a field-of-view collinear to the device screen. This capability facilitates novel mobile tasks such as, pointing at objects in the environment to interact with content, operating the mobile device at a physical distance and allowing the device to detect user activity, even when the user is not holding it. We describe Surround-See's architecture, and demonstrate applications that exploit peripheral 'seeing' capabilities during active use of a mobile device. Users confirm the value of embedding peripheral vision capabilities on mobile devices and offer insights for novel usage methods.