Ubiquitous shortcuts: mnemonics by just taking photos

Authors:
Mikko J. Rissanen;Owen Noel Newton Fernando;Horathalge Iroshan;Samantha Vu;Natalie Pang;Schubert Foo
Affiliations:
Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore
Venue:
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Year:
2013

Citing 11
Cited 0

“FingeRing”: a full-time wearable interface

CHI '94 Conference Companion on Human Factors in Computing Systems
WebStickers: using physical objects as WWW bookmarks

CHI '99 Extended Abstracts on Human Factors in Computing Systems
Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Intimate interfaces in action: assessing the usability and subtlety of emg-based motionless gestures

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Mobile Sensing Platform: An Embedded Activity Recognition System

IEEE Pervasive Computing
Disappearing mobile devices

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Interfaces on the go

XRDS: Crossroads, The ACM Magazine for Students - The Future of Interaction
Would you do that?: understanding social acceptance of gestural interfaces

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Multimodal mobile interactions: usability studies in real world settings

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
EyeRing: a finger-worn assistant

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Moses -- method for selecting senior mobile phones: supporting design & choice for the elderly

Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Ubiquitous Shortcuts is an image processing based method for making and using mnemonics set onto the real world using smartphones or other computing systems. The mnemonics can be created by taking photos of the user's vicinity and by binding them onto command sequences. The mnemonic is triggered every time a similar photo is taken. Our method uses natural feature matching algorithms and end-user programming approaches. The mnemonics can be concatenated into more complex command sequences. Thus, limited user input is realized by just taking photos with a camera embedded into a finger-ring, which enables rapid, subtle and socially acceptable user interaction. Our method can be used as semi-automatic way of achieving location and context sensitive services, activity recognition or tangible interaction.