Communications of the ACM - Special issue on graphical user interfaces
Tilting operations for small screen interfaces
Proceedings of the 9th annual ACM symposium on User interface software and technology
Tangible bits: towards seamless interfaces between people, bits and atoms
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Pick-and-drop: a direct manipulation technique for multiple computer environments
Proceedings of the 10th annual ACM symposium on User interface software and technology
Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Principles of mixed-initiative user interfaces
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Bridging physical and virtual worlds with electronic tags
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Sensing techniques for mobile interaction
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Toward more sensitive mobile phones
Proceedings of the 14th annual ACM symposium on User interface software and technology
Real-time audio buffering for telephone applications
Proceedings of the 14th annual ACM symposium on User interface software and technology
Making sense of sensing systems: five questions for designers and researchers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
TiltType: accelerometer-supported text entry for very small devices
Proceedings of the 15th annual ACM symposium on User interface software and technology
Rock 'n' Scroll Is Here to Stay
IEEE Computer Graphics and Applications
Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts
UbiComp '01 Proceedings of the 3rd international conference on Ubiquitous Computing
Distributed and local sensing techniques for face-to-face collaboration
Proceedings of the 5th international conference on Multimodal interfaces
TiltText: using tilt for text input to mobile phones
Proceedings of the 16th annual ACM symposium on User interface software and technology
Synchronous gestures for multiple persons and computers
Proceedings of the 16th annual ACM symposium on User interface software and technology
Design of spatially aware graspable displays
CHI EA '97 CHI '97 Extended Abstracts on Human Factors in Computing Systems
UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
When do we interact multimodally?: cognitive load and multimodal communication patterns
Proceedings of the 6th international conference on Multimodal interfaces
Shoogle: excitatory multimodal interaction on mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
BodySpace: inferring body pose for natural control of a music player
CHI '07 Extended Abstracts on Human Factors in Computing Systems
A Gestalt theoretic perspective on the user experience of location-based services
OZCHI '07 Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces
Navigation techniques for dual-display e-book readers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sensing-based interaction for information navigation on handheld displays
Proceedings of the 9th international conference on Human computer interaction with mobile devices and services
Zoom interaction design for pen-operated portable devices
International Journal of Human-Computer Studies
Personal and Ubiquitous Computing
Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Control centric approach in designing scrolling and zooming user interfaces
International Journal of Human-Computer Studies
Journal of Location Based Services
Engineering of Software-Intensive Systems: State of the Art and Research Challenges
Software-Intensive Systems and New Computing Paradigms
Codex: a dual screen tablet computer
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Motion marking menus: An eyes-free approach to motion input for handheld devices
International Journal of Human-Computer Studies
Journal of Visual Languages and Computing
The Five Commandments of Activity-Aware Ubiquitous Computing Applications
ICDHM '09 Proceedings of the 2nd International Conference on Digital Human Modeling: Held as Part of HCI International 2009
Glaze: A Visualization Framework for Mobile Devices
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Indexicality: Understanding mobile human-computer interaction in context
ACM Transactions on Computer-Human Interaction (TOCHI)
Is tilt interaction better than keypad interaction for mobile map-based applications?
SAICSIT '10 Proceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists
IntelliTilt: an enhanced tilt interaction technique for mobile map-based applications
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
OPF: a distributed context-sensing framework for ubiquitous computing environments
UCS'06 Proceedings of the Third international conference on Ubiquitous Computing Systems
Personalized primary port: analysis of user view for the smart environment
ICAT'06 Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-Existence
Proceedings of the 10th asia pacific conference on Computer human interaction
Focused and casual interactions: allowing users to vary their level of engagement
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An asymmetric dual-processor architecture for low-power information appliances
ACM Transactions on Embedded Computing Systems (TECS)
| Hi-index | 0.00 |
Building on Buxton's foreground/background model, we discuss the importance of explicitly considering both foreground interaction and background interaction, as well as transitions between foreground and background, in the design and implementation of sensing techniques for sensor-enhanced mobile devices. Our view is that the foreground concerns deliberate user activity where the user is attending to the device, while the background is the realm of inattention or split attention, using naturally occurring user activity as an input that allows the device to infer or anticipate user needs. The five questions for sensing systems of Bellotti et al. [2002] proposed as a framework for this special issue, primarily address the foreground, but neglect critical issues with background sensing. To support our perspective, we discuss a variety of foreground and background sensing techniques that we have implemented for sensor-enhanced mobile devices, such as powering on the device when the user picks it up, sensing when the user is holding the device to his ear, automatically switching between portrait and landscape display orientations depending on how the user is holding the device, and scrolling the display using tilt. We also contribute system architecture issues, such as using the foreground/background model to handle cross-talk between multiple sensor-based interaction techniques, and theoretical perspectives, such as a classification of recognition errors based on explicitly considering transitions between the foreground and background. Based on our experiences, we propose design issues and lessons learned for foreground/background sensing systems.