Situated information spaces and spatially aware palmtop computers
Communications of the ACM - Special issue on computer augmented environments: back to the real world
A taxonomy of see-through tools
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real Sound Synthesis for Interactive Applications
Real Sound Synthesis for Interactive Applications
Peephole displays: pen interaction on spatially aware handheld computers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Halo: a technique for visualizing off-screen objects
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Augmented Composer Project: The Music Table
ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
A camera-based interface for interaction with mobile handheld computers
Proceedings of the 2005 symposium on Interactive 3D graphics and games
Sweep and point and shoot: phonecam-based interactions for large public displays
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Navigation via continuously adapted music
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Mixed interaction space: designing for camera based interaction with mobile devices
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Visual Code Widgets for Marker-Based Interaction
ICDCSW '05 Proceedings of the Fifth International Workshop on Smart Appliances and Wearable Computing - Volume 05
The importance of parameter mapping in electronic instrument design
NIME '02 Proceedings of the 2002 conference on New interfaces for musical expression
Sonic City: the urban environment as a musical interface
NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
GpsTunes: controlling navigation via audio feedback
Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
The Smart Phone: A Ubiquitous Input Device
IEEE Pervasive Computing
Real-world interaction with camera phones
UCS'04 Proceedings of the Second international conference on Ubiquitous Computing Systems
CaMus2: collaborative music performance with mobile camera phones
Proceedings of the international conference on Advances in computer entertainment technology
CaMus2: optical flow and collaboration in camera phone music performance
NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Interactivity for mobile music-making
Organised Sound
Interaction Design: The Mobile Percussionist
HAID '09 Proceedings of the 4th International Conference on Haptic and Audio Interaction Design
ZOOZbeat: mobile music recreation
CHI '10 Extended Abstracts on Human Factors in Computing Systems
| Hi-index | 0.00 |
We demonstrate that mobile phones can be used as an actively oriented handheld musical performance device. To achieve this we use a visual tracking system of a camera phone. Motion in the plane, relative to movable targets, rotation and distance to the plane can be used to drive MIDI enabled sound generation software or hardware. Mobile camera phones are widely available technology and we hope to find ways to make them into viable and widely used performance devices.