Picode: inline photos representing posture data in source code

Authors:
Jun Kato;Daisuke Sakamoto;Takeo Igarashi
Affiliations:
The University of Tokyo, Bunkyo-ku, Japan;The University of Tokyo, Bunkyo-ku, Japan;The University of Tokyo, Bunkyo-ku, Japan
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2013

Citing 8
Cited 1

Barista: An implementation framework for enabling new tools, interaction techniques and views in code editors

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Reflective physical prototyping through integrated design, test, and analysis

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Sikuli: using GUI screenshots for search and automation

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Gestalt: integrated support for implementation and analysis in machine learning

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
An actuated physical puppet as an input device for controlling a digital manikin

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Mechanical hijacking: how robots can accelerate UbiComp deployments

Proceedings of the 13th international conference on Ubiquitous computing
Active code completion

Proceedings of the 34th International Conference on Software Engineering
DejaVu: integrated support for developing interactive camera-based programs

Proceedings of the 25th annual ACM symposium on User interface software and technology

Integrated visual representations for programming with real-world input and output

Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology

Quantified Score

Hi-index	0.01

Visualization

Abstract

Current programming environments use textual or symbolic representations. While these representations are appropriate for describing logical processes, they are not appropriate for representing raw values such as human and robot posture data, which are necessary for handling gesture input and controlling robots. To address this issue, we propose Picode, a text-based development environment integrated with visual representations: photos of human and robots. With Picode, the user first takes a photo to bind it to posture data. S/he then drag-and-drops the photo into the code editor, where it is displayed as an inline image. A preliminary in-house user study implied positive effects of taking photos on the programming experience.