Trainable sketch recognizer for graphical user interface design

Authors:
Adrien Coyette;Sascha Schimke;Jean Vanderdonckt;Claus Vielhauer
Affiliations:
Belgian Lab. of Computer-Human Interaction, Information Systems Unit, Louvain School of Management, Université catholique de Louvain, Louvain-la-Neuve, Belgium;Department of Computer Science, ITI, University Otto von Guericke, Universitätsplatz 2, Magdeburg, Germany;Belgian Lab. of Computer-Human Interaction, Information Systems Unit, Louvain School of Management, Université catholique de Louvain, Louvain-la-Neuve, Belgium;Department of Computer Science, ITI, University Otto von Guericke, Universitätsplatz 2, Magdeburg, Germany
Venue:
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
Year:
2007

Citing 15
Cited 6

Specifying gestures by example

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
The cognitive ergonomics of knowledge-based design support systems

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Implications for a gesture design tool

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
DENIM: finding a tighter fit between tools and practice for Web site design

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Computer Processing of Line-Drawing Images

ACM Computing Surveys (CSUR)
The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience

The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience
Sketching Interfaces: Toward More Human Interface Design

Computer
End-user perceptions of formal and informal representations of web sites

CHI '01 Extended Abstracts on Human Factors in Computing Systems
Are informal tools better?: comparing DEMAIS, pencil and paper, and authorware for early multimedia design

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A Goal-Based Organizational Perspective on Multi-agent Architectures

ATAL '01 Revised Papers from the 8th International Workshop on Intelligent Agents VIII
INTERACTING with sketched interface designs: an evaluation study

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Using Adapted Levenshtein Distance for On-Line Signature Authentication

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 2 - Volume 02
DENIM: an informal web site design tool inspired by observations of practice

Human-Computer Interaction
Algorithm for computer control of a digital plotter

IBM Systems Journal
A sketching tool for designing anyuser, anyplatform, anywhere user interfaces

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction

Towards tool support for agile modeling: sketching equals modeling

Proceedings of the 2012 Extreme Modeling Workshop
Template based classification of multi-touch gestures

Pattern Recognition
Dynamic injection of sketching features into GEF based diagram editors

Proceedings of the 2013 International Conference on Software Engineering
Enhancing collaborative sketching activities with context-aware adaptation guidelines

Proceedings of the 19th Brazilian symposium on Multimedia and the web
Recognition of multi-touch drawn sketches

HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
Electronic sketching on a multi-platform context: A pilot study with developers

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a new algorithm for automatic recognition of hand drawn sketches based on the Levenshtein distance. The purpose for drawing sketches in our application is to create graphical user interfaces in a similar manner as the well established paper sketching. The new algorithm is trainable by every user and improves the recognition performance of the techniques which were used before for widget recognition. In addition, this algorithm ay serve for recognizing other types of sketches, such as letters, figures, and commands. In this way, there is no modality disruption at sketching time.