Automatic evaluation of sketch recognizers

Authors:
Paul Schmieder;Beryl Plimmer;Rachel Blagojevic
Affiliations:
University of Auckland, Auckland, New Zealand;University of Auckland, Auckland, New Zealand;University of Auckland, Auckland, New Zealand
Venue:
Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling
Year:
2009

Citing 9
Cited 8

Specifying gestures by example

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Data mining: practical machine learning tools and techniques with Java implementations

ACM SIGMOD Record
Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes

Proceedings of the 20th annual ACM symposium on User interface software and technology
PaleoSketch: accurate primitive sketch recognition and beautification

Proceedings of the 13th international conference on Intelligent user interfaces
A pen-based tool for efficient labeling of 2D sketches

SBIM '07 Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling
Ink features for diagram recognition

SBIM '07 Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling
A toolkit approach to sketched diagram recognition

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
A data collection tool for sketched diagrams

SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling
SOUSA: sketch-based online user study applet

SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling

Technical Section: The effect of task on classification accuracy: Using gesture recognition techniques in free-sketch recognition

Computers and Graphics
The power of automatic feature selection: Rubine on steroids

Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
Rata.SSR: data mining for pertinent stroke recognizers

Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
Building digital ink recognizers using data mining: distinguishing between text and shapes in hand drawn diagrams

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
Technical Section: Using data mining for digital ink recognition: Dividing text and shapes in sketched diagrams

Computers and Graphics
Automated labeling of ink stroke data

Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling
RATA: codeless generation of gesture recognizers

BCS-HCI '12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers
Designing graphical user interfaces integrating gestures

Proceedings of the 30th ACM international conference on Design of communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present our toolkit to automatically evaluate recognition algorithms. There are few published comparative evaluations of sketch recognition algorithms and those that exist do not provide benchmarking or direct comparisons because standardised data and an evaluation platform is not available. By unifying data collection, labelling and evaluation in one tool, fair, flexible and comprehensive evaluations are possible. Currently we have 6 existing recognizers integrated into this tool. With our initial evaluations of these recognizers we have observed that the context from which training data is taken has an effect on recognition success rates. These results suggest that an evaluation platform such as this is a powerful adjunct for sketch recognition research.