Perceptually based learning of shape descriptions for sketch recognition

Authors:
Olya Veselova;Randall Davis
Affiliations:
Microsoft Corporation, One Microsoft Way, Redmond, WA and MIT CSAIL, Cambridge, MA;Microsoft Corporation, One Microsoft Way, Redmond, WA and MIT CSAIL, Cambridge, MA
Venue:
AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Year:
2004

Citing 3
Cited 13

Specifying gestures by example

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Sketching Interfaces: Toward More Human Interface Design

Computer
Sketch based interfaces: early processing for sketch understanding

Proceedings of the 2001 workshop on Perceptive user interfaces

Interactive learning of structural shape descriptions from automatically generated near-miss examples

Proceedings of the 11th international conference on Intelligent user interfaces
Sketch understanding systems

ACM SIGGRAPH 2007 courses
Bibliography

ACM SIGGRAPH 2007 courses
Magic Paper: Sketch-Understanding Research

Computer
Games for sketch data collection

Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling
Computational Support for Sketching in Design: A Review

Foundations and Trends in Human-Computer Interaction
Incremental learning of perceptual categories for open-domain sketch recognition

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
An image-based, trainable symbol recognizer for hand-drawn sketches

Computers and Graphics
LADDER, a sketching language for user interface developers

Computers and Graphics
Creating the perception-based LADDER sketch recognition language

Proceedings of the 8th ACM Conference on Designing Interactive Systems
Spatial recognition and grouping of text and graphics

SBM'04 Proceedings of the First Eurographics conference on Sketch-Based Interfaces and Modeling
Automatic learning of symbol descriptions avoiding topological ambiguities

SBM'06 Proceedings of the Third Eurographics conference on Sketch-Based Interfaces and Modeling
ShortStraw: a simple and effective corner finder for polylines

SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling

Quantified Score

Hi-index	0.00

Visualization

Abstract

We are interested in enabling a generic sketch recognition system that would allow more natural interaction with design tools in various domains, such as mechanical engineering, military planning, logic design, etc. We would like to teach the system the symbols for a particular domain by simply drawing an example of each one - as easy as it is to teach a person. Studies in cognitive science suggest that, when shown a symbol, people attend preferentially to certain geometric features. Relying on such biases, we built a system capable of learning descriptions of hand-drawn symbols from a single example. The generalization power is derived from a qualitative vocabulary reflecting human perceptual categories and a focus on perceptually relevant global properties of the symbol. Our user study shows that the system agrees with the subjects' majority classification about as often as any individual subject did.