Context-Based Vision: Recognizing Objects Using Information from Both 2D and 3D Imagery
IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part I
Interactive sketching for the early stages of user interface design
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Ambiguous intentions: a paper-like interface for creative design
Proceedings of the 9th annual ACM symposium on User interface software and technology
A survey of visual language specification and recognition
Visual language theory
Generating multiple new designs from a sketch
Artificial Intelligence
Visual similarity of pen gestures
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Sketching for military courses of action diagrams
Proceedings of the 8th international conference on Intelligent user interfaces
Perceptually-supported image editing of text and graphics
Proceedings of the 16th annual ACM symposium on User interface software and technology
Sketch based interfaces: early processing for sketch understanding
Proceedings of the 2001 workshop on Perceptive user interfaces
Multi-domain sketch understanding
Multi-domain sketch understanding
DENIM: an informal web site design tool inspired by observations of practice
Human-Computer Interaction
LADDER: a language to describe drawing, display, and editing in sketch recognition
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Resolving ambiguities to create a natural computer-based sketching environment
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Object-oriented Bayesian networks
UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
Multimodal integration-a statistical view
IEEE Transactions on Multimedia
Generating systems from multiple sketched models
Journal of Visual Languages and Computing
Query-adaptive shape topic mining for hand-drawn sketch recognition
Proceedings of the 20th ACM international conference on Multimedia
IMISketch: An interactive method for sketch recognition
Pattern Recognition Letters
| Hi-index | 0.00 |
We present SketchREAD, a multi-domain sketch recognition engine capable of recognizing freely hand-drawn diagrammatic sketches. Current computer sketch recognition systems are difficult to construct, and either are fragile or accomplish robustness by severely limiting the designer's drawing freedom. Our system can be applied to a variety of domains by providing structural descriptions of the shapes in that domain; no training data or programming is necessary. Robustness to the ambiguity and uncertainty inherent in complex, freely-drawn sketches is achieved through the use of context. The system uses context to guide the search for possible interpretations and uses a novel form of dynamically constructed Bayesian networks to evaluate these interpretations. This process allows the system to recover from low-level recognition errors (e.g., a line misclassified as an arc) that would otherwise result in domain level recognition errors. We evaluated SketchREAD on real sketches in two domains---family trees and circuit diagrams---and found that in both domains the use of context to reclassify low-level shapes significantly reduced recognition error over a baseline system that did not reinterpret low-level classifications. We also discuss the system's potential role in sketch-based user interfaces.