An interactive system for recognizing hand drawn UML diagrams

Authors:
Edward Lank;Jeb S. Thorley;Sean Jy-Shyang Chen
Affiliations:
Department of Computing Science, Queen's University;Department of Computing Science, Queen's University;Department of Computing Science, Queen's University
Venue:
CASCON '00 Proceedings of the 2000 conference of the Centre for Advanced Studies on Collaborative research
Year:
2000

Citing 9
Cited 11

The Unified Modeling Language user guide

The Unified Modeling Language user guide
A handwriting-based equation editor

Proceedings of the 1999 conference on Graphics interface '99
Computer aided serendipity: the role of autonomous assistants in problem solving

Proceedings of the 1999 conference on Graphics interface '99
Fluid sketches: continuous recognition and morphing of simple hand-drawn shapes

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Using UML: Software Engineering with Objects and Rules

Using UML: Software Engineering with Objects and Rules
A Strategy for On-line Interpretation of Sketched Engineering Drawings

ICDAR '97 Proceedings of the 4th International Conference on Document Analysis and Recognition
On Musical Score Recognition Using Probabilistic Reasoning

ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Application of Deformable Template Matching to Symbol Recognition in Hand-written Architectural Drawings

ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Distributed architectures for pen-based input and diagram recognition

AVI '96 Proceedings of the workshop on Advanced visual interfaces

Tahuti: a geometrical sketch recognition system for UML class diagrams

ACM SIGGRAPH 2006 Courses
LADDER, a sketching language for user interface developers

ACM SIGGRAPH 2007 courses
Recognizing interspersed sketches quickly

Proceedings of Graphics Interface 2009
SmartList: exploring intelligent hand-written list support

Proceedings of the 10th International Conference NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction
LADDER, a sketching language for user interface developers

Computers and Graphics
Recognition and beautification of multi-stroke symbols in digital ink

Computers and Graphics
Adding speech recognition support to UML tools

Journal of Visual Languages and Computing
Building digital ink recognizers using data mining: distinguishing between text and shapes in hand drawn diagrams

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
Technical Section: Using data mining for digital ink recognition: Dividing text and shapes in sketched diagrams

Computers and Graphics
The software design board: a tool supporting workstyle transitions in collaborative software design

EHCI-DSVIS'04 Proceedings of the 2004 international conference on Engineering Human Computer Interaction and Interactive Systems
Natural modeling: retrospective and perspectives an anthropological point of view

Proceedings of the 2012 Extreme Modeling Workshop

Quantified Score

Hi-index	0.00

Visualization

Abstract

Diagrams are widely used by software engineers to capture the structure and organization of software systems. The Unified Modeling Language (UML) is a commonly-used notation for such diagrams. We have designed and implemented a system for the on-line recognition of hand drawn UML diagrams. Input comes from an electronic whiteboard, a mouse, or a data tablet. A sophisticated segmentation algorithm groups pen strokes into symbols, coping with drawing inaccuracies that are common in hand drawn input. The system is organized around a retargetable kernel which provides a general front end for on-line recognition of any iconic notation. The kernel is extended with UML specific enhancements to segmentation, as well as UML specific glyph recognizers. A simple and intuitive graphical user interface allows the user to correct segmentation and recognition errors. Relatively messy freehand UML drawings are interpreted properly.