Anatomical sketch understanding: recognizing explicit and implicit structure

Authors:
Peter Haddawy;Matthew Dailey;Ploen Kaewruen;Natapope Sarakhette
Affiliations:
Asian Institite of Technology;Sirindhorn International Institute of Technology, Thammasat University;Asian Institite of Technology;Asian Institite of Technology
Venue:
AIME'05 Proceedings of the 10th conference on Artificial Intelligence in Medicine
Year:
2005

Citing 6
Cited 1

Iterative point matching for registration of free-form curves and surfaces

International Journal of Computer Vision
Parametrization of closed surfaces for 3-D shape description

Computer Vision and Image Understanding
The nature of statistical learning theory

The nature of statistical learning theory
A fast depth-buffer-based voxelization algorithm

Journal of Graphics Tools
Three Dimensional MR-Based Morphometric Comparison of Schizophrenic and Normal Cerebral Ventricles

VBC '96 Proceedings of the 4th International Conference on Visualization in Biomedical Computing
Automatic and Robust Computation of 3D Medial Models Incorporating Object Variability

International Journal of Computer Vision - Special Issue on Research at the University of North Carolina Medical Image Display Analysis Group (MIDAG)

Segmentation of Text and Non-text in On-Line Handwritten Patient Record Based on Spatio-Temporal Analysis

AIME '09 Proceedings of the 12th Conference on Artificial Intelligence in Medicine: Artificial Intelligence in Medicine

Quantified Score

Hi-index	0.00

Visualization

Abstract

Sketching is ubiquitous in medicine. Physicians commonly use sketches as part of their note taking in patient records and to help convey diagnoses and treatments to patients. Medical students frequently use sketches to help them think through clinical problems in individual and group problem solving. Applications ranging from automated patient records to medical education software could benefit greatly from the richer and more natural interfaces that would be enabled by the ability to understand sketches. In this paper we take the first steps toward developing a system that can understand anatomical sketches. Understanding an anatomical sketch requires the ability to recognize what anatomical structure has been sketched and from what view (e.g. parietal view of the brain), as well as to identify the anatomical parts and their locations in the sketch (e.g. parts of the brain), even if they have not been explicitly drawn. We present novel algorithms for sketch recognition and for part identification. We evaluate the accuracy of the recognition algorithm on sketches obtained from medical students. We evaluate the part identification algorithm by comparing its results to the judgment of an experienced physician.