Entangled decision forests and their application for semantic segmentation of CT images

Authors:
Albert Montillo;Jamie Shotton;John Winn;Juan Eugenio Iglesias;Dimitri Metaxas;Antonio Criminisi
Affiliations:
GE Global Research Center, Niskayuna, NY and Microsoft Research, Cambridge, UK;Microsoft Research, Cambridge, UK;Microsoft Research, Cambridge, UK;Microsoft Research, Cambridge, UK and University of California, Los Angeles;Rutgers University, Piscataway, NJ;Microsoft Research, Cambridge, UK
Venue:
IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging
Year:
2011

Citing 17
Cited 7

Shape quantization and recognition with randomized trees

Neural Computation
Random Forests

Machine Learning
Robust Real-Time Face Detection

International Journal of Computer Vision
"GrabCut": interactive foreground extraction using iterated graph cuts

ACM SIGGRAPH 2004 Papers
Probabilistic Boosting-Tree: Learning Discriminative Models for Classification, Recognition, and Clustering

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Extremely randomized trees

Machine Learning
Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification

Proceedings of the 30th DAGM symposium on Pattern Recognition
GeoS: Geodesic Image Segmentation

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context

International Journal of Computer Vision
Random Forest Classification for Automatic Delineation of Myocardium in Real-Time 3D Echocardiography

FIMH '09 Proceedings of the 5th International Conference on Functional Imaging and Modeling of the Heart
Marginal Space Learning for Efficient Detection of 2D/3D Anatomical Structures in Medical Images

IPMI '09 Proceedings of the 21st International Conference on Information Processing in Medical Imaging
Discriminative, Semantic Segmentation of Brain Tissue in MR Images

MICCAI '09 Proceedings of the 12th International Conference on Medical Image Computing and Computer-Assisted Intervention: Part II
The Pascal Visual Object Classes (VOC) Challenge

International Journal of Computer Vision
Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Spatial decision forests for MS lesion segmentation in multi-channel MR images

MICCAI'10 Proceedings of the 13th international conference on Medical image computing and computer-assisted intervention: Part I
Regression forests for efficient anatomy detection and localization in CT studies

MCV'10 Proceedings of the 2010 international MICCAI conference on Medical computer vision: recognition techniques and applications in medical imaging
Combining generative and discriminative models for semantic segmentation of CT scans via active learning

IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging

Combining generative and discriminative models for semantic segmentation of CT scans via active learning

IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging
Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning

Foundations and Trends® in Computer Graphics and Vision
Joint classification-regression forests for spatially structured multi-object segmentation

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
A supervised learning based approach to detect crohn's disease in abdominal MR volumes

MICCAI'12 Proceedings of the 4th international conference on Abdominal Imaging: computational and clinical applications
Fast anatomical structure localization using top-down image patch regression

MCV'12 Proceedings of the Second international conference on Medical Computer Vision: recognition techniques and applications in medical imaging
Brain tumor cell density estimation from multi-modal MR images based on a synthetic tumor growth model

MCV'12 Proceedings of the Second international conference on Medical Computer Vision: recognition techniques and applications in medical imaging
Joint co-segmentation and registration of 3D ultrasound images

IPMI'13 Proceedings of the 23rd international conference on Information Processing in Medical Imaging

Quantified Score

Hi-index	0.00

Visualization

Abstract

This work addresses the challenging problem of simultaneously segmenting multiple anatomical structures in highly varied CT scans. We propose the entangled decision forest (EDF) as a new discriminative classifier which augments the state of the art decision forest, resulting in higher prediction accuracy and shortened decision time. Our main contribution is two-fold. First, we propose entangling the binary tests applied at each tree node in the forest, such that the test result can depend on the result of tests applied earlier in the same tree and at image points offset from the voxel to be classified. This is demonstrated to improve accuracy and capture long-range semantic context. Second, during training, we propose injecting randomness in a guided way, in which node feature types and parameters are randomly drawn from a learned (non-uniform) distribution. This further improves classification accuracy. We assess our probabilistic anatomy segmentation technique using a labeled database of CT image volumes of 250 different patients from various scan protocols and scanner vendors. In each volume, 12 anatomical structures have been manually segmented. The database comprises highly varied body shapes and sizes, a wide array of pathologies, scan resolutions, and diverse contrast agents. Quantitative comparisons with state of the art algorithms demonstrate both superior test accuracy and computational efficiency.