Registration for correlative microscopy using image analogies

Authors:
Tian Cao;Christopher Zach;Shannon Modla;Debbie Powell;Kirk Czymmek;Marc Niethammer
Affiliations:
UNC, Chapel Hill;Microsoft Research, Cambridge;University of Delaware;University of Delaware;University of Delaware;UNC, Chapel Hill, USA, BRIC
Venue:
WBIR'12 Proceedings of the 5th international conference on Biomedical Image Registration
Year:
2012

Citing 6
Cited 0

Image analogies

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images

SIAM Review
Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing

Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing
A compressed sensing approach for MR tissue contrast synthesis

IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging
Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers

Foundations and Trends® in Machine Learning
Nonrigid Registration of 3-D Multichannel Microscopy Images of Cell Nuclei

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies for the same biological specimen. In this paper, we propose an image registration method for correlative microscopy, which is challenging due to the distinct appearance of biological structures when imaged with different modalities. Our method is based on image analogies and allows to transform images of a given modality into the appearance-space of another modality. Hence, the registration between two different types of microscopy images can be transformed to a mono-modality image registration. We use a sparse representation model to obtain image analogies. The method makes use of representative corresponding image training patches of two different imaging modalities to learn a dictionary capturing appearance relations. We test our approach on backscattered electron (BSE) Scanning Electron Microscopy (SEM)/confocal and Transmission Electron Microscopy (TEM)/confocal images and show improvements over direct registration using a mutual-information similarity measure to account for differences in image appearance.