Contour and Texture Analysis for Image Segmentation

Authors:
Jitendra Malik;Serge Belongie;Thomas Leung;Jianbo Shi
Affiliations:
Computer Science Division, University of California at Berkeley, Berkeley, CA 94720-1776, USA;Computer Science Division, University of California at Berkeley, Berkeley, CA 94720-1776, USA;Computer Science Division, University of California at Berkeley, Berkeley, CA 94720-1776, USA;Computer Science Division, University of California at Berkeley, Berkeley, CA 94720-1776, USA
Venue:
International Journal of Computer Vision
Year:
2001

Citing 21
Cited 155

A Computational Approach to Edge Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Representation of local geometry in the visual system

Biological Cybernetics
Feature detection from local energy

Pattern Recognition Letters
Trace Inference, Curvature Consistency, and Curve Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Vector quantization and signal compression

Vector quantization and signal compression
Computational framework for determining stereo correspondence from a set of linear spatial filters

Image and Vision Computing - Special issue: 2nd European Conference on Computer Vision
Robust and Efficient Detection of Salient Convex Groups

IEEE Transactions on Pattern Analysis and Machine Intelligence
Pyramid-based texture analysis/synthesis

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Normalized Cuts and Image Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
On the optimal detection of curves in noisy pictures

Communications of the ACM
Finding Boundaries in Natural Images: A New Method Using Point Descriptors and Area Completion

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Contour Continuity in Region Based Image Segmentation

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Computing Contour Closure

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
Non-parametric Similarity Measures for Unsupervised Texture Segmentation and Image Retrieval

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Normalized Cuts and Image Segmentation

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Stochastic completion fields: a neural model of illusory contour shape and salience

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Textons, Contours and Regions: Cue Integration in Image Segmentation

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Segmentation Using Eigenvectors: A Unifying View

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Recognizing Surfaces Using Three-Dimensional Textons

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Color- and Texture-Based Image Segmentation Using EM and Its Application to Content-Based Image Retrieval

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Unsupervised texture classification using vector quantization and deterministic relaxation neural network

IEEE Transactions on Image Processing

A Probabilistic Multi-scale Model for Contour Completion Based on Image Statistics

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Toward a Full Probability Model of Edges in Natural Images

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Parsing Images into Region and Curve Processes

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Spectral Partitioning with Indefinite Kernels Using the Nyström Extension

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Grouping with Directed Relationships

EMMCVPR '01 Proceedings of the Third International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition
Path-Based Clustering for Grouping of Smooth Curves and Texture Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Nonlinear Statistics of High-Contrast Patches in Natural Images

International Journal of Computer Vision - Special Issue on Computational Vision at Brown University
Binary Partitioning, Perceptual Grouping, and Restoration with Semidefinite Programming

IEEE Transactions on Pattern Analysis and Machine Intelligence
Segmentation Given Partial Grouping Constraints

IEEE Transactions on Pattern Analysis and Machine Intelligence
Spectral Grouping Using the Nyström Method

IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Contracting Curve Density Algorithm: Fitting Parametric Curve Models to Images Using Local Self-Adapting Separation Criteria

International Journal of Computer Vision
Collection understanding

Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries
On combining graph-partitioning with non-parametric clustering for image segmentation

Computer Vision and Image Understanding
A Statistical Approach to Texture Classification from Single Images

International Journal of Computer Vision - Special Issue on Texture Analysis and Synthesis
Image Parsing: Unifying Segmentation, Detection, and Recognition

International Journal of Computer Vision
A Sparse Texture Representation Using Local Affine Regions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Iterative Kernel Principal Component Analysis for Image Modeling

IEEE Transactions on Pattern Analysis and Machine Intelligence
One-click lattice extraction from near-regular texture

GRAPHITE '05 Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Content-based image retrieval: approaches and trends of the new age

Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Parsing Images into Regions, Curves, and Curve Groups

International Journal of Computer Vision
Multi-scale morphological modeling of a class of structural texture

Machine Graphics & Vision International Journal
A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape

International Journal of Computer Vision
Three-Dimensional Shape Knowledge for Joint Image Segmentation and Pose Tracking

International Journal of Computer Vision
Human Pose Estimation Using Partial Configurations and Probabilistic Regions

International Journal of Computer Vision
Robust Image Segmentation Using Resampling and Shape Constraints

IEEE Transactions on Pattern Analysis and Machine Intelligence
Graph regularization for color image processing

Computer Vision and Image Understanding
A Bayes-Based Region-Growing Algorithm for Medical Image Segmentation

Computing in Science and Engineering
Image-Based Modeling by Joint Segmentation

International Journal of Computer Vision
A biologically motivated multiresolution approach to contour detection

EURASIP Journal on Applied Signal Processing
Globally adaptive region information for automatic color-texture image segmentation

Pattern Recognition Letters
Inappropriateness of the criterion of k-way normalized cuts for deciding the number of clusters

Pattern Recognition Letters
Spectral clustering with eigenvector selection

Pattern Recognition
Clustering approach to quantify long-term spatio-temporal interactions in epileptic intracranial electroencephalography

Computational Intelligence and Neuroscience - EEG/MEG Signal Processing
Robust Object Detection with Interleaved Categorization and Segmentation

International Journal of Computer Vision
Image retrieval: Ideas, influences, and trends of the new age

ACM Computing Surveys (CSUR)
Spectral clustering in telephone call graphs

Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis
Semantic Segmentation Tree for image content representation

International Journal of Virtual Technology and Multimedia
Unsupervised segmentation of natural images via lossy data compression

Computer Vision and Image Understanding
An Approximate Distribution for the Normalized Cut

Journal of Mathematical Imaging and Vision
A Global Contour-Grouping Algorithm Based on Spectral Clustering

ISNN '08 Proceedings of the 5th international symposium on Neural Networks: Advances in Neural Networks, Part II
Foliage Recognition Based on Local Edge Information

ACIVS '08 Proceedings of the 10th International Conference on Advanced Concepts for Intelligent Vision Systems
Shape Matching by Segmentation Averaging

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Morphological segmentation on learned boundaries

Image and Vision Computing
An Attentional System Combining Top-Down and Bottom-Up Influences

Attention in Cognitive Systems. Theories and Systems from an Interdisciplinary Viewpoint
Shape Extraction through Region-Contour Stitching

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context

International Journal of Computer Vision
Color-texture segmentation using unsupervised graph cuts

Pattern Recognition
Automatic joint classification and segmentation of whole cell 3D images

Pattern Recognition
Spectral Clustering in Social Networks

Advances in Web Mining and Web Usage Analysis
Optimizing Gabor Filter Design for Texture Edge Detection and Classification

International Journal of Computer Vision
Blood Detection In IVUS Longitudinal Cuts Using AdaBoost With a Novel Feature Stability Criterion

Proceedings of the 2007 conference on Artificial Intelligence Research and Development
Semi-supervised Segmentation Based on Non-local Continuous Min-Cut

SSVM '09 Proceedings of the Second International Conference on Scale Space and Variational Methods in Computer Vision
Cue Integration for Urban Area Extraction in Remote Sensing Images

ICIAR '09 Proceedings of the 6th International Conference on Image Analysis and Recognition
Object boundary detection in images using a semantic ontology

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Benchmarking Image Segmentation Algorithms

International Journal of Computer Vision
Hierarchical Pairwise Segmentation Using Dominant Sets and Anisotropic Diffusion Kernels

EMMCVPR '09 Proceedings of the 7th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Measuring serendipity: connecting people, locations and interests in a mobile 3G network

Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference
Edge-Preserving Laplacian Pyramid

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Adaptive Contextual Energy Parameterization for Automated Image Segmentation

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Silhouette representation and matching for 3D pose discrimination - A comparative study

Image and Vision Computing
An Approach to the Parameterization of Structure for Fast Categorization

International Journal of Computer Vision
Intravascular ultrasound images vessel characterization using Adaboost

FIMH'03 Proceedings of the 2nd international conference on Functional imaging and modeling of the heart
Computation of generic features for object classification

Scale Space'03 Proceedings of the 4th international conference on Scale space methods in computer vision
Architecture for image labelling in real conditions

ICVS'03 Proceedings of the 3rd international conference on Computer vision systems
Beyond average: toward sophisticated sensing with queries

IPSN'03 Proceedings of the 2nd international conference on Information processing in sensor networks
A variational framework for adaptive satellite images segmentation

SSVM'07 Proceedings of the 1st international conference on Scale space and variational methods in computer vision
Blood detection in IVUS images for 3D volume of lumen changes measurement due to different drugs administration

CAIP'07 Proceedings of the 12th international conference on Computer analysis of images and patterns
Efficient image segmentation using pairwise pixel similarities

Proceedings of the 29th DAGM conference on Pattern recognition
Dinkelbach NCUT: An Efficient Framework for Solving Normalized Cuts Problems with Priors and Convex Constraints

International Journal of Computer Vision
Multi-view Superpixel Stereo in Urban Environments

International Journal of Computer Vision
Efficient texture representation using multi-scale regions

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Efficiently solving the fractional trust region problem

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Generalizing edge detection to contour detection for image segmentation

Computer Vision and Image Understanding
Web-scale computer vision using MapReduce for multimedia data mining

Proceedings of the Tenth International Workshop on Multimedia Data Mining
Enabling scalable spectral clustering for image segmentation

Pattern Recognition
Diffusion maps for edge-aware image editing

ACM SIGGRAPH Asia 2010 papers
An object-based visual attention model for robotic applications

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Reliability-driven, spatially-adaptive regularization for deformable registration

WBIR'10 Proceedings of the 4th international conference on Biomedical image registration
Optimizing complex loss functions in structured prediction

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Adaptive regularization for image segmentation using local image curvature cues

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
A novel approach to FRUC using discriminant saliency and frame segmentation

IEEE Transactions on Image Processing
Learning methods for generic object recognition with invariance to pose and lighting

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Recovering human body configurations: combining segmentation and recognition

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Detecting and reading text in natural scenes

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Spatially coherent clustering using graph cuts

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Review article: Edge and line oriented contour detection: State of the art

Image and Vision Computing
Normalized Cuts Revisited: A Reformulation for Segmentation with Linear Grouping Constraints

Journal of Mathematical Imaging and Vision
Universal seed skin segmentation

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part II
Adaptation for multiple cue integration

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Segmentation via ncuts and lossy minimum description length: a unified approach

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Inference and Learning with Hierarchical Shape Models

International Journal of Computer Vision
Graph-based quadratic optimization: A fast evolutionary approach

Computer Vision and Image Understanding
Region-based annotation of digital photographs

CCIW'11 Proceedings of the Third international conference on Computational color imaging
Bagging-based spectral clustering ensemble selection

Pattern Recognition Letters
Satellite image segmentation with Shadowed C-Means

Information Sciences: an International Journal
Near-Infrared Ink Differentiation in Medieval Manuscripts

International Journal of Computer Vision
Computational-geometry approach to digital image contour extraction

Transactions on computational science XIII
A review on automatic image annotation techniques

Pattern Recognition
Virtual restoration of the ghent altarpiece using crack detection and inpainting

ACIVS'11 Proceedings of the 13th international conference on Advanced concepts for intelligent vision systems
Segmentation of Natural Images by Texture and Boundary Compression

International Journal of Computer Vision
Character segmentation for license plate recognition by K-means algorithm

ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing - Volume Part II
Learning what matters: combining probabilistic models of 2D and 3D saliency cues

ICVS'11 Proceedings of the 8th international conference on Computer vision systems
Object recognition and tracking in video sequences: a new integrated methodology

CIARP'06 Proceedings of the 11th Iberoamerican conference on Progress in Pattern Recognition, Image Analysis and Applications
Color pair clustering for texture detection

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part II
Supervised texture detection in images

CAIP'05 Proceedings of the 11th international conference on Computer Analysis of Images and Patterns
Segmenting highly articulated video objects with weak-prior random forests

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Integrated graph cuts for brain MRI segmentation

MICCAI'06 Proceedings of the 9th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part II
A local basis representation for estimating human pose from cluttered images

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
The eigen-transform and applications

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
Waterfall segmentation of complex scenes

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
Spectral methods in image segmentation: a combined approach

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part II
Image segmentation using local spectral histograms and linear regression

Pattern Recognition Letters
Steerable semi-automatic segmentation of textured images

SCIA'05 Proceedings of the 14th Scandinavian conference on Image Analysis
A probabilistic integrated object recognition and tracking framework

Expert Systems with Applications: An International Journal
Deformable-Model based textured object segmentation

EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Spatio-temporal segmentation using dominant sets

EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
Automatic image segmentation by positioning a seed

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
A computational model for boundary detection

ICVGIP'06 Proceedings of the 5th Indian conference on Computer Vision, Graphics and Image Processing
Spectral graph partitioning based on a random walk diffusion similarity measure

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Multicue graph mincut for image segmentation

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Road image segmentation and recognition using hierarchical bag-of-textons method

PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part I
Computer vision for fruit harvesting robots state of the art and challenges ahead

International Journal of Computational Vision and Robotics
An efficient and effective tool for image segmentation, total variations and regularization

SSVM'11 Proceedings of the Third international conference on Scale Space and Variational Methods in Computer Vision
Texture bags: anomaly retrieval in medical images based on local 3d-texture similarity

MCBR-CDS'11 Proceedings of the Second MICCAI international conference on Medical Content-Based Retrieval for Clinical Decision Support
Numerical aspects of spectral segmentation on polygonal grids

PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume Part I
Learning Behavioural Context

International Journal of Computer Vision
PLISS: labeling places using online changepoint detection

Autonomous Robots
Selective extraction of entangled textures via adaptive PDE transform

Journal of Biomedical Imaging - Special issue on Mathematical Methods for Images and Surfaces 2011
A modular image search engine based on key words and color features

Transactions on Edutainment VIII
Structure extraction from texture via relative total variation

ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Retrieval-based cartoon gesture recognition and applications via semi-supervised heterogeneous classifiers learning

Pattern Recognition
Monte Carlo cluster refinement for noise robust image segmentation

Journal of Visual Communication and Image Representation
Feature-based textures

EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Large-scale data management for PRT-based real-time rendering of dynamically skinned models

EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Natural image colorization

EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Enhancing contour primitives by pairwise grouping and relaxation

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Multi-spectral saliency detection

Pattern Recognition Letters
ESVC-based extraction and segmentation of texture features

Computers & Geosciences
Rapid image segmentation using color, texture and syntactic visual features

AICI'12 Proceedings of the 4th international conference on Artificial Intelligence and Computational Intelligence
Exploiting publicly available cartographic resources for aerial image analysis

Proceedings of the 20th International Conference on Advances in Geographic Information Systems
Action recognition using linear dynamic systems

Pattern Recognition
Global optimization in discretized parameter space for predefined object segmentation

Proceedings of the 7th International Conference on Ubiquitous Information Management and Communication
Multiscale edge detection based on Gaussian smoothing and edge tracking

Knowledge-Based Systems
Regional appearance modeling based on the clustering of intensity profiles

Computer Vision and Image Understanding
Background intensity independent texture features for assessing breast cancer risk in screening mammograms

Pattern Recognition Letters
One-Class multiple instance learning and applications to target tracking

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Segmentation of Ill-Defined Objects by Convoluting Context Window of Each Pixel with a Non-Parametric Function

International Journal of Computer Vision and Image Processing
Break and conquer: efficient correlation clustering for image segmentation

SIMBAD'13 Proceedings of the Second international conference on Similarity-Based Pattern Recognition
On the impact of anisotropic diffusion on edge detection

Pattern Recognition
Agriculture satellite image segmentation using a modified artificial Hopfield neural network

Computers in Human Behavior
Integrating edge detection and fuzzy connectedness for automated segmentation of anatomical branching structures

International Journal of Bioinformatics Research and Applications
Learning to resize image

Neurocomputing
Systematic skin segmentation: merging spatial and non-spatial data

Multimedia Tools and Applications
A distinct and compact texture descriptor

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper provides an algorithm for partitioning grayscale images into disjoint regions of coherent brightness and texture. Natural images contain both textured and untextured regions, so the cues of contour and texture differences are exploited simultaneously. Contours are treated in the intervening contour framework, while texture is analyzed using textons. Each of these cues has a domain of applicability, so to facilitate cue combination we introduce a gating operator based on the texturedness of the neighborhood at a pixel. Having obtained a local measure of how likely two nearby pixels are to belong to the same region, we use the spectral graph theoretic framework of normalized cuts to find partitions of the image into regions of coherent texture and brightness. Experimental results on a wide range of images are shown.