A survey of thresholding techniques
Computer Vision, Graphics, and Image Processing
Context dependent edge detection and evaluation
Pattern Recognition
Performance study of several global thresholding techniques for segmentation
Computer Vision, Graphics, and Image Processing
Digital image processing
Three-dimensional image segmentation using a split, merge and group approach
Pattern Recognition Letters
Image thresholding: some new techniques
Signal Processing
Validation of the interleaved pyramid for the segmentation of 3D vector images
VIP '94 The international conference on volume image processing on Volume image processing
Objective and quantitative segmentation evaluation and comparison
Signal Processing
The image processing handbook (2nd ed.)
The image processing handbook (2nd ed.)
Quantitative evaluation of color image segmentation results
Pattern Recognition Letters
Contextual and non-contextual performance evaluation of edge detectors
Pattern Recognition Letters
Empirical Evaluation Techniques in Computer Vision
Empirical Evaluation Techniques in Computer Vision
Edge detector evaluation using empirical ROC curves
Computer Vision and Image Understanding - Special issue on empirical evaluation of computer vision algorithms
Comparison of edge detector performance through use in an object recognition task
Computer Vision and Image Understanding - Special issue on empirical evaluation of computer vision algorithms
Adaptive Split-and-Merge Segmentation Based on Piecewise Least-Square Approximation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiresolution Color Image Segmentation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Stand-alone objective segmentation quality evaluation
EURASIP Journal on Applied Signal Processing - Image analysis for multimedia interactive services - part I
Evaluating Image Segmentation Algorithms Using the Pareto Front
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
A Supervised Approach to the Evaluation of Image Segmentation Methods
CAIP '95 Proceedings of the 6th International Conference on Computer Analysis of Images and Patterns
Edge Flow: A Framework of Boundary Detection and Image Segmentation
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Color Image Segmentation Based on Markov Random Field Clustering for Histological Image Analysis
ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
A Method for Objective Edge Detection Evaluation and Detector Parameter Selection
IEEE Transactions on Pattern Analysis and Machine Intelligence
Epitomic analysis of appearance and shape
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues
IEEE Transactions on Pattern Analysis and Machine Intelligence
Unsupervised Evaluation of Image Segmentation Application to Multi-spectral Images
ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Towards Perceptually Driven Segmentation Evaluation Metrics
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 4 - Volume 04
Quantitative Evaluation of a Novel Image Segmentation Algorithm
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Image Analysis and Mathematical Morphology
Image Analysis and Mathematical Morphology
Image segmentation based on merging of sub-optimal segmentations
Pattern Recognition Letters
Meta-Evaluation of Image Segmentation Using Machine Learning
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Image-Segmentation Evaluation From the Perspective of Salient Object Extraction
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Genetic fusion: application to multi-components image segmentation
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 04
On the Quantitative Evaluation of Edge Detection Schemes and their Comparison with Human Performance
IEEE Transactions on Computers
Dynamic Measurement of Computer Generated Image Segmentations
IEEE Transactions on Pattern Analysis and Machine Intelligence
Design of statistical measures for the assessment of image segmentation schemes
CAIP'05 Proceedings of the 11th international conference on Computer Analysis of Images and Patterns
Comparison of edge detection algorithms using a structure frommotion task
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A methodology for quantitative performance evaluation of detection algorithms
IEEE Transactions on Image Processing
Objective evaluation of video segmentation quality
IEEE Transactions on Image Processing
Performance measures for video object segmentation and tracking
IEEE Transactions on Image Processing
Toward a generic evaluation of image segmentation
IEEE Transactions on Image Processing
A benchmark for 3D mesh segmentation
ACM SIGGRAPH 2009 papers
A new approach for image processing in foreign fiber detection
Computers and Electronics in Agriculture
Effectiveness of Video Segmentation Techniques for Different Categories of Videos
Proceedings of the 2008 conference on New Trends in Multimedia and Network Information Systems
A comparative evaluation of interactive segmentation algorithms
Pattern Recognition
Real-time moving object segmentation in H.264 compressed domain based on approximate reasoning
International Journal of Approximate Reasoning
Comparison of Segmentation Algorithms for the Zebrafish Heart in Fluorescent Microscopy Images
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Evaluation of Segmentation Techniques Using Region Size and Boundary Information
PReMI '09 Proceedings of the 3rd International Conference on Pattern Recognition and Machine Intelligence
A neutrosophic approach to image segmentation based on watershed method
Signal Processing
Adaptive Rough Entropy Clustering Algorithms in Image Segmentation
Fundamenta Informaticae
Segmentation of medical images using geo-theoretic distance matrix in fuzzy clustering
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Unsupervised measures for parameter selection of binarization algorithms
Pattern Recognition
Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing
Learning a nonlinear distance metric for supervised region-merging image segmentation
Computer Vision and Image Understanding
Fuzzy image fusion based on modified Self-Generating Neural Network
Expert Systems with Applications: An International Journal
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Toward automated evaluation of interactive segmentation
Computer Vision and Image Understanding
Original papers: A feature extraction software tool for agricultural object-based image analysis
Computers and Electronics in Agriculture
Rough entropy hierarchical agglomerative clustering in image segmentation
Transactions on rough sets XIII
Estimating image segmentation difficulty
MLDM'11 Proceedings of the 7th international conference on Machine learning and data mining in pattern recognition
Automatic localization of page segmentation errors
Proceedings of the 2011 Joint Workshop on Multilingual OCR and Analytics for Noisy Unstructured Text Data
Markovian approach using several Gibbs energy for remote sensing images segmentation
Analog Integrated Circuits and Signal Processing
A new algorithm for image segmentation via watershed transformation
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing - Volume Part II
Towards stratified model-based environmental visual perception for humanoid robots
Pattern Recognition Letters
Evaluation of segmentation techniques using region area and boundary matching information
Journal of Visual Communication and Image Representation
Multiview depth coding based on combined color/depth segmentation
Journal of Visual Communication and Image Representation
Journal of Mathematical Imaging and Vision
A subjective method for image segmentation evaluation
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Ridler and Calvard's, Kittler and Illingworth's and Otsu's methods for image thresholding
Pattern Recognition Letters
Spatial color image segmentation based on finite non-Gaussian mixture models
Expert Systems with Applications: An International Journal
Fast recognition of foreign fibers in cotton lint using machine vision
Mathematical and Computer Modelling: An International Journal
Image segmentation using fuzzy logic, neural networks and genetic algorithms: survey and trends
Machine Graphics & Vision International Journal
Computer Methods and Programs in Biomedicine
How to select microscopy image similarity metrics?
Proceedings of the ACM Conference on Bioinformatics, Computational Biology and Biomedicine
Kernel generalized fuzzy c-means clustering with spatial information for image segmentation
Digital Signal Processing
k nearest neighbor using ensemble clustering
DaWaK'12 Proceedings of the 14th international conference on Data Warehousing and Knowledge Discovery
An improved particle swarm optimisation for image segmentation of homogeneous images
PRICAI'12 Proceedings of the 12th Pacific Rim international conference on Trends in Artificial Intelligence
Automatic localization and correction of line segmentation errors
Proceeding of the workshop on Document Analysis and Recognition
Image thresholding based on semivariance
Pattern Recognition Letters
A stochastic gravitational approach to feature based color image segmentation
Engineering Applications of Artificial Intelligence
Breast mass contour segmentation algorithm in digital mammograms
Computer Methods and Programs in Biomedicine
Transforming cluster-based segmentation for use in OpenVL by mainstream developers
ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume Part I
Proceedings of the 5th IBM Collaborative Academia Research Exchange Workshop
A new evaluation measure for color image segmentation based on genetic programming approach
Image and Vision Computing
Automatic image segmentation using constraint learning and propagation
Digital Signal Processing
An ensemble-clustering-based distance metric and its applications
International Journal of Business Intelligence and Data Mining
Expert Systems with Applications: An International Journal
Quantum Information Processing
Hi-index | 0.00 |
Image segmentation is an important processing step in many image, video and computer vision applications. Extensive research has been done in creating many different approaches and algorithms for image segmentation, but it is still difficult to assess whether one algorithm produces more accurate segmentations than another, whether it be for a particular image or set of images, or more generally, for a whole class of images. To date, the most common method for evaluating the effectiveness of a segmentation method is subjective evaluation, in which a human visually compares the image segmentation results for separate segmentation algorithms, which is a tedious process and inherently limits the depth of evaluation to a relatively small number of segmentation comparisons over a predetermined set of images. Another common evaluation alternative is supervised evaluation, in which a segmented image is compared against a manually-segmented or pre-processed reference image. Evaluation methods that require user assistance, such as subjective evaluation and supervised evaluation, are infeasible in many vision applications, so unsupervised methods are necessary. Unsupervised evaluation enables the objective comparison of both different segmentation methods and different parameterizations of a single method, without requiring human visual comparisons or comparison with a manually-segmented or pre-processed reference image. Additionally, unsupervised methods generate results for individual images and images whose characteristics may not be known until evaluation time. Unsupervised methods are crucial to real-time segmentation evaluation, and can furthermore enable self-tuning of algorithm parameters based on evaluation results. In this paper, we examine the unsupervised objective evaluation methods that have been proposed in the literature. An extensive evaluation of these methods are presented. The advantages and shortcomings of the underlying design mechanisms in these methods are discussed and analyzed through analytical evaluation and empirical evaluation. Finally, possible future directions for research in unsupervised evaluation are proposed.