User-steered image segmentation paradigms: live wire and live lane
Graphical Models and Image Processing
User interface design for programmers
User interface design for programmers
Introduction to algorithms
Toward automated exploration of interactive systems
Proceedings of the 7th international conference on Intelligent user interfaces
IEEE Transactions on Pattern Analysis and Machine Intelligence
SIOX: Simple Interactive Object Extraction in Still Images
ISM '05 Proceedings of the Seventh IEEE International Symposium on Multimedia
Image-Segmentation Evaluation From the Perspective of Salient Object Extraction
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Distance measures for image segmentation evaluation
EURASIP Journal on Applied Signal Processing
2D Euclidean distance transform algorithms: A comparative survey
ACM Computing Surveys (CSUR)
Image segmentation evaluation: A survey of unsupervised methods
Computer Vision and Image Understanding
Synchronous Collaborative Information Retrieval: Techniques and Evaluation
ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Data-driven user simulation for automated evaluation of spoken dialog systems
Computer Speech and Language
A comparative evaluation of interactive segmentation algorithms
Pattern Recognition
ISBI'10 Proceedings of the 2010 IEEE international conference on Biomedical imaging: from nano to Macro
User-Centric Learning and Evaluation of Interactive Segmentation Systems
International Journal of Computer Vision
A survey of graph theoretical approaches to image segmentation
Pattern Recognition
Crowdsourced object segmentation with a game
Proceedings of the 2nd ACM international workshop on Crowdsourcing for multimedia
Hi-index | 0.00 |
We previously described a system for evaluating interactive segmentation by means of user experiments (McGuinness and O'Connor, 2010) [1]. This method, while effective, is time-consuming and labor-intensive. This paper aims to make evaluation more practicable by investigating if it is feasible to automate user interactions. To this end, we propose a general algorithm for driving the segmentation that uses the ground truth and current segmentation error to automatically simulate user interactions. We investigate four strategies for selecting which pixels will form the next interaction. The first of these is a simple, deterministic strategy; the remaining three strategies are probabilistic, and focus on more realistically approximating a real user. We evaluate four interactive segmentation algorithms using these strategies, and compare the results with our previous user experiment-based evaluation. The results show that automated evaluation is both feasible and useful.