Benchmarks, performance evaluation and contests for 3D shape retrieval

Authors:
Afzal Godil;Zhouhui Lian;Helin Dutagaci;Rui Fang;T. P. Vanamali;Chun Pan Cheung
Affiliations:
National Institute of Standards and Technology;National Institute of Standards and Technology;National Institute of Standards and Technology;Michigan State University;National Institute of Standards and Technology;National Institute of Standards and Technology
Venue:
Proceedings of the 10th Performance Metrics for Intelligent Systems Workshop
Year:
2010

Citing 9
Cited 1

IR evaluation methods for retrieving highly relevant documents

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
The effect of topic set size on retrieval experiment error

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
The Princeton Shape Benchmark

SMI '04 Proceedings of the Shape Modeling International 2004
A survey of content based 3D shape retrieval methods

Multimedia Tools and Applications
A New Shape Benchmark for 3D Object Retrieval

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Retrieving articulated 3-d models using medial surfaces and their graph spectra

EMMCVPR'05 Proceedings of the 5th international conference on Energy Minimization Methods in Computer Vision and Pattern Recognition
SHREC'10 track: generic 3D warehouse

EG 3DOR'10 Proceedings of the 3rd Eurographics conference on 3D Object Retrieval
SHREC'10 track: non-rigid 3D shape retrieval

EG 3DOR'10 Proceedings of the 3rd Eurographics conference on 3D Object Retrieval
SHREC'10 track: range scan retrieval

EG 3DOR'10 Proceedings of the 3rd Eurographics conference on 3D Object Retrieval

On 3D object retrieval benchmarking

3D Research

Quantified Score

Hi-index	0.00

Visualization

Abstract

Benchmarking of 3D Shape retrieval allows developers and researchers to compare the strengths of different algorithms on a standard dataset. Here we describe the procedures involved in developing a benchmark and issues involved. We then discuss some of the current 3D shape retrieval benchmarks efforts of our group and others. We also review the different performance evaluation measures that are developed and used by researchers in the community. After that we give an overview of the 3D shape retrieval contest (SHREC) tracks run under the EuroGraphics Workshop on 3D Object Retrieval and give details of tracks that we organized for SHREC 2010. Finally we demonstrate some of the results based on the different SHREC contest tracks and the NIST shape benchmark.