ACM Computing Surveys (CSUR)
The Wisdom of Crowds
A benchmark for 3D mesh segmentation
ACM SIGGRAPH 2009 papers
Geometric reasoning via internet CrowdSourcing
2009 SIAM/ACM Joint Conference on Geometric and Physical Modeling
Putting the crowd to work in a knowledge-based factory
Advanced Engineering Informatics
| Hi-index | 0.00 |
Although a significant number of benchmark data sets for 3D object based retrieval systems have been proposed over the last decade their value is dependent on a robust classification of their content being available. Ideally researchers would want hundreds of people to have classified thousands of parts and the results recorded in a manner that explicitly shows how the similarity assessments varies with the precision used to make the judgement. This paper reports a study which investigated the proposition that Internet Crowdsourcing could be used to quickly and cheaply provide benchmark classifications of 3D shapes. The collective judgments of the anonymous workers produce a classification that has surprisingly fine granularity and precision. The paper reports the results of validating Crowdsourced judgements of 3D similarity against Purdue's ESB and concludes with an estimate of the overall costs associated with large scale classification tasks involving many tens of thousands of models.