Attributes for classifier feedback
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Object categorization based on a supervised mean shift algorithm
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
| Hi-index | 0.00 |
Traditional supervised visual learning simply asks annotators "what" label an image should have. We propose an approach for image classification problems requiring subjective judgment that also asks "why", and uses that information to enrich the learned model. We develop two forms of visual annotator rationales: in the first, the annotator highlights the spatial region of interest he found most influential to the label selected, and in the second, he comments on the visual attributes that were most important. For either case, we show how to map the response to synthetic contrast examples, and then exploit an existing large-margin learning technique to refine the decision boundary accordingly. Results on multiple scene categorization and human attractiveness tasks show the promise of our approach, which can more accurately learn complex categories with the explanations behind the label choices.