Landmark recognition and retrieval: from 2D to 3D

  • Authors:
  • Xian Xiao;ChangSheng Xu;JinQiao Wang;Min Xu

  • Affiliations:
  • National Lab of Pattern Recognition, Institute of Automation, CAS, Beij & China-Singapore Institute of Digital Media, Singapore, BeiJing, China;National Lab of Pattern Recognition, Institute of Automation, CAS, Beij & China-Singapore Institute of Digital Media, Singapore , BeiJing, China;National Lab of Pattern Recognition, Institute of Automation, CAS, Beij & China-Singapore Institute of Digital Media, Singapore , BeiJing, China;University of Technology, Sydney 123 Broadway & National Lab of Pattern Recognition, Institute of Automation, CAS, Beijing, Sydney, Australia

  • Venue:
  • J-HGBU '11 Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Existing landmark retrieval methods cannot provide a comprehensive solution, by which user can view different angles of landmark. In this paper, we propose a novel approach to reconstruct and retrieve 3D landmark models by direct 2D to 3D matching. In an offline module, firstly, attention-based 3D reconstruction method is proposed to reconstruct sparse 3D landmark models. Secondly, we construct textured 3D landmark model for each sparse 3D landmark model. Finally, a 3D landmark recognizer is built for each landmark based on the 3D landmark model. In online module, query images are recognized by the 3D landmark recognizers using a 2D to 3D matching approach. For each recognized query image, a 3D landmark model and a 3D landmark texture model are presented as a query result. Experimental results demonstrate the effectiveness of our proposed approach.