Adaptive planar and rotational image stitching for mobile devices

  • Authors:
  • Christopher Herbon;Klaus Tönnies;Bernd Stock

  • Affiliations:
  • HAWK Fakultät, Naturwissenschaften und Technik, Göttingen, Germany;Otto-von-Guericke-Universität Magdeburg, Magdeburg, Germany;HAWK Fakultät Naturwissenschaften und Technik, Göttingen, Germany

  • Venue:
  • Proceedings of the 5th ACM Multimedia Systems Conference
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

A novel stitching method is presented that is capable of automatically determining the panorama type, planar or rotational, form a set of input images. The proposed method distinguishes between two kinds of panoramas, which we achieve through homography parametrization for the estimation of a global camera motion. The presented algorithm is part of a complete image stitching pipeline, where the determined panorama type is utilized for adaptive bundle adjustment with a matching number of degrees of freedom (DOFs). For planar scenes bundle adjustment for the homography's full eight DOFs are used, while three DOFs have proven to be sufficient for rotational panoramas. Knowledge about the panorama type yields significant advantages with regard to the selection of a mapping surface and the over all processing time and memory usage, which is especially import when being used on mobile devices such as smartphones, tablets, and digital cameras. For rotational panoramas, a spherical mapping surface is chosen, while a planar surface is suitable for a planar panorama. The resulting panorama image thus adequately represents the obseved scene in both cases, which cannot be achieved by current methods. The method was implemented on an iPhone 5S and tested on 50 scenes. Computation times for processing between 5 and 15 images for rotational and planar stitching ranged from 3 to 15 seconds with peak memory usage below 100 MB in all cases. The average reprojection error was slightly higher for rotational stitching but well below 1.5 pixels in each case.