Restoring Warped Document Images through 3D Shape Modeling

Authors:
Chew Lim Tan;Li Zhang;Zheng Zhang;Tao Xia
Affiliations:
IEEE;-;-;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2006

Citing 12
Cited 15

Shape from Shading with Interreflections Under a Proximal Light Source: Distortion-Free Copying of an UnfoldedBook

International Journal of Computer Vision
Former books digital processing: image warping

DIA '97 Proceedings of the 1997 Workshop on Document Image Analysis
Nonlinear Shape Restoration For Document Images

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
On the Evaluation of Document Analysis Components by Recall, Precision, and Accuracy

ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Document Image Quality: Making Fine Discriminations

ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Recovery of Distorted Document Images from Bound Volumes

ICDAR '01 Proceedings of the Sixth International Conference on Document Analysis and Recognition
Rectifying the Bound Document Image Captured by the Camera: A Model Based Approach

ICDAR '03 Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 1
Correcting Document Image Warping Based on Regression of Curved Text Lines

ICDAR '03 Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 1
A Cylindrical Surface Model to Rectify the Bound Document Image

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Image Restoration of Arbitrarily Warped Documents

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape Reconstruction and Image Restoration for Non-Flat Surfaces of Documents with a Stereo Vision System

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Estimation of 3D Shape of Warped Document Surface for Image Restoration

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01

Shape from shading for the digitization of curved documents

Machine Vision and Applications
Restoring 2D Content from Distorted Documents

IEEE Transactions on Pattern Analysis and Machine Intelligence
Restoration of arbitrarily warped document images based on text line and word detection

SPPR'07 Proceedings of the Fourth conference on IASTED International Conference: Signal Processing, Pattern Recognition, and Applications
Restoration of arbitrarily warped document images based on text line and word detection

SPPRA '07 Proceedings of the Fourth IASTED International Conference on Signal Processing, Pattern Recognition, and Applications
Restoring Chinese documents images based on text boundary lines

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
A dewarping algorithm to compensate volume binding distortion in scanned documents

Proceedings of the 2010 ACM Symposium on Applied Computing
Shape from contour for the digitization of curved documents

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Book scanner dewarping with weak 3d measurements and a simplified surface model

DGCI'08 Proceedings of the 14th IAPR international conference on Discrete geometry for computer imagery
User-assisted ink-bleed reduction

IEEE Transactions on Image Processing - Special section on distributed camera networks: sensing, processing, communication, and implementation
Grid-based modelling and correction of arbitrarily warped historical document images for large-scale digitisation

Proceedings of the 2011 Workshop on Historical Document Imaging and Processing
Reconstruction of shredded document based on image feature matching

Expert Systems with Applications: An International Journal
On the Illumination Invariance of the Level Lines under Directed Light: Application to Change Detection

SIAM Journal on Imaging Sciences
Correcting bound document images based on automatic and robust curved text lines estimation

ICCPOL'06 Proceedings of the 21st international conference on Computer Processing of Oriental Languages: beyond the orient: the research challenges ahead
Correcting book binding distortion in scanned documents

ICIAR'10 Proceedings of the 7th international conference on Image Analysis and Recognition - Volume Part II
An image based performance evaluation method for page dewarping algorithms using SIFT features

CBDAR'11 Proceedings of the 4th international conference on Camera-Based Document Analysis and Recognition

Quantified Score

Hi-index	0.15

Visualization

Abstract

Scanning a document page from a thick bound volume often results in two kinds of distortions in the scanned image, i.e., shade along the "spine” of the book and warping in the shade area. In this paper, we propose an efficient restoration method based on the discovery of the 3D shape of a book surface from the shading information in a scanned document image. From a technical point of view, this shape from shading (SFS) problem in real-world environments is characterized by 1) a proximal and moving light source, 2) Lambertian reflection, 3) nonuniform albedo distribution, and 4) document skew. Taking all these factors into account, we first build practical models (consisting of a 3D geometric model and a 3D optical model) for the practical scanning conditions to reconstruct the 3D shape of the book surface. We next restore the scanned document image using this shape based on deshading and dewarping models. Finally, we evaluate the restoration results by comparing our estimated surface shape with the real shape as well as the OCR performance on original and restored document images. The results show that the geometric and photometric distortions are mostly removed and the OCR results are improved markedly.