Modern Information Retrieval
Integrated Algorithms for Newspaper Page Decomposition and Article Tracking
ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Xed: A New Tool for eXtracting Hidden Structures from Electronic Documents
DIAL '04 Proceedings of the First International Workshop on Document Image Analysis for Libraries (DIAL'04)
The SMART Retrieval System—Experiments in Automatic Document Processing
The SMART Retrieval System—Experiments in Automatic Document Processing
Unsupervised Newspaper Segmentation Using Language Context
ICDAR '07 Proceedings of the Ninth International Conference on Document Analysis and Recognition - Volume 02
Dolores: An Interactive and Class-Free Approach for Document Logical Restructuring
DAS '08 Proceedings of the 2008 The Eighth IAPR International Workshop on Document Analysis Systems
IEEE Computational Intelligence Magazine
Ant system: optimization by a colony of cooperating agents
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Adaptive document block segmentation and classification
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
CAPSO: Centripetal accelerated particle swarm optimization
Information Sciences: an International Journal
| Hi-index | 0.00 |
The primary information units in a newspaper are the articles. How to segment a newspaper page into individual articles and to recover the reading order of each article, namely newspaper article reconstruction, is known to be challenging due to the complexity of the multi-article page layout. In this paper, we propose a novel article reconstruction approach by solving a series of subtasks: grouping the article bodies, detecting the reading order, associating the title-body pairs and linking article parts scattered in multiple pages. We formulate reading order detection as a traveling salesman problem (TSP), and employ the Max-Min Ant System (MMAS) to solve it. Furthermore, a level-based pheromone mechanism is introduced to improve the efficiency of standard MMAS. Moreover, in sharp contrast to the existing methods, we perform the first two subtasks of article reconstruction in reverse order, that is, we detect the reading order of the text blocks first and then use the content continuity implicitly specified in the reading order to aggregate text blocks of the same article. In this way, we can effectively overcome the limitation of content similarity on article body aggregation. The other two subtasks (associating the title-body pairs, linking article parts scattered in multiple pages), are solved under a unified bipartite graph framework, which models the complex relationships between page objects as one-to-one correspondences, and accomplishes the two subtasks by finding the optimal matching on this graph. During the optimization process, various information sources, including geometric layout, linguistic and semantic content, are deeply mined in MMAS and bipartite graph model to deal with the wide range of complex newspaper layouts. Experimental results on real-world data have demonstrated the effectiveness of our proposed method. It has also been adopted in several large-scale newspaper digitalization projects.