Efficient Identification of Duplicate Bibliographical References

Authors:
Vinícius Veloso de Melo;Alneu de Andrade Lopes
Affiliations:
Instituto de Ciências Matemáticas e de Computação da Universidade de São Paulo;Instituto de Ciências Matemáticas e de Computação da Universidade de São Paulo
Venue:
Proceedings of the 2005 conference on Advances in Logic Based Intelligent Systems: Selected Papers of LAPTEC 2005
Year:
2005

Citing 4
Cited 0

CiteSeer: an autonomous Web agent for automatic retrieval and identification of interesting publications

AGENTS '98 Proceedings of the second international conference on Autonomous agents
Automatic segmentation of text into structured records

SIGMOD '01 Proceedings of the 2001 ACM SIGMOD international conference on Management of data
Digital Libraries and Autonomous Citation Indexing

Computer
Identifying and Merging Related Bibliographic Records

Identifying and Merging Related Bibliographic Records

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this work we present an approach to extract and to structure bibliographical references from BibTex files, allowing the identification of the duplicate ones, which can appear slightly different in different files. To deal with this problem, existing systems use classifiers, clustering or others algorithms, allied with an Edit Distance metric, to distinguish between duplicate and nonduplicate records. The main challenge is to identify the duplicate records in database where the volume of the references can reach millions, in an efficient computational time. The technique proposed constructs a key (string) with information from each reference and stores them in a metric data structure called Slim-Tree. The Slim-Tree structure allows the minimization of the comparisons between references (being close to O(n log (n))), considering only the most similar keys to a given one.