Automatic document metadata extraction using support vector machines

  • Authors:

  • Hui Han;C. Lee Giles;Eren Manavoglu;Hongyuan Zha;Zhenyue Zhang;Edward A. Fox

  • Affiliations:

  • The Pennsylvania State University University Park, PA;The Pennsylvania State University University Park, PA;The Pennsylvania State University University Park, PA;The Pennsylvania State University University Park, PA;Zhejiang University, Yu-Quan Campus, Hangzhou 310027, P.R. China;Virginia Polytechnic Institute and State University, Blacksburg, VA

  • Venue:
  • Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic metadata generation provides scalability and usability for digital libraries and their collections. Machine learning methods offer robust and adaptable automatic metadata extraction. We describe a Support Vector Machine classification-based method for metadata extraction from header part of research papers and show that it outperforms other machine learning methods on the same task. The method first classifies each line of the header into one or more of 15 classes. An iterative convergence procedure is then used to improve the line classification by using the predicted class labels of its neighbor lines in the previous round. Further metadata extraction is done by seeking the best chunk boundaries of each line. We found that discovery and use of the structural patterns of the data and domain based word clustering can improve the metadata extraction performance. An appropriate feature normalization also greatly improves the classification performance. Our metadata extraction method was originally designed to improve the metadata extraction quality of the digital libraries Citeseer [17] and EbizSearch[24]. We believe it can be generalized to other digital libraries.