Automatic Keyphrase Extraction with a Refined Candidate Set

  • Authors:
  • Wei You;Dominique Fontaine;Jean-Paul Barthes

  • Affiliations:
  • -;-;-

  • Venue:
  • WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we develop and evaluate an automatic keyphrase extraction technique for scientific documents. A new candidate phrase generation method is proposed based on the core word expansion algorithm, which can reduce the size of candidate set by about 75% without increasing the computational complexity. Then in the step of feature calculation, when a phrase and its sub-phrases coexist as candidates, an inverse document frequency related feature is introduced for selecting the proper granularity. Experimental results show the efficiency and effectiveness of the refined candidate set and demonstrate that the overall performance of our system compares favorably with other known keyphrase extraction systems.