Efficient text summarization using lexical chains

  • Authors:
  • H. Gregory Silber;Kathleen F. McCoy

  • Affiliations:
  • Computer and Information Sciences, University of Delaware, Newark, DE;Computer and Information Sciences, University of Delaware, Newark, DE

  • Venue:
  • Proceedings of the 5th international conference on Intelligent user interfaces
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

The rapid growth of the Internet has resulted in enormous amounts of information that has become more difficult to access efficiently. Internet users require tools to help manage this vast quantity of information. The primary goal of this research is to create an efficient and effective tool that is able to summarize large documents quickly. This research presents a linear time algorithm for calculating lexical chains which is a method of capturing the “aboutness” of a document. This method is compared to previous, less efficient methods of lexical chain extraction. We also provide alternative methods for extracting and scoring lexical chains. We show that our method provides similar results to previous research, but is substantially more efficient. This efficiency is necessary in Internet search applications where many large documents may need to be summarized at once, and where the response time to the end user is extremely important.