Distributed information management in the National HPCC Software Exchange

  • Authors:
  • Shirley Browne;Jack Dongarra;Geoffrey C. Fox;Ken Hawick;Ken Kennedy;Rick Stevens;Robert Olson;Tom Rowan

  • Affiliations:
  • University of Tennessee, 107 Ayres Hall, Knoxville, TN;University of Tennessee and Oak Ridge National Laboratory;Syracuse University;Syracuse University;Rice University;Argonne National Laboratory;Argonne National Laboratory;Oak Ridge National Laboratory and University of Tennessee

  • Venue:
  • Supercomputing '95 Proceedings of the 1995 ACM/IEEE conference on Supercomputing
  • Year:
  • 1995

Quantified Score

Hi-index 0.00

Visualization

Abstract

Currently, most approaches to retrieving textual materials from scientific databases depend on a lexical match between words in usersý requests and those in or assigned to documents in a database. Because of the tremendous diversity in the words people use to describe the same document, lexical methods are necessarily incomplete and imprecise. Using the singular value decomposition (SVD), one can take advantage of the implicit higher-order structure in the association of terms with documents by determining the SVD of large sparse term by document matrices. Terms and documents represented by 200-300 of the largest singular vectors are then matched against user queries. We call this retrieval method Latent Semantic Indexing (LSI) because the subspace represents important associative relationships between terms and documents that are not evident in individual documents. LSI is a completely automatic yet intelligent indexing method, widely applicable, and a promising way to improve usersý access to many kinds of textual materials, or to documents and services for which textual descriptions are available. A survey of the computational requirements for managing LSI-encoded databases as well as current and future applications of LSI is presented.