A correlation analysis on LSA and HAL semantic space models

Authors:
Xin Yan;Xue Li;Dawei Song
Affiliations:
School of Information Technology and Electrical Engineering, The University of Queensland, QLD, Australia;School of Information Technology and Electrical Engineering, The University of Queensland, QLD, Australia;CRC for Enterprise Distributed Systems Technology (DSTC), The University of Queensland, QLD, Australia
Venue:
CIS'04 Proceedings of the First international conference on Computational and Information Science
Year:
2004

Citing 4
Cited 0

Information flow: the logic of distributed systems

Information flow: the logic of distributed systems
Document language models, query models, and risk minimization for information retrieval

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Relevance based language models

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Towards context sensitive information inference

Journal of the American Society for Information Science and Technology - Mathematical, logical, and formal methods in information retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we compare a well-known semantic spacemodel, Latent Semantic Analysis (LSA) with another model, Hyperspace Analogue to Language (HAL) which is widely used in different area, especially in automatic query refinement. We conduct this comparative analysis to prove our hypothesis that with respect to ability of extracting the lexical information from a corpus of text, LSA is quite similar to HAL. We regard HAL and LSA as black boxes. Through a Pearson's correlation analysis to the outputs of these two black boxes, we conclude that LSA highly co-relates with HAL and thus there is a justification that LSA and HAL can potentially play a similar role in the area of facilitating automatic query refinement. This paper evaluates LSA in a new application area and contributes an effective way to compare different semantic space models.