Using the web to validate lexico-semantic relations

Authors:
Hernani Pereira Costa;Hugo Gonçalo Oliveira;Paulo Gomes
Affiliations:
Cognitive and Media Systems Group, CISUC, University of Coimbra, Portugal;Cognitive and Media Systems Group, CISUC, University of Coimbra, Portugal;Cognitive and Media Systems Group, CISUC, University of Coimbra, Portugal
Venue:
EPIA'11 Proceedings of the 15th Portugese conference on Progress in artificial intelligence
Year:
2011

Citing 16
Cited 0

CYC: a large-scale investment in knowledge infrastructure

Communications of the ACM
Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL

EMCL '01 Proceedings of the 12th European Conference on Machine Learning
Automatic acquisition of hyponyms from large text corpora

COLING '92 Proceedings of the 14th conference on Computational linguistics - Volume 2
Learning by googling

ACM SIGKDD Explorations Newsletter
Is it the right answer?: exploiting web redundancy for Answer Validation

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Using LSA and noun coordination information to improve the precision and recall of automatic hyponymy extraction

CONLL '03 Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4
Espresso: leveraging generic patterns for automatically harvesting semantic relations

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Measuring semantic similarity between words using web search engines

Proceedings of the 16th international conference on World Wide Web
Mining for personal name aliases on the web

Proceedings of the 17th international conference on World Wide Web
Web-Based Measure of Semantic Relatedness

WISE '08 Proceedings of the 9th international conference on Web Information Systems Engineering
Hyponymy Extraction and Web Search Behavior Analysis Based on Query Reformulation

IBERAMIA '08 Proceedings of the 11th Ibero-American conference on AI: Advances in Artificial Intelligence
Harvesting relations from the web: quantifiying the impact of filtering functions

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
A probabilistic model of redundancy in information extraction

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Unsupervised named-entity extraction from the Web: An experimental study

Artificial Intelligence
Open information extraction using Wikipedia

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Information distance

IEEE Transactions on Information Theory

Quantified Score

Hi-index	0.01

Visualization

Abstract

The evaluation of semantic relations acquired automatically from text is a challenging task, which generally ends up being done by humans. Despite less prone to errors, manual evaluation is hardly repeatable, time-consuming and sometimes subjective. In this paper, we evaluate relational triples automatically, exploiting popular similarity measures on the Web. After using these measures to quantify triples according to the co-occurrence of their arguments and textual patterns denoting their relation, some scores revealed to be highly correlated with the correction rate of the triples. The measures were also used to select correct triples in a set, with best F1 scores around 96%.