Test collection selection and gold standard generation for a multiply-annotated opinion corpus

Authors:
Lun-Wei Ku;Yong-Shen Lo;Hsin-Hsi Chen
Affiliations:
National Taiwan University;National Taiwan University;National Taiwan University
Venue:
ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Year:
2007

Citing 1
Cited 2

Thumbs up?: sentiment classification using machine learning techniques

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10

Opinion Mining and Sentiment Analysis

Foundations and Trends in Information Retrieval
Sentiment classification of blog posts using topical extracts

ADC '12 Proceedings of the Twenty-Third Australasian Database Conference - Volume 124

Quantified Score

Hi-index	0.00

Visualization

Abstract

Opinion analysis is an important research topic in recent years. However, there are no common methods to create evaluation corpora. This paper introduces a method for developing opinion corpora involving multiple annotators. The characteristics of the created corpus are discussed, and the methodologies to select more consistent testing collections and their corresponding gold standards are proposed. Under the gold standards, an opinion extraction system is evaluated. The experiment results show some interesting phenomena.