How to evaluate opinionated keyphrase extraction?

  • Authors:
  • Gábor Berend;Veronika Vincze

  • Affiliations:
  • University of Szeged, Szeged, Hungary;Hungarian Academy of Sciences Research Group on Artificial Intelligence, Szeged, Hungary

  • Venue:
  • WASSA '12 Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Evaluation often denotes a key issue in semantics- or subjectivity-related tasks. Here we discuss the difficulties of evaluating opinionated keyphrase extraction. We present our method to reduce the subjectivity of the task and to alleviate the evaluation process and we also compare the results of human and machine-based evaluation.