Automatically predicting peer-review helpfulness

Authors:
Wenting Xiong;Diane Litman
Affiliations:
University of Pittsburgh, Pittsburgh, PA;University of Pittsburgh, Pittsburgh, PA
Venue:
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Year:
2011

Citing 10
Cited 2

Making large-scale support vector machine learning practical

Advances in kernel methods
The automated acquisition of topic signatures for text summarization

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Online large-margin training of dependency parsers

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system

Computers & Education
Modeling and Predicting the Helpfulness of Online Reviews

ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
How opinions are received by online communities: a case study on amazon.com helpfulness votes

Proceedings of the 18th international conference on World wide web
Automatically assessing review helpfulness

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Detecting key sentences for automatic assistance in peer reviewing research articles in educational sciences

NLPIR4DL '09 Proceedings of the 2009 Workshop on Text and Citation Analysis for Scholarly Digital Libraries
Estimating the Helpfulness and Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics

IEEE Transactions on Knowledge and Data Engineering
Identifying problem localization in peer-review feedback

ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part II

Understanding differences in perceived peer-review helpfulness using natural language processing

IUNLPBEA '11 Proceedings of the 6th Workshop on Innovative Use of NLP for Building Educational Applications
An interactive analytic tool for peer-review exploration

Proceedings of the Seventh Workshop on Building Educational Applications Using NLP

Quantified Score

Hi-index	0.00

Visualization

Abstract

Identifying peer-review helpfulness is an important task for improving the quality of feedback that students receive from their peers. As a first step towards enhancing existing peer-review systems with new functionality based on helpfulness detection, we examine whether standard product review analysis techniques also apply to our new context of peer reviews. In addition, we investigate the utility of incorporating additional specialized features tailored to peer review. Our preliminary results show that the structural features, review uni-grams and meta-data combined are useful in modeling the helpfulness of both peer reviews and product reviews, while peer-review specific auxiliary features can further improve helpfulness prediction.