Investigating multi-label classification for human values

Authors:
Emi Ishita;Douglas W. Oard;Kenneth R. Fleischmann;An-Shou Cheng;Thomas Clay Templeton
Affiliations:
Surugadai University, Japan;University of Maryland;University of Maryland;University of Maryland;University of Maryland
Venue:
Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 47
Year:
2010

Citing 3
Cited 4

Opinion Mining and Sentiment Analysis

Foundations and Trends in Information Retrieval
Inter-coder agreement for computational linguistics

Computational Linguistics
Values of Stakeholders in the Net Neutrality Debate: Applying Content Analysis to Telecommunications Policy

HICSS '10 Proceedings of the 2010 43rd Hawaii International Conference on System Sciences

Modeling diverse standpoints in text classification: learning to be human by modeling human values

Proceedings of the 2011 iConference
The role of innovation and wealth in the net neutrality debate: A content analysis of human values in congressional and FCC hearings

Journal of the American Society for Information Science and Technology
Understanding individuals' personal values from social media word use

Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
How to see values in social computing: methods for studying values dimensions

Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes the development of a scalable process for people and machines working together to identify sections of text that reflect specific human values. A total of 2,005 sentences from 28 prepared testimonies presented before hearings on Net neutrality were manually annotated for one or more of ten human values using an annotation frame based on experience annotating similar content using the Schwartz Values Inventory. Moderately good agreement suggests that meaningful distinctions can often be drawn by human annotators. Several k-Nearest-Neighbor classifiers were compared in this preliminary study, yielding results that appear promising and that clearly point to productive directions for future work.