User interface evaluation in an iterative design process: a comparison of three techniques
Conference Companion on Human Factors in Computing Systems
A simple rule-based part of speech tagger
ANLC '92 Proceedings of the third conference on Applied natural language processing
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An effective approach to document retrieval via utilizing WordNet and recognizing phrases
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Why we twitter: understanding microblogging usage and communities
Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis
Predictors of answer quality in online Q&A sites
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Knowledge sharing and yahoo answers: everyone knows something
Proceedings of the 17th international conference on World Wide Web
Designing games with a purpose
Communications of the ACM - Designing games with a purpose
Towards a model of understanding social search
Proceedings of the 2008 ACM conference on Computer supported cooperative work
Matchin: eliciting user preferences with an online game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User-centered design of a social game to tag music
Proceedings of the ACM SIGKDD Workshop on Human Computation
Twitter power: Tweets as electronic word of mouth
Journal of the American Society for Information Science and Technology
Is it really about me?: message content in social awareness streams
Proceedings of the 2010 ACM conference on Computer supported cooperative work
Tweet, Tweet, Retweet: Conversational Aspects of Retweeting on Twitter
HICSS '10 Proceedings of the 2010 43rd Hawaii International Conference on System Sciences
A comparison of visual and textual page previews in judging the helpfulness of web pages
Proceedings of the 19th international conference on World wide web
Design lessons from the fastest q&a site in the west
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Who gives a tweet?: evaluating microblog content value
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Proceeding of the 16th International Academic MindTrek Conference
Twasebook: a "crowdsourced phrasebook" for language learners using Twitter
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems
| Hi-index | 0.01 |
Millions of recommendations, opinions and experiences are shared across popular microblogging platforms and services each day. Yet much of this content becomes quickly lost in the stream shortly after being posted. This paper looks at the feasibility of identifying useful content in microblog streams so that it might be archived to facilitate wider access and reference. Towards this goal, we present an experiment with a game-with-a-purpose called Twiage that we designed to determine how well the deluge of content in "raw" microblog streams could be turned into filtered and ranked collections using ratings from players. Experiments with Twiage validate the feasibility of applying human-computation to this problem, finding strong agreement about what constitutes the "most useful" content in our test dataset. Second, we compare the effectiveness of various methods of eliciting such ratings, finding that a "choose-best" interface and Elo rating ranking scheme yield the greatest agreement in the fewest rounds. External validation of resulting top-rated twitter content with a domain expert found that while the top Twiage-ranked "tweets" were among the best of the set, there was a tendency for players to also select what we term "weak spam" - e.g., promotional content disguised as articles or reviews, indicating a need for more stringent content filtering.