Matchin: eliciting user preferences with an online game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Ranking from pairs and triplets: information quality, evaluation methods and query complexity
Proceedings of the fourth ACM international conference on Web search and data mining
Topical semantics of twitter links
Proceedings of the fourth ACM international conference on Web search and data mining
Identifying relevant social media content: leveraging information diversity and user cognition
Proceedings of the 22nd ACM conference on Hypertext and hypermedia
A weighted multi-factor algorithm for microblog search
AMT'11 Proceedings of the 7th international conference on Active media technology
Learning to rank with multi-aspect relevance for vertical search
Proceedings of the fifth ACM international conference on Web search and data mining
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
DASFAA'12 Proceedings of the 17th international conference on Database Systems for Advanced Applications - Volume Part I
Conversation retrieval for microblogging sites
Information Retrieval
Case study: recommending course reading materials in a small virtual learning community
International Journal of Web Based Communities
Synthesis ranking with critic resonance
Proceedings of the 3rd Annual ACM Web Science Conference
Predicting responses to microblog posts
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Supervised learning of semantic relatedness
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Discerning actuality in backstage: comprehensible contextual aging
EC-TEL'12 Proceedings of the 7th European conference on Technology Enhanced Learning
Personalized Tweet Ranking Based on AHP: A Case Study of Micro-blogging Message Ranking in T.Sina
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03
| Hi-index | 0.01 |
We study the problem of designing a mechanism to rank items in forums by making use of the user reviews such as thumb and star ratings. We compare mechanisms where forum users rate individual posts and also mechanisms where the user is asked to perform a pairwise comparison and state which one is better. The main metric used to evaluate a mechanism is the ranking accuracy vs the cost of reviews, where the cost is measured as the average number of reviews used per post. We show that for many reasonable probability models, there is no thumb (or star) based ranking mechanism that can produce approximately accurate rankings with bounded number of reviews per item. On the other hand we provide a review mechanism based on pairwise comparisons which achieves approximate rankings with bounded cost. We have implemented a system, shoutvelocity, which is a twitter-like forum but items (i.e., tweets in Twitter) are rated by using comparisons. For each new item the user who posts the item is required to compare two previous entries. This ensures that over a sequence of n posts, we get at least n comparisons requiring one review per item on average. Our mechanism uses this sequence of comparisons to obtain a ranking estimate. It ensures that every item is reviewed at least once and winning entries are reviewed more often to obtain better estimates of top items.