Using collaborative filtering to weave an information tapestry
Communications of the ACM - Special issue on information filtering
GroupLens: an open architecture for collaborative filtering of netnews
CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Recommending and evaluating choices in a virtual community of use
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Social information filtering: algorithms for automating “word of mouth”
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Fab: content-based, collaborative recommendation
Communications of the ACM
CSCW '98 Proceedings of the 1998 ACM conference on Computer supported cooperative work
Recommendation as classification: using social and content-based information in recommendation
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Combining collaborative filtering with personal agents for better recommendations
AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
A Framework for Collaborative, Content-Based and Demographic Filtering
Artificial Intelligence Review - Special issue on data mining on the Internet
Why batch and user evaluations do not give the same results
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Getting to know you: learning new user preferences in recommender systems
Proceedings of the 7th international conference on Intelligent user interfaces
Methods and metrics for cold-start recommendations
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Eigentaste: A Constant Time Collaborative Filtering Algorithm
Information Retrieval
Discovering Relevant Scientific Literature on the Web
IEEE Intelligent Systems
Learning Collaborative Information Filters
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Collaborative Learning and Recommender Systems
ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Latent Class Models for Collaborative Filtering
IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Collaborative Filtering by Personality Diagnosis: A Hybrid Memory and Model-Based Approach
UAI '00 Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence
UAI '01 Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Learning trees and rules with set-valued features
AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Empirical analysis of predictive algorithms for collaborative filtering
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
A Web page prediction model based on click-stream tree representation of user behavior
Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Implicit feedback for inferring user preference: a bibliography
ACM SIGIR Forum
A comparison of several predictive algorithms for collaborative filtering on multi-valued ratings
Proceedings of the 2004 ACM symposium on Applied computing
Applying Collaborative Filtering for Efficient Document Search
WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
Taxonomy-driven computation of product recommendations
Proceedings of the thirteenth ACM international conference on Information and knowledge management
SERF: integrating human recommendations with search
Proceedings of the thirteenth ACM international conference on Information and knowledge management
Improving recommendation lists through topic diversification
WWW '05 Proceedings of the 14th international conference on World Wide Web
Designing and evaluating kalas: A social navigation system for food recipes
ACM Transactions on Computer-Human Interaction (TOCHI)
Incremental click-stream tree model: Learning from new users for web page prediction
Distributed and Parallel Databases
SuggestBot: using intelligent task routing to help people find work in wikipedia
Proceedings of the 12th international conference on Intelligent user interfaces
Click data as implicit relevance feedback in web search
Information Processing and Management: an International Journal
AWESOME: a data warehouse-based system for adaptive website recommendations
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
On exploiting classification taxonomies in recommender systems
AI Communications - Recommender Systems
A semantic complement to enhance electronic market
Expert Systems with Applications: An International Journal
Testing and evaluating tag recommenders in a live system
Proceedings of the third ACM conference on Recommender systems
Qualitative analysis of user-based and item-based prediction algorithms for recommendation agents
Engineering Applications of Artificial Intelligence
A web-page usage prediction scheme using weighted suffix trees
SPIRE'07 Proceedings of the 14th international conference on String processing and information retrieval
Incorporating concept hierarchies into usage mining based recommendations
WebKDD'06 Proceedings of the 8th Knowledge discovery on the web international conference on Advances in web mining and web usage analysis
Serendipitous recommendations via innovators
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Application and analysis of interpersonal networks for a community support system
JSAI'03/JSAI04 Proceedings of the 2003 and 2004 international conference on New frontiers in artificial intelligence
A probabilistic approach to semantic collaborative filtering using world knowledge
Journal of Information Science
A comparison of on-line computer science citation databases
ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries
Hi-index | 0.00 |
Automated recommendation (e.g., personalized product recommendation on an ecommerce web site) is an increasingly valuable service associated with many databases--typically online retail catalogs and web logs. Currently, a major obstacle for evaluating recommendation algorithms is the lack of any standard, public, real-world testbed appropriate for the task. In an attempt to fill this gap, we have created REFEREE, a framework for building recommender systems using ResearchIndex--a huge online digital library of computer science research papers--so that anyone in the research community can develop, deploy, and evaluate recommender systems relatively easily and quickly. Research Index is in many ways ideal for evaluating recommender systems, especially so-called hybrid recommenders that combine information filtering and collaborative filtering techniques. The documents in the database are associated with a wealth of content information (author, title, abstract, full text) and collaborative information (user behaviors), as well as linkage information via the citation structure. Our framework supports more realistic evaluation metrics that assess user buy-in directly, rather than resorting to offline metrics like prediction accuracy that may have little to do with end user utility. The sheer scale of ResearchIndex (over 500,000 documents with thousands of user accesses per hour) will force algorithm designers to make real-world trade-offs that consider performance, not just accuracy. We present our own tradeoff decisions in building an example hybrid recommender called PD-Live. The algorithm uses content-based similarity information to select a set of documents from which to recommend, and collaborative information to rank the documents. PD-Live performs reasonably well compared to other recommenders in ResearchIndex.