Personalization on the Net using Web mining: introduction
Communications of the ACM
Automatic personalization based on Web usage mining
Communications of the ACM
Proceedings of the 20th international conference on World wide web
Framework and algorithms for network bucket testing
Proceedings of the 21st international conference on World Wide Web
Know your personalization: learning topic level personalization in online services
Proceedings of the 22nd international conference on World Wide Web
Effective Interpretation of Bucket Testing Results through Big Data Analytics
BIGDATACONGRESS '13 Proceedings of the 2013 IEEE International Congress on Big Data
Hi-index | 0.00 |
Online service platforms like search engines, news websites, information portal sites and others offer highly personalized content to the users based on their interest and taste. At the same time, these online sites, with large audiences, frequently use bucket testing to evaluate the impact of a new feature or service on a small subset of its users before releasing it to the entire user population. In general, web personalization leads to an improved user engagement for the sites, but it can also interfere and adversely impact the online bucket testing experiments. In this work, we show empirically through real experiments conducted on Yahoo pages that how personalization can mislead to erroneous interpretation of the bucket testing results. We also present a novel algorithmic framework that addresses this challenge and draws a more accurate inference from the bucket testing results by factoring in the personalization experience of the users. The effectiveness of our algorithm is demonstrated through experiments conducted on Yahoo pages.