Lessons and Challenges from Mining Retail E-Commerce Data

  • Authors:
  • Ron Kohavi;Llew Mason;Rajesh Parekh;Zijian Zheng

  • Affiliations:
  • Amazon.com, 1200 12th Ave. South, Suite 1200, Seattle, WA 98144. ronnyk@cs.stanford.edu;Blue Martini Software, 2600 Campus Drive, San Mateo, CA 94403. lmason@bluemartini.com;Blue Martini Software, 2600 Campus Drive, San Mateo, CA 94403. rparekh@bluemartini.com;Microsoft Corporation, One Microsoft Way, Redmond, WA 98052. zijianz@microsoft.com

  • Venue:
  • Machine Learning
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

The architecture of Blue Martini Software's e-commerce suite has supported data collection, data transformation, and data mining since its inception. With clickstreams being collected at the application-server layer, high-level events being logged, and data automatically transformed into a data warehouse using meta-data, common problems plaguing data mining using weblogs (e.g., sessionization and conflating multi-sourced data) were obviated, thus allowing us to concentrate on actual data mining goals. The paper briefly reviews the architecture and discusses many lessons learned over the last four years and the challenges that still need to be addressed. The lessons and challenges are presented across two dimensions: business-level vs. technical, and throughout the data mining lifecycle stages of data collection, data warehouse construction, business intelligence, and deployment. The lessons and challenges are also widely applicable to data mining domains outside retail e-commerce.