How to reverse-engineer quality rankings

  • Authors:
  • Allison Chang;Cynthia Rudin;Michael Cavaretta;Robert Thomas;Gloria Chou

  • Affiliations:
  • Operations Research Center, Mass. Institute of Technology, Cambridge, USA 02139;MIT Sloan School of Management, Mass. Institute of Technology, Cambridge, USA 02139;Ford Motor Company, Dearborn, USA 48124;Ford Motor Company, Dearborn, USA 48124;Ford Motor Company, Dearborn, USA 48124

  • Venue:
  • Machine Learning
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

A good or bad product quality rating can make or break an organization. However, the notion of "quality" is often defined by an independent rating company that does not make the formula for determining the rank of a product publicly available. In order to invest wisely in product development, organizations are starting to use intelligent approaches for determining how funding for product development should be allocated. A critical step in this process is to "reverse-engineer" a rating company's proprietary model as closely as possible. In this work, we provide a machine learning approach for this task, which optimizes a certain rank statistic that encodes preference information specific to quality rating data. We present experiments on data from a major quality rating company, and provide new methods for evaluating the solution. In addition, we provide an approach to use the reverse-engineered model to achieve a top ranked product in a cost-effective way.