Sensitivity and Stability of Ranking Vectors

  • Authors:
  • Timothy P. Chartier;Erich Kreutzer;Amy N. Langville;Kathryn E. Pedings

  • Affiliations:
  • tichartier@davidson.edu and erkreutzer@davidson.edu;-;langvillea@cofc.edu and kepeding@edisto.cofc.edu;-

  • Venue:
  • SIAM Journal on Scientific Computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We conduct an analysis of the sensitivity of three linear algebra-based ranking methods: the Colley, Massey, and Markov methods. Our analysis employs reverse engineering, in that we start with a simple input ranking vector that we use to build a perfect season, and we then determine the output rating vectors produced by the three methods. This analysis shows that the PageRank rating vector is strongly nonuniformly spaced, while the Colley and Massey methods provide a uniformly spaced rating vector, which is more natural for a perfect season. We further extend our study of the sensitivity and rank stability of these three methods with a careful perturbation analysis of the same perfect season dataset. We find that the Markov method is highly sensitive to small changes in the data and show with an example from the NFL that the Markov method's ranking vector displays some odd unstable behavior.