Dealing with Class Skew in Context Recognition

  • Authors:
  • Mathias Stager;Paul Lukowicz;Gerhard Troster

  • Affiliations:
  • ETH Zurich, Switzerland;ETH Zurich, Switzerland;Institute for Computer Systems and Networks, UMIT Hall, Austria

  • Venue:
  • ICDCSW '06 Proceedings of the 26th IEEE International ConferenceWorkshops on Distributed Computing Systems
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

As research in context recognition moves towards more maturity and real life applications, appropriate and reliable performance metrics gain importance. This paper focuses on the issue of performance evaluation in the face of class skew (varying, unequal occurrence of individual classes), which is common for many context recognition problems. We propose to use ROC curves and Area Under the Curve (AUC) instead of the more commonly used accuracy to better account for class skew. The main contributions of the paper are to draw the attention of the community to these methods, present a theoretical analysis of their advantages for context recognition, and illustrate their performance on a real life case study.