A Sparse Regularized Least-Squares Preference Learning Algorithm

  • Authors:
  • Evgeni Tsivtsivadze;Tapio Pahikkala;Antti Airola;Jorma Boberg;Tapio Salakoski

  • Affiliations:
  • (TUCS), Dept. of Info. Technol., Univ. of Turku, Joukahaisenkatu 3-5 B, 20520 Turku, Finland, email: evgeni.tsivtsivadze@utu.fi, tapio.pahikkala@utu.fi, antti.airola@utu.fi, jorma.boberg@utu.fi, t ...;(TUCS), Dept. of Info. Technol., Univ. of Turku, Joukahaisenkatu 3-5 B, 20520 Turku, Finland, email: evgeni.tsivtsivadze@utu.fi, tapio.pahikkala@utu.fi, antti.airola@utu.fi, jorma.boberg@utu.fi, t ...;(TUCS), Department of Information Technology, University of Turku, Joukahaisenkatu 3-5 B, 20520 Turku, Finland, email: evgeni.tsivtsivadze@utu.fi, tapio.pahikkala@utu.fi, antti.airola@utu.fi, jorm ...;(TUCS), Department of Information Technology, University of Turku, Joukahaisenkatu 3-5 B, 20520 Turku, Finland, email: evgeni.tsivtsivadze@utu.fi, tapio.pahikkala@utu.fi, antti.airola@utu.fi, jorm ...;(TUCS), Department of Information Technology, University of Turku, Joukahaisenkatu 3-5 B, 20520 Turku, Finland, email: evgeni.tsivtsivadze@utu.fi, tapio.pahikkala@utu.fi, antti.airola@utu.fi, jorm ...

  • Venue:
  • Proceedings of the 2008 conference on Tenth Scandinavian Conference on Artificial Intelligence: SCAI 2008
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning preferences between objects constitutes a challenging task that notably differs from standard classification or regression problems. The objective involves prediction of ordering of the data points. Furthermore, methods for learning preference relations usually are computationally more demanding than standard classification or regression methods. Recently, we have proposed a kernel based preference learning algorithm, called RankRLS, whose computational complexity is cubic with respect to the number of training examples. The algorithm is based on minimizing a regularized least-squares approximation of a ranking error function that counts the number of incorrectly ranked pairs of data points. When nonlinear kernel functions are used, the training of the algorithm might be infeasible if the amount of examples is large. In this paper, we propose a sparse approximation of RankRLS whose training complexity is considerably lower than that of basic RankRLS. In our experiments, we consider parse ranking, a common problem in natural language processing. We show that sparse RankRLS significantly outperforms basic RankRLS in this task. To conclude, the advantage of sparse RankRLS is the computational efficiency when dealing with large amounts of training data together with high dimensional feature representations.