Some optimization problems in multivariate statistics

  • Authors:
  • T. Rapcsák

  • Affiliations:
  • Computer and Automation Research Institute, Hungarian Academy of Sciences, H-1518 Budapest, P.O. Box 63, Hungary (e-mail: rapcsak@oplab.sztaki.hu URL: http://www.oplab.sztaki ...

  • Venue:
  • Journal of Global Optimization
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Interesting and important multivariate statistical problems containing principal component analysis, statistical visualization and singular value decomposition, furthermore, one of the basic theorems of linear algebra, the matrix spectral theorem, the characterization of the structural stability of dynamical systems and many others lead to a new class of global optimization problems where the question is to find optimal orthogonal matrices. A special class is where the problem consists in finding, for any 2≤k≤n, the dominant k-dimensional eigenspace of an n×n symmetric matrix A in Rn where the eigenspaces are spanned by the k largest eigenvectors. This leads to the maximization of a special quadratic function on the Stiefel manifold Mn,k. Based on the global Lagrange multiplier rule developed in Rapcsák (1997) and the paper dealing with Stiefel manifolds in optimization theory (Rapcsák, 2002), the global optimality conditions of this smooth optimization problem are obtained, then they are applied in concrete cases.