A Useful Form of Unitary Matrix Obtained from Any Sequence of Unit 2-Norm $n$-Vectors

  • Authors:
  • Christopher C. Paige

  • Affiliations:
  • paige@cs.mcgill.ca

  • Venue:
  • SIAM Journal on Matrix Analysis and Applications
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Charles Sheffield pointed out that the modified Gram-Schmidt (MGS) orthogonalization algorithm for the QR factorization of $B\!\in\!\R^{n\times k}$ is mathematically equivalent to the QR factorization applied to the matrix $B$ augmented with a $k\times k$ matrix of zero elements on top. This is true in theory for any method of QR factorization, but for Householder's method it is true in the presence of rounding errors as well. This knowledge has been the basis for several successful but difficult rounding error analyses of algorithms which in theory produce orthogonal vectors but significantly fail to do so because of rounding errors. Here we show that the same results can be found more directly and easily without recourse to the MGS connection. It is shown that for any sequence of $k$ unit 2-norm $n$-vectors there is a special $(n\!+\!k)$-square unitary matrix which we call a unitary augmentation of these vectors and that this matrix can be used in the analyses without appealing to the MGS connection. We describe the connection of this unitary matrix to Householder matrices. The new approach is applied to an earlier analysis to illustrate both the improvement in simplicity and advantages for future analyses. Some properties of this unitary matrix are derived. The main theorem on orthogonalization is then extended to cover the case of biorthogonalization.