Least-Squares Estimation, Linear Programming, and Momentum: A Geometric Parametrization of Local Minima

Byrnes, C. I. & Willems, J. C., 1986, In : Ima journal of mathematical control and information. 3, 2-3, p. 103-118 16 p.

Research output: Contribution to journalArticleAcademicpeer-review

  • Christopher I. Byrnes
  • Jan C. Willems

In contrast to estimation by ordinary least squares, estimation by total least squares has much less favourable properties as far as existence and uniqueness of local minima is concerned. Indeed, as elementary examples show, and contrary to intuition gleaned from the Gauss-Markov theorem for ordinary least squares, for certain data sets this problem can have nonisolated local minima and local maxima. Using Morse theory and the Lie theory of coadjoint orbits, we show that, despite this apparent degeneracy, the distribution of critical points of least-squares problems is remarkably well behaved. For arbitrary data, the least-squares function is perfect in the sense of the Morse-Bott theory. In particular, the set of local minima always forms a connected manifold while there exists a unique minimum value.

Original languageEnglish
Pages (from-to)103-118
Number of pages16
JournalIma journal of mathematical control and information
Issue number2-3
Publication statusPublished - 1986

View graph of relations

ID: 4190625