Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Recommended by Editor Recommended by Reviewer Recommended by Reader
Search
Extra-precise iterative refinement for overdetermined least squares problems
Demmel J., Hida Y., Riedy E., Li X.  ACM Transactions on Mathematical Software 35 (4): 1-32, 2009. Type: Article
Date Reviewed: Jul 28 2010

The algorithm for iterative refinement of least squares given here is an update of the 1967 work of Björck [1], with more recent ideas about componentwise errors and condition estimation. These ideas influenced stopping criteria, the use of the Hager-Higham condition estimator [2,3] to estimate relevant conditioning parameters, and the discussion of the role of extra-precision. Iterative refinement cannot be expected to improve the solutions of problems that are ill-conditioned, but can provide significant improvement for non-ill-conditioned problems, which are called “acceptably conditioned” here.

The authors state two goals for the refinement algorithm: “for acceptably conditioned problems [to] obtain small errors,” and that “a small error bound returned from the code [be] trustworthy.” One new theorem is proven, but it is similar to bounds that have appeared in previous work by some of the authors [4]; the new results of the paper are about the numerical tests of the software.

The authors do one million test problems, of which 577,412 are acceptably conditioned by standard normwise measures. All but 35 of these problems converged according to their stopping criteria, and for those the condition number in the infinity norm is larger than or close to the condition threshold. Thus, they could arguably be put in the ill-conditioned category.

For the convergent problems, the algorithm delivered tiny errors for the solution and least squares residuals, both normwise and componentwise--so the first goal was achieved. The second goal was also achieved for the acceptably conditioned problems--they were close to actual error and did not underestimate true errors.

The software described is useful for providing the best solution that can be reasonably expected to acceptably conditioned least squares problems.

Reviewer:  Jesse L. Barlow Review #: CR138192
1) Björck, A. Iterative refinement of linear least squares solutions. BIT 7, (1967), 257–278.
2) Hager, W. Condition estimates. SIAM J. Sci. Stat. Computing 5, (1984), 311–316.
3) Higham, N. Fortran codes for estimating the one-norm of a real or complex matrix, with applications to condition estimation. ACM Trans. Math. Soft. 14, (1988), 381–396.
4) Demmel, J.; Hida, Y.; Kahan, W.; Li, X.; Mukherjee, S.; Riedy, E. Error bounds from extra--precise iterative refinement. ACM Trans. Math Soft. 32, 2(2006), 325–351.
  Editor Recommended
 
 
Error Analysis (G.1.3 ... )
 
Would you recommend this review?
yes
no
Other reviews under "Error Analysis": Date
Probabilistic error analysis of Gaussian elimination in floating point and logarithmic arithmetic
Barlow J., Bareiss E.  Computing 34(4): 349-364, 1985. Type: Article
Oct 1 1986

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright © 2000-2010 Reviews.com
Terms of Use
| Privacy Policy