Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
OSNAP: faster numerical linear algebra algorithms via sparser subspace embeddings
Nelson J., Nguyên H.  FOCS 2013 (Proceedings of the IEEE 54th Annual Symposium on Foundations of Computer Science, Oct 26-29, 2013)117-126.2013.Type:Proceedings
Date Reviewed: May 12 2014

For the solution of very high-dimensional linear algebra problems, much current research involves dimension reduction using norm-approximating projections. The Johnson–Lindenstrauss lemma [1] establishes the existence of projections that map a given space of dimension n to a given subspace dimension m << n, approximately preserving the 2-norm of vectors within a given relative error of ±&egr;. Moreover, the map can be linear, an m-by-n matrix. For example, a solution to the least-squares problem, Ax=b with an n-by-d matrix, A, and a right-hand side b, can be approximated by a least-squares solution to the m equations PAx=Pb, where P is an m-by-d norm-approximating projection. Although m, which depends on &egr; and d can be significantly smaller than n, it will still be large, and the time to compute the product PA will be large if both P and A are dense (hence the desire for sparse projections).

OSNAP stands for oblivious sparse norm-approximating projections. These projections are oblivious in that the matrix entries are independent identically distributed random variables. They are sparse because they have only a few nonzero entries per column; in fact, in some examples presented here, each column has only one entry. The authors compare their methods with work by others and give asymptotic running times for these methods.

The paper is well-written and the methods are clearly explained. There is an extensive bibliography. This version of the paper is from the proceedings of a conference, and the proofs are only sketched.

Reviewer:  Charles R. Crawford Review #: CR142269 (1408-0666)
1) Johnson, W. B.; Lindenstrauss, J, Extensions of Lipschitz mappings into a Hilbert space. In Proc. of the Conf. on Modern Analysis and Probability. American Mathematical Society, 1982, 189–206.
Bookmark and Share
 
Numerical Linear Algebra (G.1.3 )
 
Would you recommend this review?
yes
no
Other reviews under "Numerical Linear Algebra": Date
Exploiting fast matrix multiplication within the level 3 BLAS
Higham N. ACM Transactions on Mathematical Software 16(4): 352-368, 2000. Type: Article
Aug 1 1991
Fundamentals of matrix computations
Watkins D., John Wiley & Sons, Inc., New York, NY, 1991. Type: Book (9780471614142)
Jun 1 1992
Computational methods for linear control systems
Petkov P., Christov N., Konstantinov M., Prentice Hall International (UK) Ltd., Hertfordshire, UK, 1991. Type: Book (9780131618039)
Jun 1 1992
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy