Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Matrix recipes for hard thresholding methods
Kyrillidis A., Cevher V. Journal of Mathematical Imaging and Vision48 (2):235-265,2014.Type:Article
Date Reviewed: Nov 10 2014

The authors consider a class of methods for solving the general affine rank minimization (ARM) problem. Mathematically, the problem is described in terms of a multilinear operator A that maps an m × n matrix X into a p-vector y. The goal is to find a matrix X of rank k ⪡ min {m,n} such that y - AX is minimized in the Euclidean norm. Particular cases of the problem arise in quantum tomography, matrix completion (also known as the Netflix problem), and, a very special version, in principal component analysis (PCA). Of course, the problem is NP-hard, thus all reasonable algorithms are approximation algorithms.

The paper separates the approximation methods into two classes. The first is convex relaxations. The rank constraint is replaced by a constraint on the nuclear norm of X, which is the sum of the first k singular values. That change allows us to employ well-understood techniques from constrained optimization.

The second class uses greedy algorithms that maintain the nonconvex nature of the problem. These greedy algorithms refine a rank-k solution based upon local information. Hard thresholding methods, the topic of this paper, are a subset of this class of algorithms.

In 30 densely written pages, the paper gives a nice overview of thresholding methods, including the mathematical development, conditions for convergence, and comparisons. The bibliography is helpful for any researcher wanting to understand more about these methods and their applications.

Reviewer:  Jesse L. Barlow Review #: CR142915 (1502-0166)
Bookmark and Share
 
Inverse Problems (G.1.8 ... )
 
 
Approximation (G.1.2 )
 
Would you recommend this review?
yes
no
Other reviews under "Inverse Problems": Date
Computational methods for inverse problems
Vogel C., Society for Industrial & Applied Mathematics, 2002.  183, Type: Book (9780898715071)
May 29 2003
Image Deblurring: I Can See Clearly Now
Nagy J., O’Leary D. Computing in Science and Engineering 5(3): 82-84, 2003. Type: Article
Nov 25 2003
Inverse sorting problem by minimizing the total weighted number of changes and partial inverse sorting problems
Yang X., Zhang J. Computational Optimization and Applications 36(1): 55-66, 2007. Type: Article
Aug 1 2007
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy