Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Entropic risk minimization for nonparametric estimation of mixing distributions
Watanabe K., Ikeda S. Machine Learning99 (1):119-136,2015.Type:Article
Date Reviewed: Aug 31 2015

The paper introduces a new method for nonparametric estimation of mixing distributions, which is a generalization of the maximum likelihood estimation (MLE) of Lindsay [1,2]. The method aims at minimizing a function, named entropic risk measure, of one parameter. The authors show that by choosing a good range for this parameter, the method generalizes better (less prone to overfitting) than the maximum likelihood method. Tests are conducted with a synthetic set of data from a 2D Gaussian mixture distribution. The paper also discusses the relationship between the introduced method and the rate-distortion method.

This is a fairly technical paper: easy to read for theoreticians in the field (mathematicians, statisticians), but extremely hard for the rest of the world to understand since deep knowledge of statistical distribution literature is required. Also, note that the proposed method has been proved for synthetic data of a certain distribution; there is not yet proof of its workability in real-world data.

Reviewer:  Anca Doloc-Mihu Review #: CR143733 (1511-0972)
1) Lindsay, B. G.; Lesperance, M. L. A review of semiparametric mixture models. Journal of Statistical Planning and Inference 47, 1-2(1995), 29–39.
2) Lindsay, B. G. The geometry of mixture likelihoods: a general theory. Annals of Statistics 11, 1(1983), 86–94.
Bookmark and Share
 
Nonparametric Statistics (G.3 ... )
 
Would you recommend this review?
yes
no
Other reviews under "Nonparametric Statistics": Date
Nonparametric econometrics
Pagan A., Ullah A., Cambridge University Press, New York, NY, 1999. Type: Book (9780521355643)
Aug 1 1999
Baysian nonparametrics via neural networks
Lee H., Society for Industrial & Applied Mathematics., 2004. Type: Book (9780898715637)
Jan 18 2005
On projection-based tests for directional and compositional data
Cuesta-Albertos J., Cuevas A., Fraiman R. Statistics and Computing 19(4): 367-380, 2009. Type: Article
Mar 22 2010
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy