Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Assessing neural network scene classification from degraded images
Tadros T., Cullen N., Greene M., Cooper E. ACM Transactions on Applied Perception16 (4):1-20,2019.Type:Article
Date Reviewed: Nov 27 2019

Image processing and understanding human vision have shared interests and methods since the beginning of computer vision research. In recent years, deep learning and in particular convolutional neural networks (CNNs) have been applied to both, as early human vision is believed to apply filters similarly to CNNs.

CNNs trained on large image datasets have an accuracy that rivals human ability to classify images. However, human observers are tolerant to image degradation while CNN results are debatable. The authors develop an experimental protocol to test CNNs on 200 images of indoor and outdoor scenes degraded with Gaussian blur, white noise, scrambling, and occluding grids at different levels. The CNN results are compared to results of a linear classifier using only HSV (hue, saturation, value) features and a linear model built with holistic spatial features (GIST). The results confirm that CNNs perform comparably to human observers when it comes to the original images, whereas GIST and HSV descriptors produce less accurate classifiers. For degraded images, however, CNN accuracy drops much faster than human accuracy.

Conclusions about whether CNNs model human vision are derived for high degradation levels; it seems that global image features are not well captured by CNNs. Moreover, comparing the levels of agreement suggests that CNN training creates different features from those used by humans when observing degraded images.

This paper is easy to follow, applies a rigorous method, shows many interesting statistics, and gives indications for future research. It is of interest to computer and cognitive scientists.

Reviewer:  G. Gini Review #: CR146801 (2003-0055)
Bookmark and Share
  Featured Reviewer  
 
General (I.4.0 )
 
 
Manipulators (I.2.9 ... )
 
 
Psychology (J.4 ... )
 
 
General (I.3.0 )
 
Would you recommend this review?
yes
no
Other reviews under "General": Date
Matrix structured image processing
Dougherty E., Giardina C., Prentice-Hall, Inc., Upper Saddle River, NJ, 1987. Type: Book (9789780135656235)
Jul 1 1988
Digital image processing (2nd ed.)
Gonzales R., Wintz P., Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987. Type: Book (9789780201110265)
Jul 1 1988
Art and design: AI and its consequences
Howard G., John Wiley & Sons, Inc., New York, NY, 1986. Type: Book (9780471909309)
Dec 1 1987
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy