Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Painting-to-3D model alignment via discriminative visual elements
Aubry M., Russell B., Sivic J. ACM Transactions on Graphics (TOG)33 (2):1-14,2014.Type:Article
Date Reviewed: Sep 2 2014

Generating 3D models of historical photographs, paintings, and line drawings using discriminative visual elements that align automatically is a recent trend in computer vision applications. These studies enhance the visualization of details, turning a 2D representation of an architectural site into a 3D model.

The authors present an automatic alignment technique that “aligns arbitrary 2D depictions of an architectural site with a 3D model of the site,” based on discriminative visual elements. According to the paper, they found that “appearance and scene structure in 2D depictions can be very different from the appearance and geometry of the 3D model ... due to the specific rendering style, drawing error, age, lighting, or change of seasons.” The authors redepict complex 3D models using a set of visually distinct mid-level scene elements that are possible matches “in 2D depictions of the scene despite large variations in rendering style (for example, watercolor, sketch, historical photograph) and structural changes (for example, missing scene parts, large occluders) of the scene.” The proposed approach adds to the automatic computational rephotography of “historical paintings and photographs with respect to a 3D model” approximating viewpoints.

Experimental data include a set of human-generated 3D models from Trimble 3D Warehouse, and “a 3D model of San Marco’s Square that was reconstructed from a set of photographs using dense multiview stereo.” A total of 85 historical photographs and 252 nonphotographic depictions of the sites--drawings (60 images), engravings (45 images), and paintings (147 images)--were collected from the Internet. The authors use Amazon Mechanical Turk to conduct a user study to validate the proposed approach, comparing it against four baseline approaches. In the set of sampled views, the authors observe failed cases with regard to large-scale symmetries, locally confusing image structures, and false viewpoint depiction.

The computational cost estimation for both offline and online discriminative visual element detection stages makes the paper worth reading. The authors suggest that their approach could lead to “the possibility of efficient indexing for visual search of paintings and historical photographs (for example, via hashing of the [histogram of oriented gradients (HOG)] features ..., or automatic fitting of complex nonperspective models used in historical imagery.”

Reviewer:  Lalit Saxena Review #: CR142679 (1412-1090)
Bookmark and Share
  Reviewer Selected
 
 
3D/ Stereo Scene Analysis (I.2.10 ... )
 
 
Statistical (I.4.10 ... )
 
Would you recommend this review?
yes
no
Other reviews under "3D/Stereo Scene Analysis": Date
Probabilistic regularisation and symmetry in binocular dynamic programming stereo
Gimel’farb G. Pattern Recognition Letters 23(4): 431-442, 2002. Type: Article
Aug 7 2003
A new approach to automatic reconstruction of a 3-D world using active stereo vision
Lin C., Shih S., Hung Y., Tang G. Computer Vision and Image Understanding 85(2): 117-143, 2002. Type: Article
Jun 3 2003
Linear-time algorithms for testing the realisability of line drawings of curved objects
Cooper M. Artificial Intelligence 108(1-2): 31-67, 1999. Type: Article
Aug 1 1999
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy