Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Machine learning for first-order theorem proving
Bridge J., Holden S., Paulson L. Journal of Automated Reasoning53 (2):141-172,2014.Type:Article
Date Reviewed: Jul 22 2015

Bridge and colleagues have developed a methodology of machine learning for theorem proving that uses real-valued features of the problem at hand and determines in a rigorous manner and with fewer preconceptions the possible connections between feature values and the best heuristic to use. They have chosen the five most-used heuristics from the E theorem prover, using as learning methods support vector machines or Gaussian processes; then, they applied their methodology to a large collection of problems taken from the Thousands of Problems for Theorem Provers (TPTP) library as a training set from which to learn.

Rather than learning the form of the heuristic itself, they make use of known good heuristics (as mentioned, the five most used) and learn to select an appropriate one. Also, instead of using accuracy to measure performance, they show as a better parameter to use the Matthews correlation coefficient. The difference is that accuracy only takes into account the true positives and the true negatives (the sum of them divided by the size of number of tests), whereas the Matthews correlation coefficient uses also the false positives and false negatives, and the denominator is far more than only the crude size of tests, instead using the square root of all combinations of products of sums among true and false positives, and true and false negatives.

They demonstrate that machine learning can effectively be applied to theorem proving. While they did not study the sharing factor specifically in terms of its effectiveness in identifying a heuristic, they have found that dynamic features in general have provided little or no increase in performance when used in addition to static features.

I strongly recommend this paper to specialists and advanced students of machine learning and automatic theorem proving.

Reviewer:  Arturo Ortiz-Tapia Review #: CR143638 (1510-0905)
Bookmark and Share
  Featured Reviewer  
 
Learning (I.2.6 )
 
 
Feature Evaluation And Selection (I.5.2 ... )
 
 
Gaussian Quadrature (G.1.4 ... )
 
Would you recommend this review?
yes
no
Other reviews under "Learning": Date
Learning in parallel networks: simulating learning in a probabilistic system
Hinton G. (ed) BYTE 10(4): 265-273, 1985. Type: Article
Nov 1 1985
Macro-operators: a weak method for learning
Korf R. Artificial Intelligence 26(1): 35-77, 1985. Type: Article
Feb 1 1986
Inferring (mal) rules from pupils’ protocols
Sleeman D.  Progress in artificial intelligence (, Orsay, France,391985. Type: Proceedings
Dec 1 1985
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy