A comparison of predictive measures of problem difficulty for classification with Genetic Programming

Published in Journal Articles

Abstract

In the field of Genetic Programming (GP) a question exists that is difficult to solve; how can problem difficulty be determined? In
this paper the overall goal is to develop predictive tools that estimate how difficult a problem is for GP to solve. Here we analyse two groups of methods. We call the first group Evolvability Indicators (EI), measures that capture how amendable the fitness landscape is to a GP search. The second are Predictors of Expected Performance (PEP), models that take as input a set of descriptive attributes of a problem and predict the expected performance of a GP system. These predictive variables are domain specific thus problems are described in the context of the problem domain. This paper compares an EI, the Negative Slope Coefficient, and a PEP model for a GP classifier. Results suggest that the EI does not correlate with the performance of GP classifiers. Conversely, the PEP models show a high correlation with GP performance. It appears that while an EI estimates the difficulty of a search, it does not necessarily capture the difficulty of the underlying problem. However, while PEP models treat GP as a computational black-box, they can produce accurate performance predictions.

  1. Yuliana Martínez, Leonardo Trujillo, Galvan Galván-López and Pierrick Legrand. A comparison of predictive measures of problem difficulty for classification with Genetic Programming. In ERA 2012. 2012. BibTeX

    @inproceedings{,
    	title = "A comparison of predictive measures of problem difficulty for classification with Genetic Programming",
    	author = "Mart\'{i}nez, Yuliana and Trujillo, Leonardo and Galv\'{a}n-L\'{o}pez, Galvan and Legrand, Pierrick",
    	booktitle = "ERA 2012",
    	year = 2012
    }
    

Read more...
Subscribe to this RSS feed
Feedback