Construction of decision trees applying genetic algorithm of structural and parametric synthesis
Keywords:
decision trees, genetic algorithm, structural and parametric optimization, genetic encodingAbstract
Construction of decision trees is considered as the problem of optimal structural and parametric synthesis. A genetic algorithm is proposed to solve this problem, implementing a consequent trees growing according to the learning dataset. The approach is used for structure encoding based on saving all structural variations in population in the order as they appear. Developed crossing and mutation operators allow avoiding known problems of structural optimization.References
Тененев В. А., Якимович Б. А. Генетические алгоритмы в моделировании систем. - Ижевск : Изд-во ИжГТУ, 2010. - 308 с.
Wo-Chiang Lee. Genetic Programming Decision Tree for Bankruptcy Prediction // Atlantis Press, Proceedings of the 2006 Joint Conference on Information Sciences JCIS 2006. - Pp. 4-7. - URL: <http://www.atlantis-press.com/php/download_paper.php?id=8 (дата> обращения: 24.05.2012).
Classification and regression trees / L. Breiman, J. H. Friedman, R. A. Olshen et al. - California : Wadsworth & Brooks, 1984. - 368 p.
Koza, J. R. Genetic Programming: On the Programming of Computers by Means of Natural Selection (Complex Adaptive Systems). - MIT Press, 1992. - 819 р.
Stanley, K. O., Miikkulainen, R. Evolving Neural Networks through Augmenting Topologies // Evolutionary Computation. - 2002. - Vol. 10, Nr 2. - Pp. 99-127.
Quinlan, J. R. Induction of Decision Trees // Machine Learning. - Vol. 1, Iss. 1. - Pp. 81-106. - URL: http://www.dmi.unict.it/~apulvirenti/agd/Qui86.pdf (дата <http://www.atlantis-press.com/php/download_paper.php?id=8 (дата> обращения: 24.05.2012).