Abstract
An algorithm for learning decision trees for classification and prediction is described which converts real-valued attributes into intervals using statistical considerations. The trees are automatically pruned with the help of a threshold for the estimated class probabilities in an interval. By means of this threshold the user can control the complexity of the tree, i.e. the degree of approximation of class regions in feature space. Costs can be included in the learning phase if a cost matrix is given. In this case class dependent thresholds are used.
Some applications are described, especially the task of predicting the high water level in a mountain river.
Similar content being viewed by others
References
L. Breiman, J.H. Friedman, R.A. Olshen and C.J. Stone,Classification and Regression Trees, The Wadsworth & Brooks/Cole Statistics/Probability Series (1984).
G. Meyer-Brötz and J. Schürmann,Methoden der automatischen Zeichenerkennung (Akademie Verlag, Berlin, 1970).
J.R. Quinlan, Induction of decision trees, Machine Learning 1 (1986) 81–106.
J.R. Quinlan, Decision trees as probabilistic classifiers, in:Proc. 4th Int. Workshop on Machine Learning, ed. Langley (Morgan Kaufmann, Los Altos, 1987).
J.R. Quinlan, Simplifying decision trees, Int. J. Man-Machine Studies 27 (1987) 221–234.
STATLOG (ESPRIT Project no. 5170), Deliverable D.2.2, Learning Algorithms and Datasets used in STATLOG (1991).
S. Unger and F. Wysotzki,Lernfähige Klassifizierungssysteme (Akademie Verlag, Berlin, 1981).
L. Wehenkel et al., Artificial intelligence applied to online transient stability assessment of electrical power systems,Proc. 10th World Congress on Automatic Control, Vol. 6, Munich (1987) pp. 308–313.
T. van Cutsem et al., Decision trees for detecting emergency voltage conditions,Proc. 2nd Workshop on Bulk Power System Voltage, pp. 229–240.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Müller, W., Wysotzki, F. Automatic construction of decision trees for classification. Ann Oper Res 52, 231–247 (1994). https://doi.org/10.1007/BF02032305
Issue Date:
DOI: https://doi.org/10.1007/BF02032305