Skip to main content
Log in

Automatic construction of decision trees for classification

  • Algorithms For Decision Problems
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

An algorithm for learning decision trees for classification and prediction is described which converts real-valued attributes into intervals using statistical considerations. The trees are automatically pruned with the help of a threshold for the estimated class probabilities in an interval. By means of this threshold the user can control the complexity of the tree, i.e. the degree of approximation of class regions in feature space. Costs can be included in the learning phase if a cost matrix is given. In this case class dependent thresholds are used.

Some applications are described, especially the task of predicting the high water level in a mountain river.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. L. Breiman, J.H. Friedman, R.A. Olshen and C.J. Stone,Classification and Regression Trees, The Wadsworth & Brooks/Cole Statistics/Probability Series (1984).

  2. G. Meyer-Brötz and J. Schürmann,Methoden der automatischen Zeichenerkennung (Akademie Verlag, Berlin, 1970).

    Google Scholar 

  3. J.R. Quinlan, Induction of decision trees, Machine Learning 1 (1986) 81–106.

    Google Scholar 

  4. J.R. Quinlan, Decision trees as probabilistic classifiers, in:Proc. 4th Int. Workshop on Machine Learning, ed. Langley (Morgan Kaufmann, Los Altos, 1987).

    Google Scholar 

  5. J.R. Quinlan, Simplifying decision trees, Int. J. Man-Machine Studies 27 (1987) 221–234.

    Article  Google Scholar 

  6. STATLOG (ESPRIT Project no. 5170), Deliverable D.2.2, Learning Algorithms and Datasets used in STATLOG (1991).

  7. S. Unger and F. Wysotzki,Lernfähige Klassifizierungssysteme (Akademie Verlag, Berlin, 1981).

    Google Scholar 

  8. L. Wehenkel et al., Artificial intelligence applied to online transient stability assessment of electrical power systems,Proc. 10th World Congress on Automatic Control, Vol. 6, Munich (1987) pp. 308–313.

    Google Scholar 

  9. T. van Cutsem et al., Decision trees for detecting emergency voltage conditions,Proc. 2nd Workshop on Bulk Power System Voltage, pp. 229–240.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Müller, W., Wysotzki, F. Automatic construction of decision trees for classification. Ann Oper Res 52, 231–247 (1994). https://doi.org/10.1007/BF02032305

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02032305

Keywords

Navigation