Abstract
This paper proposes a method for refining numerical constants occurring in rules of a knowledge base expressed in a first order logic language. The method consists in tuning numerical parameters by performing error gradient descent. The knowledge base to be refined can be manually handcrafted or automatically acquired by a symbolic relational learner, able to deal with numerical features. The results of an experimental analysis performed on four case studies show that the refinement step can be effective in improving classification performances.
Article PDF
Similar content being viewed by others
References
Apt, K., Blair, H., & Walker, A. (1988). Towards a theory of declarative knowledge. In J. Minker (Ed.) Foundations of deductive databases and logic programming (pp. 89–148) Los Altos, CA: Morgan Kaufmann.
Baroglio, C., Giordana, A., Kaiser, M., Nuttin, M., & Piola, R. (1996). Learning controllers for industrial robots. Machine Learning, 23, 221–250.
Bergadano, F., Giordana, A., & Saitta, L. (1988). Learning concepts in noisy environment. IEEE Transaction on Pattern Analysis and Machine Intelligence, PAMI-10, 555–578.
Blockeel, H. & De Raedt, L. (1998). Top-down induction of first-order logical decision trees. Artificial Intelligence, 101, 285–297.
Botta, M. & Giordana, A. (1993). SMART+: A multi-strategy learning tool. In IJCAI-93, Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence (pp. 937–943) Chambéry, France.
Botta, M., Giordana, A., & Piola, R. (1997a). FONN: Combining first order logic with connectionist learning. Proceedings of the 14th International Conference on Machine Learning ICML-97 (pp. 48–56) Nashville, TN: Morgan Kaufmann.
Botta, M., Giordana, A., & Piola, R. (1997b). Refining first order theories with neural networks. In Z. Ras & A. Skowron. (Ed.), Proceedings of the International Symposium on Methodologies for Intelligent Systems ISMIS-97, LNAI (Vol. 1325, pp. 84–93) Charlotte, NC: Springer-Verlag.
Botta, M., Giordana, A., & Piola, R. (1997c). Refining numerical terms in Horn clauses. Topics in Artificial Intelligence, proceedings of the AI*IA Conference. LNAI (Vol. 1321, pp. 13–23) Rome, Italy: Springer-Verlag.
Breiman, L., Friedman, J., Ohlsen, R., & Stone, C. (1984). Classification And Regression Trees. Pacific Grove, CA: Wadsworth & Brooks.
Burns, B. & Danyluk, A. (1999). Feature selection vs theory reformulation: a study of genetic refinement of knowledge-based neural networks. Machine Learning, this issue.
DeMori, R., Giordana, A., Laface, P., & Saitta, L. (1984). An expert system for mapping acoustic cues into phonetic features. Information Sciences, 33, 115–155.
Esposito, F., Malerba, D., & Semeraro, G. (1992). Classification in noisy environments using a distance measure between structural symbolic descriptions. IEEE Transactions on Pattern Analisys and Machine Intelligence, 14(3), 390–402.
Frasconi, P., Gori, M., Maggini, M., & Soda, G. (1996). Representation of finite state automata in recurrent radial basis function networks. Machine Learning, 23, 5–32.
Fu, L. (1993). Knowledge-based connectionism for revising domain theories. IEEE Transactions on Systems, Man and Cybernetics, 23(1), 173–182.
Giordana, A., Neri, F., Saitta, L., & Botta, M. (1997). Integrating multiple learning strategies in first order logics. Machine Learning, 27, 209–240.
Jang, J. (1993). ANFIS: Adaptive-Network-Based Fuzzy Inference System. IEEE Transactions on Systems, Men and Cybernetics, 23(3), 665–687.
Karalič, A. & Bratko, I. (1997). First order regression. Machine Learning, 26, 147–176.
Lavrač, N. & Džeroski, S. (1994). Inductive logic programming: techniques and applications. Chichester, UK: Ellis Horwood.
Lloyd, J. W. (1987). Foundations of logic programming. Berlin, Germany: Springer.
Mahoney, J. & Mooney, R. (1994). Comparing methods for refining certainity-factor rule-bases. Proc. of the Eleventh Internetional Workshop on Machine Learning ML-94, Rutgers University, NJ.
Michalski, R. (1983). A theory and methodology of inductive learning. In R. Michalski, J. Carbonell, & T. Mitchell, (Eds), Machine learning: an artificial intelligence approach (pp. 83–134) Los Altos, CA: Morgan Kaufmann.
Mitchell, T., Keller, R., & Kedar-Cabelli, S. (1986). Explanation based generalization: an unifying view. Machine Learning, 1, 47–80.
Moody, J. & Darken, C. (1988). Learning with localized receptive fields. In T. Sejnowski, D. Touretzky, & G. Hinton (Eds.), Connectionist models summer school, Carnegie Mellon University.
Muggleton, S. (1995). Inverse entailment and Progol. New Generation Computing, 13, 245–286.
Omlin, C. & Giles, C. (1996). Constructing deterministic finite-state automata in recurrent neural networks. Journal of the ACM, 43(6), 937–972.
Piola, R. (1998). Refinement of knowledge bases in first order logics by means of neural networks. Ph.D. Thesis, Università di Torino, Italy.
Poggio, T. & Girosi, F. (1990). Networks for approximation and learning. Proceedings of the IEEE, 78(9), 1481–1497.
Quinlan, R. (1983). Efficient classification procedures. In J. Carbonell, R. Michalski,& T. Mitchell (Eds.), Machine learning, an artificial intelligence approach. Morgan Kaufmann.
Quinlan, R. (1990). Learning logical definitions from relations. Machine Learning, 5, 239–266.
Quinlan, R. (1993). C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo, CA.
Rumelhart, D. E. & McClelland, J. L. (1986). Parallel distributed processing: explorations in the microstructure of cognition, Parts I & II. Cambridge, Massachusetts: MIT Press.
Sebag, M. & Rouveirol, C. (1995). Polynomial-time learning in logic programming and constraint logic programming. Proc. of ILP-95 (pp. 105–126) LNAI (Vol. 1297).
Towell, G. & Shavlik, J. (1994). Knowledge Based Artificial Neural Networks. Artficial Intelligence, 70(4), 119–166.
Tresp, V., Hollatz, J., & Ahmad, S. (1993). Network structuring and training using rule-based knowledge. In S. Hanson, J. Cowan, & C. Giles (Eds.), Advances in neural information processing systems 5 (NIPS-5), (pp. 871–878) San Mateo, CA: Morgan Kaufmann.
Watanabe, L. & Rendell, L. (1991). Learning structural decision trees from examples. Proc. of the 12th International Joint Conference on Artificial Intelligence, IJCAI-91 (pp. 770–776), Sidney, Australia.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Botta, M., Piola, R. Refining Numerical Constants in First Order Logic Theories. Machine Learning 38, 109–131 (2000). https://doi.org/10.1023/A:1007686007399
Issue Date:
DOI: https://doi.org/10.1023/A:1007686007399