Abstract
The recursive estimation of the regression function m(x) = E(Y/X = x) and its derivatives is studied under dependence conditions. The examined method of nonparametric estimation is a recursive version of the estimator based on locally weighted polynomial fitting, that in recent articles has proved to be an attractive technique and has advantages over other popular estimation techniques. For strongly mixing processes, expressions for the bias and variance of these estimators are given and asymptotic normality is established. Finally, a simulation study illustrates the proposed estimation method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Cleveland, W. S. (1979). Robust locally weighted regression and smoothing scatterplots, J. Amer. Statist. Assoc., 74, 829–836.
Cleveland, W. S. and Devlin, S. J. (1988). Locally weighted regression: an approach to regression anlysis by local fitting, J. Amer. Statist. Assoc., 83, 597–610.
Devroye, L. and Wagner, T. J. (1980). On the L 1 convergence of kernel estimators of regression function with application in discrimination, Z. Wahrsch. Verw. Gebiete, 51, 15–25.
Doukhan, P. (1995). Mixing, Properties and Examples, Lecture Notes in Statistics, Vol. 85, Springer, Berlin.
Eubank, R. L. (1988). Spline Smoothing and Nonparametric Regression, Marcel Dekker, New York.
Fan, J. (1992). Design-adaptive nonparametric regression, J. Amer. Statist. Assoc., 87, 998–1004.
Fan, J. (1993). Local linear regression smoothers and their minimax efficiency, Ann. Statist., 21, 196–216.
Fan, J. and Gijbels, I. (1992). Variable bandwidth and local linear regression smoothers, Ann. Statist., 20, 2008–2036.
Fan, J. and Gijbels, I. (1995). Data-driven bandwidth selection in local polynomial fitting: variable bandwidth and spatial adaption, J. Roy. Stat. Soc. Ser. B, 57(2), 371–394.
Fan, J. and Gijbels, I. (1996). Local Polynomial Modelling and Its Applications, Chapman and Hall, London.
Fan, J., Gasser, T., Gijbels, I., Brockmann, M. and Engel, J. (1997). Local polynomial regression: optimal kernels and asymptotic minimax efficiency, Ann. Inst. Statist. Math., 49(1), 79–99.
Greblicky, W. and Pawlak, M. (1987). Necessary and sufficient consistency conditions for a recursive kernel regression estimate, J. Multivariate Anal., 23, 67–76.
Härdle, W. (1990). Applied nonparametric regression, Econometric Society Monographs, No. 19, Cambridge University Press, Cambridge.
Hastie, T. and Loader, C. (1993). Local regression: automatic kernel carpentry, Statist. Sci., 8(2), 120–143.
Krzyzak, A. and Pawlak, M. (1984). Almost everywhere convergence of recursive regression function estimate and classification, IEEE Trans. Inform. Theory, 30, 91–93.
Lejeune, M. (1985). Estimation non-paramétrique par noyaux: régression polynomiale mobile, Re. Statist. Appli., 33, 43–68.
Masry, E. (1996a) Multivariate regression estimation: local polynomial fitting for time series, Stochastic Process. Appl., 65, 81–101.
Masry, E. (1996b) Multivariate local polynomial regression for time series: uniform strong consistency and rates, J. Time Ser. Anal., 17, 571–599.
Masry, E. and Fan, J. (1997). Local polynomial estimation of regression function for mixing processes, Scand. J. Statist., 24, 165–179.
Müller, H. G. (1988). Nonparametric Regression Analysis of Longitudinal Data, Lecture Notes in Statistics, Vol. 46, Springer, Berlin.
Rosenblatt, M. (1956). A central limit theorem and strong mixing condition, Proc. Nat. Acad. Sci., 42, 43–47.
Roussas, G. G. (1992). Exact rates of almost sure convergence of a recursive kernel estimate of a probability density function: application to regression and hazard rate estimation, Nonparametric Statistics, 1, 171–195.
Roussas, G. G. and Tran, L. T. (1992). Asymptotic normality of the recursive kernel regression estimate under dependence conditions, Ann. Statist., 20(1), 98–120.
Ruppert, D. and Wand, P. (1994). Multivariate locally weighted least squares regression, Ann. Statist., 22, 1346–1370.
Selfert, B. and Gasser, T. (1996). Finite sample variance of local polynomials: analysis and solutions, J. Amer. Statist. Assoc., 91, 267–275.
Stone, C. J. (1977). Consistent nonparametric regression, Ann. Statist., 5, 595–620.
Volkonskii, V. A. and Rozanov, Yu. A. (1959). Some limit theorems for random functions, Theory Probab. Appl., 4, 178–197.
Wheeden, R. L. and Zygmund, A. (1977). Measure and Integral, Marcel Dekker, New York.
Author information
Authors and Affiliations
About this article
Cite this article
Vilar-Fernández, J.A., Vilar-Fernández, J.M. Recursive Estimation of Regression Functions by Local Polynomial Fitting. Annals of the Institute of Statistical Mathematics 50, 729–754 (1998). https://doi.org/10.1023/A:1003764914460
Issue Date:
DOI: https://doi.org/10.1023/A:1003764914460