Abstract
In the past two decades, model averaging, as a way to solve model uncertainty, has attracted more and more attention. In this paper, the authors propose a jackknife model averaging (JMA) method for the quantile single-index coefficient model, which is widely used in statistics. Under model misspecification, the model averaging estimator is proved to be asymptotically optimal in terms of minimizing out-of-sample quantile loss. Simulation experiments are conducted to compare the JMA method with several model selections and model averaging methods, and the results show that the proposed method has a satisfactory performance. The method is also applied to a real dataset.
Similar content being viewed by others
References
Huang Z S, Zhou Z G, Jiang R, et al., Empirical likelihood for semiparametric varying-coefficient partially linear models with error-prone linear covariates, Statistics and Probability Letters, 2010, 80: 497–504.
Tang Y, Wang H, and Zhu Z, Variable selection in quantile varying coefficient models with longitudinal data, Computational Statistics and Data Analysis, 2013, 57: 435–449.
Huang Z S, Pang Z, Lin B Q, et al., Model structure selection in single-index-coefficient regression models, Journal of Multivariate Analysis, 2014, 125: 159–175.
Lü Y Z, Zhang R Q, Zhao W H, et al., Quantile regression and variable selection of partial linear single-index model, Annals of the Institute of Statistical Mathematics, 2015, 67: 375–409.
Jiang R and Qian W M, Quantile regression for single-index-coefficient regression models, Statistics and Probability Letters, 2016, 110: 305–317.
Xia Y and Li W K, On single-index coefficient regression models, Journal of the American Statistical Association, 1999, 94: 1275–1285.
Zhao W H, Lian H, and Liang H, Quantile regression for the single-index coefficient model, Bernoulli, 2017, 23(3): 1997–2027.
Koenker R and Bassett G S, Regression quantiles, Econometrica, 1978, 46: 33–50.
Koenker R, Quantile Regression, Cambridge University Press, Cambridge, 2005.
Cai Z and Xiao Z, Semiparametric quantile regression estimation in dynamic models with partially varying coefficients, Journal of Econometrics, 2012, 167: 413–425.
Wu T Z, Yu K, and Yu Y, Single-index quantile regression, Journal of Multivariate Analysis, 2010, 101: 1607–1621.
Hu Y, Gramacy R B, and Lian H, Bayesian quantile regression for single-index models, Statistics and Computing, 2013, 23: 437–454.
Akaike H, A new look at the statistical model identification, IEEE Transactions on Automatic Control, 1974, 19: 716–723.
Schwarz G E, Estimating the dimension of a model, The Annals of Statistics, 1978, 6: 461–464.
Mallows C L, Some comments on Cp, Technometrics, 1973, 15: 661–675.
Raftery A, Madigan D, and Hoeting J, Bayesian model averaging for linear regression models, Journal of the American Statistical Association, 1997, 92: 179–191.
Hoeting J A, Madigan D, Raftery A E, et al., Bayesian model averaging: A tutorial, Statistical Science, 1999, 14: 382–417.
Liu Y, Zou J, Zhao S, et al., Model averaging estimation for varying-coefficient single-index models, Journal of Systems Science & Complexity, 2022, 35(1): 264–282.
Liang H, Zou G, Wan A T K, et al., Optimal weight choice for frequentist model average estimators, Journal of the American Statistical Association, 2011, 106: 1053–1066.
Buckland S T, Burnham K P, and Augustin N H, Model selection, an integral part of inference, Biometrics, 1997, 53: 603–618.
Hansen B E, Least squares model averaging, Econometrica, 2007, 75: 1175–1189.
Hansen B E and Racine J, Jackknife model averaging, Journal of Econometrics, 2012, 167: 38–46.
Lu X and Su L, Jackknife model averaging for quantile regressions, Journal of Econometrics, 2015, 188: 40–58.
Fan J, Hu T C, and Truong Y K, Robust nonparametric function estimation, Scandinavian Journal of Statistics, 1994, 21: 433–446.
Cho H and Fryzlewicz P, High dimensional variable selection via tilting, Journal of the Royal Statistical Society Series B, 2012, 74: 593–622.
Knight K, Limiting distributions for L1 regression estimators under general conditions, The Annals of Statistics, 1998, 26: 755–770.
Pollard D, Asymptotics for least absolute deviation regression estimators, Econometric Theory, 1991, 7: 186–199.
Shibata R, An optimal selection of regression variables, Biometrika, 1981, 68: 45–54.
Li K C, Asymptotic optimality for Cp, CL, cross-validation and generalized cross-validation: Discrete index set, The Annals of Statistics, 1987, 15: 958–975.
Van der Vaart A and Wellner J A, Weak Convergence and Empirical Processes: With Applications to Statistics, Springer, New York, 1996.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
The authors declare no conflict of interest.
Additional information
This research was supported by the National Natural Science Foundation of China under Grant Nos. U23A2064 and 12031005.
This paper was recommended for publication by Editor LI Qizhai.
Rights and permissions
About this article
Cite this article
Sun, X., Zhang, L. Jackknife Model Averaging for Quantile Single-Index Coefficient Model. J Syst Sci Complex 37, 1685–1713 (2024). https://doi.org/10.1007/s11424-024-3111-6
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-024-3111-6