Abstract
We discuss a number of resampling schemes in which m = o(n) observations are resampled. We review nonparametric bootstrap failure and give results old and new on how the m out of n with replacement and without replacement bootstraps work. We extend work of Bickel and Yahav (1988) to show that m out of n bootstraps can be made second order correct, if the usual nonparametric bootstrap is correct and study how these extrapolation techniques work when the nonparametric bootstrap does not.
Chapter PDF
Similar content being viewed by others
Key words and phrases
References
Athreya, K. B. (1987). Bootstrap of the mean in the infinite variance case. Ann. Statist. 15, 724-731.
Athreya, K. B. and Fukuchi, J. (1994). Bootstrapping extremes of LI.D. random variables. Proceedings of Conference on Extreme Value Theory (NIST). 296
30 P. J. BICKEL, F. GOTZE AND W. R. VAN ZWET
Babu, G. J. and Singh, K. (1985). Edgeworth expansions for sampling without replacement from finite populations. J. Multivariate Anal. 17, 261-278.
Bentkus, V., Gi:itze, F. and van Zwet, W. R. (1994). An Edgeworth expansion for symmetric statistics. Tech Report Univ. of Bielefeld.
Beran, R. (1982). Estimated sampling distributions: The bootstrap and competitors. Ann. Statist. 10, 212-225.
Beran, R. and Srivastava, M. S. (1985). Bootstrap tests and confidence regions for functions of a covariance matrix. Ann. Statist. 13, 95-115.
Bertail, P. (1994). Second order properties of an extrapolated bootstrap without replacement. Submitted to Bernoulli.
Bhattacharya, R. and Ghosh, J. K. (1978). On the validity of the formal Edgeworth expansion. Ann. Statist. 6, 434-451.
Bickel, P. J. and Freedman, D. A. (1981). Some asymptotic t heory for the bootstrap. Ann. Statist. 9, 1196-1217.
Bickel, P. J. and Ren, J. J. (1995). The m out of n bootstrap and goodness of fit tests with double censored data. Robust Statistics, Data Analysis and Computer Intensive Methods Ed. H. Rieder Lecture Notes in Statistics, Springer-Verlag.
Bickel, P. J., Klaassen, C. K., Ritov, Y. and Wellner, J. (1993). Efficient and Adaptive Estimation in Semiparametric Models. Johns Hopkins University Press, Baltimore.
Bickel, P. J. and Yahav, J. A. (1988). Richardson extrapolation and the bootstrap. J. Amer. Statist. Assoc. 83, 387-393.
Blom, G. (1976). Some properties of incomplete U statistics. Biometrika 63, 573-580.
Bretagnolle, J. (1981). Lois limites du bootstrap de certaines fonctionelles. Ann. Inst. H. Poincare, Ser.B 19, 281-296.
David, H. A. (1981). Order Statistics. 2nd edition, John Wiley, New York.
Deheuvels, P., Mason, D. and Shorack, G. (1993). Some results on the influence of extremes on the bootstrap. Ann. Inst. H. Poincare 29, 83-103.
DeCiccio T. J. and Romano, J. P. (1989). The automatic percentile method: Accurate confidence limits in parametric models, Canad. J. Statist. 17, 155-169.
Diimbgen, L. (1993). On nondifferentiable functions and the bootstrap. Probab. Theory Related Fields 95, 125-140.
Efron, B. (1979). Bootstrap methods: another look at the jackknife. Ann. Statist. 7, 1-26.
Efron, B. and Tibshirani, R. J. (1993). An Introduction to the Bootstrap. Chapman & Hall, London, New York.
Feller W. (1968). Probability Theory vl. John Wiley, New York.
Freedman D. A. (1981). Bootstrapping regression models. Ann. Statist. 9, 1218-1228. Gine. E. and Zinn, J. (1989). Necessary conditions for the bootstrap of the mean. Ann. Statist. 17, 684-691.
Gi:itze, F. (1993). Bulletin I. M. S.
Hall, P. (1992). The Bootstrap and Edgewor-th Expansion. Springer Verlag, New York.
Hall, P. and Wilson, S. (1991). Two guidelines for bootstrap hypothesis testing. Biometrics 47, 757-762.
Hall, P. and Jing B. Y. (1993). Performance of boostrap for heavy tailed distributions. Tech. Report A. N. U. Canberra.
Hinkley, D. V. (1988). Bootstrap methods (with discussion). J. Roy. Statist. Soc. Ser.B 50, 321-337.
Mammen, E. (1992). When does bootstrap work? Springer Verlag, New York.
Politis, D. N. and Romano, J. P. (1994). A general theory for large sample confidence regions based on subsamples under minimal assumptions. Ann. Statist. 22, 2031-2050. 297
Praestgaard, J. and Wellner, J. (1993). Exchangeably weighted bootstraps of the general empirical process. Ann. Probab. 21, 2053-2086.
Putter, H. and van Zwet, W. R. (1993). Consistency of plug in estimators with applications to the bootstrap. Submitted to Ann. Statist.
Robinson, J. (1978). An asymptotic expansion for samples from a finite population. Ann. Stat·ist. 6, 1005-1011.
Shen, X. and Wong, W. (1994). Convergence rates of sieve estimates. Ann. Statist. 22, 580-615.
Singh, K. (1981). On the asymptotic accuracy of Efron's bootstrap. Ann. Statist. 9, 1187-1195.
Wu, C. F. J. (1990). On the asymptotic properties of the jackknife histogram. Ann. Statist. 18, 1438-1452.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
This chapter is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
Copyright information
© 2012 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Bickel, P.J., Götze, F., van Zwet, W.R. (2012). Resampling Fewer Than n Observations: Gains, Losses, and Remedies for Losses. In: van de Geer, S., Wegkamp, M. (eds) Selected Works of Willem van Zwet. Selected Works in Probability and Statistics. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1314-1_17
Download citation
DOI: https://doi.org/10.1007/978-1-4614-1314-1_17
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-1313-4
Online ISBN: 978-1-4614-1314-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)