Skip to main content
Log in

A Dynamic Mixture Model for Unsupervised Tail Estimation without Threshold Selection

  • Published:
Extremes Aims and scope Submit manuscript

Abstract

Exceedances over high thresholds are often modeled by fitting a generalized Pareto distribution (GPD) on R+. It is difficult to select the threshold, above which the GPD assumption is enough solid and enough data is available for inference. We suggest a new dynamically weighted mixture model, where one term of the mixture is the GPD, and the other is a light-tailed density distribution. The weight function varies on R+ in such a way that for large values the GPD component is predominant and thus takes the role of threshold selection. The full data set is used for inference on the parameters present in the two component distributions and in the weight function. Maximum likelihood provides estimates with approximate standard deviations. Our approach has been successfully applied to simulated data and to the (previously studied) Danish fire loss data set. We compare the new dynamic mixture method to Dupuis' robust thresholding approach in peaks-over-threshold inference. We discuss robustness with respect to the choice of the light-tailed component and the form of the weight function. We present encouraging simulation results that indicate that the new approach can be useful in unsupervised tail estimation, especially in heavy tailed situations and for small percentiles.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Balkema, A.A. and de Haan, L., “Residual life time at great age,” Annals of Probability 2, 792–804, (1974).

    Google Scholar 

  • Crovella, M. and Taqqu, M., “Estimating the heavy tail index from scaling properties,” Methodology and Computing in Applied Probability 1, 55–79, (1999).

    Google Scholar 

  • Davison, A.C. and Smith, R.L., “Models for exceedances over high thresholds (with discussion),” Journal of the Royal Statistical Society, Series B 5(3), 393–442, (1990).

    Google Scholar 

  • Dupuis, D.J., “Exceedances over high thresholds: A guide to threshold selection,” Extremes 1(3), 251–261, (1999).

    Google Scholar 

  • Embrechts, P., Klüppelberg, C., and Mikosch, T., Modelling Extremal Events, number 33 in Applications of Mathematics: Stochastic Modelling and Applied Probability, Springer Verlag, Heidelberg, 1997.

    Google Scholar 

  • Feuerverger, A. and Hall, P., “Estimating a tail exponent by modelling departure from a Pareto distribution,” The Annals of Statistics 27(2), 760–781, (1999).

    Google Scholar 

  • Gilks, W.R., Richardson, S., and Spiegelhalter, D.J., Markov Chain Monte Carlo in Practice, Chapman & Hall, London, 1996.

    Google Scholar 

  • McNeil, A.J., Estimating the tails of loss severity distributions using extreme value theory, Technical report, Department Mathematik, ETH Zentrum, Zürich.

  • Meng, X.L. and van Dyk, D., “The em algorithm—an old folk-song sung to a fast new tune (with discussion),” Journal of the Royal Statistical Society, Series B 59(3), 511–567, (1997).

    Google Scholar 

  • Pickands, J. “Statistical inference using extreme order statistics,” The Annals of Statistics 3, 119–131, (1975).

    Google Scholar 

  • Resnick, S.I., “Heavy tail modeling and teletraffic data,” The Annals of Statistics 25(5), 1805–1869, (1997).

    Google Scholar 

  • Robert, C.P. and Casella, G., Monte Carlo Statistical Methods, Springer-Verlag, New York, 1999.

    Google Scholar 

  • Rootzen, H. and Tajvidi, N., “Extreme value statistics and wind storm losses: A case study,” Scandinavian Actuarial Journal 1, 70–94, (1997).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Frigessi, A., Haug, O. & Rue, H. A Dynamic Mixture Model for Unsupervised Tail Estimation without Threshold Selection. Extremes 5, 219–235 (2002). https://doi.org/10.1023/A:1024072610684

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1024072610684

Navigation