Skip to main content

Advertisement

Log in

A Markov analysis of social learning and adaptation

  • Regular Article
  • Published:
Journal of Evolutionary Economics Aims and scope Submit manuscript

Abstract

A number of recent contributions to the literature have modelled social learning and adaptation in an economic context. Understanding the processes driving these models is important in order to explain and predict the behaviour of the economy. In this paper, we analyze the economic applications for a class of adaptive learning models with bounded rational agents. The dynamics of these economies can be thought of as arising from discrete-time Markov chains. In particular, conditions for uniqueness of equilibria, convergence and stability in the economic systems follow from the accessibility and communication structures of these Markov chains. We establish a correspondence between absorbing states of the Markov chains and economic equilibria, whether stable or unstable, and develop theorems giving conditions for absorption and recurrence. Furthermore, we develop practical applications of these theorems using a cobweb model. We use a genetic algorithm, operating under election, as an example of a well known adaptive learning process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Arifovic J (1991) Learning by Genetic Algorithms in Economic Environments. PhD thesis, University of Chicago

  • Arifovic J (1994) Genetic algorithm learning and the cobweb model. J Econ Dyn Control 18:3–28

    Article  Google Scholar 

  • Arifovic J (2000) Evolutionary algorithms in macroeconomic models. Macroecon Dyn 4(3):373–414

    Article  Google Scholar 

  • Chiarella C (1990) The elements of a nonlinear theory of economic dynamics, volume 343 of Lecture notes in economics and mathematical systems. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Dawid H (1994) A Markov chain analysis of genetic algorithms with a state dependent fitness function. Complex Syst 8:407–417

    Google Scholar 

  • Dawid H (1999) Adaptive learning by genetic algorithms. Analytical results and applications to economic models. 2nd edn. Springer, Berlin, Heidelberg, New York

    Google Scholar 

  • Dawid H, Hornik K (1996) The dynamics of genetic algorithms in interactive environments. J Netw Comput Appl 19:5–19

    Article  Google Scholar 

  • Dawid H, Kopel M (1998) On economic application of the genetic algorithm: a model of the cobweb type. J Evol Econ 8:297–315

    Article  Google Scholar 

  • Ezekiel M (1938) The cobweb theorem. Q J Econ, 52:255–280

    Article  Google Scholar 

  • Goffe WL, Ferrier GD, Rogers J (1994) Global optimization of statistical functions with simulated annealing. J Econom 60:5–99

    Article  Google Scholar 

  • Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison–Wesley, Reading, Massachusetts

    Google Scholar 

  • Grimmett GR, Stirzaker DR (1992) Probability and random processes. 2nd edn. Oxford University Press, New York

    Google Scholar 

  • Kemeny JG, Snell JL (1976) Finite Markov Chains. Undergraduate texts in mathematics. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Leontief WW (1934) Verzögerte angebotsanpassing und partielles gleichgewicht. Z. Nationalökon 5:670–676

    Article  Google Scholar 

  • Nix AE, Vose MD (1992) Modeling genetic algorithms with Markov chains. Ann Math Artif Intell 5:79–88

    Article  Google Scholar 

  • Rudolph G (1994) Convergence analysis of canonical genetic algorithms. IEEE Trans Neural Netw 5(1):96–101

    Article  Google Scholar 

  • Selton R (1998) Aspiration adaptation theory. J Math Psychol 42:191–214

    Article  PubMed  Google Scholar 

  • Simon HA (1955) A behavioral model of rational choice. Q J Econ 69(1):99–118

    Article  Google Scholar 

  • Vose MD, Liepins GE (1991) Punctuated equilibria in genetic search. Complex Syst 5:31–44

    Google Scholar 

  • Wellford CP (1989) A laboratory analysis of price dynamics and expectations in the cobweb model. Discussion paper no 89-15. Tuscon, University of Arizona

  • Wheeler S (2002) Mathematical Foundations for the use of Genetic Algorithms in Economic Models. PhD thesis, University of Adelaide, Adelaide, Australia

Download references

Comments made by an anonymous referee are gratefully acknowledged. Research contributing to this paper was conducted under an Australian Postgraduate Award.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Scott Wheeler.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wheeler, S., Bean, N., Gaffney, J. et al. A Markov analysis of social learning and adaptation. J Evol Econ 16, 299–319 (2006). https://doi.org/10.1007/s00191-006-0017-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00191-006-0017-5

Keywords

JEL

Navigation