Abstract
A method of statistical neurodynamics is presented for treating ensembles of nets of randomly connected neuron-like elements. The concept of a macrostate plays a fundamental role in statistical neurodynamics and a criterion is given for ascertaining that given macroscopic quantities together constitute a macrostate. The activity of a nerve net is shown to be a macrostate and the equation of the dynamics of the activity is elucidated for various ensembles of random nerve nets. It is shown that the distance between two microstates can also be treated as a macrostate in a generalized sense. The equation of its dynamics represents how the distance between two states changes in the course of state transitions. The dynamics of distance reveals interesting microscopic properties of random nerve nets, such as the stability of state-transition, the transient lengths, etc.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Allanson,J.T: Some properties of randomly connected neural networks. Proc. 3rd London Symp. on Information Theory, C. Cherry Ed. London: Butterworths 1956
Amari,S.: Characteristics of random threshold-element networks (in Japanese). PGA, Inst. Electron. Commun. Eng. Jap., Paper A 69–55 (1969)
Amari,S.: Characteristics of randomly connected threshold element networks and network systems. Proc. IEEE 59, 35–47 (1971)
Amari,S.: Characteristics of random nets of analog neuron-like elements. IEEE Trans. Systems, Man and Cybernetics SMC-2, 643–657 (1972)
Amari,S.: Unpublished note
Amari,S.: Learning patterns and patterns sequences by self-organizing nets of threshold elements. IEEE Trans. Comput. C21, 1197–1206 (1972)
Annios,P.A.: Cyclic modes in artificial neural nets. Kybernetik 11, 5–14 (1972)
Ashby,W.R., Foerster,F.v., Walker,C.C.: Instability of pulse activity in a net with threshold. Nature (Lond.) 196, 561–562 (1962)
Burattini,E., Liesis,V.: A method of analysis of the models of neural nets. Kybernetik 10, 38–44 (1972)
Cowan,J.D.: A statistical mechanics of nervous activity. Some Mathematical Questions in Biology. Rhode Island: American Mathematical Society 1970
Farley,B.G., Clark,W.A.: Activity in networks of neuron-like elements. Proc. 4th London Symp. on Information Theory, C. Cherry Ed. London: Butterworths 1961
Griffith,J.S.: Mathematical neurobiology. New York-London: Academic Press. 1971
Harmon,L.D., Lewis,E.R.: Neural modeling. Physiol. Rev. 46, 513–591 (1966)
Harth,E.M., Csermely,T.J., Beek,B., Lindsay,R.D.: Brain functions and neural dynamics. J. theor. Biol. 26, 93–120 (1970)
Kac,M.: Probability and related topics in physical sciences. London: Interscience Publ. 1959
Kauffman,S.A.: Metabolic stability and epigenesis in randomly constructed genetic nets. J. theor. Biol. 22, 437–467 (1969)
McCulloch,W.S., Pitts,W.H.: A logical calculus of the ideas immanent in neural nets. Bull. math. Biophys. 5, 115–133 (1943)
Rapoport,A.: Ignition phenomena in random nets. Bull. math. Biophys. 14, 35–44 (1952)
Rotenberg,A.R.: Behavior of homogeneous statistical ensemble of finite automata. Avtomat. Telemekh. 9, 84–92 (1971)
Rozonoer,L.I.: Random logical nets, I, II, III. Avtomat. Telemkh. 5, 137–147; 6, 99–109; 7, 127–136 (1969)
Smith,D.R., Davidson,C.H.: Maintained activity in neural nets. J. Ass. Comput. Mach. 9, 268–278 (1962)
Yoshizawa,S.: Characteristics of random nets consisting of neuron-like elements with refractory period. PGMBE, Inst. Electron. Commun. Eng. Jap., Paper MBE 72-22 (1972)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Amari, Si. A method of statistical neurodynamics. Kybernetik 14, 201–215 (1974). https://doi.org/10.1007/BF00274806
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00274806