Graded-response neurons and information encodings in autoassociative memories

Alessandro Treves
Phys. Rev. A 42, 2418 – Published 1 August 1990
PDFExport Citation

Abstract

A general mean-field theory is presented for an attractor neural network in which each elementary unit is described by one input and one output real variable, and whose synaptic strengths are determined by a covariance imprinting rule. In the case of threshold-linear units, a single equation is shown to yield the storage capacity for the retrieval of random activity patterns drawn from any given probability distribution. If this distribution produces binary patterns, the storage capacity is essentially the same as for networks of binary units. To explore the effects of storing more structured patterns, the case of a ternary distribution is studied. It is shown that the number of patterns that can be stored can be much higher than in the binary case, whereas the total amount of retrievable information does not exceed the limit obtained with binary patterns.

  • Received 1 March 1990

DOI:https://doi.org/10.1103/PhysRevA.42.2418

©1990 American Physical Society

Authors & Affiliations

Alessandro Treves

  • Department of Experimental Psychology, University of Oxford, Oxford OX1 3UD, England

References (Subscription Required)

Click to Expand
Issue

Vol. 42, Iss. 4 — August 1990

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review A

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×