Abstract
A generalization of the Little–Hopfield neural network model for associative memories is presented that considers the case of a continuum of processing units. The state space corresponds to an infinite dimensional euclidean space. A dynamics is proposed that minimizes an energy functional that is a natural extension of the discrete case. The case in which the synaptic weight operator is defined through the autocorrelation rule (Hebb rule) with orthogonal memories is analyzed. We also consider the case of memories that are not orthogonal. Finally, we discuss the generalization of the non deterministic, finite temperature dynamics.
Similar content being viewed by others
References
Little, W. A.: The existence of persistent states in the brain, Math. Biosci. 19 (1974), 101–120.
Little, W. A.: Analytic study of the memory storage capacity of a neural network, Math. Biosci. 39 (1978), 281–290.
Hebb, D. O.: The Organization of Behavior: A Neuropsychological Theory, New York, Wiley, 1949.
Amit, D. J.: Modeling Brain Function, Cambridge, Cambridge University Press, 1989.
Hopfield, J. J.: Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci. 79 (1982), 2554–2558.
Hopfield, J. J.: Neurons with graded response have collective computational properties like those of two-state neurons, Proc. Natl. Acad. Sci. 81 (1984), 3088–3092.
Feynman, R. P. and Hibbs, A. R.: Quantum Mechanics and Path Integrals, New York, McGraw-Hill, 1965.
Fodor, J. A.: The Modularity of Mind, Cambridge, MIT Press, 1983.
Van Kampen, N. G.: Stochastic Processes in Physics and Chemistry, Amsterdam, Elsevier, 1997.
Hinton, G. E. and Sejnowsky, T. J.: Optimal perceptual inference, In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (Washington, 1983), New York, IEEE, 1983, pp. 448–453.
Peretto, P.: Collective properties of neural networks: A statistical physics approach, Biological Cybernetics 50, 51–62.
Glauber, R. J.: Time dependent statistics of the Ising model, J. of Math. Phys. 4 (1963), 294–307.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Segura, E.C., Perazzo, R.P.J. Associative Memories in Infinite Dimensional Spaces. Neural Processing Letters 12, 129–144 (2000). https://doi.org/10.1023/A:1009689025427
Issue Date:
DOI: https://doi.org/10.1023/A:1009689025427