Title: Mutual information of sparsely coded associative memory with self-control and ternary neurons
Authors: Bollé, Désiré
Dominguez, DRC
Amari, S #
Issue Date: May-2000
Publisher: Pergamon-elsevier science ltd
Series Title: Neural networks vol:13 issue:4-5 pages:455-462
Abstract: The influence of a macroscopic time-dependent threshold on the retrieval dynamics of attractor associative memory models with ternary neurons {-1,0,+1} is examined. If the threshold is chosen appropriately as a function of the cross-talk noise and of the activity of the memorized patterns in the model, adapting itself in the course of the time evolution, it guarantees an autonomous functioning of the model. Especially in the limit of sparse coding, it is found that this self-control mechanism considerably improves the quality of the fixed-point retrieval dynamics, in particular the storage capacity, the basins of attraction and the information content. The mutual information is shown to be the relevant parameter to study the retrieval quality of such sparsely coded models. Numerical results confirm these observations. (C) 2000 Elsevier Science Ltd. All rights reserved.
ISSN: 0893-6080
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Theoretical Physics Section
# (joint) last author

Files in This Item:

There are no files associated with this item.

Request a copy


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science