Journal of Physics A. Mathematical and General vol:33 issue:14 pages:2597-2609
The inclusion of a threshold in the dynamics of layered neural networks with variable activity is studied at arbitrary temperature. In particular, the effects on the retrieval quality of a self-controlled threshold obtained by forcing the neural activity to stay equal to the activity of the stored patterns during the whole retrieval process, are compared with those of a threshold chosen externally for every loading and every temperature through optimization of the mutual information content of the network. Numerical results, mostly concerning low-activity networks are discussed.