Title: Nonlinear hebbian training of the perceptron
Authors: Bollé, Désiré ×
Shim, Gyoung Moo #
Issue Date: Nov-1995
Publisher: Informa Healthcare
Series Title: Network: Computation in Neural vol:6 issue:4 pages:619-633
Abstract: The effects of nonlinear modulation of the Hebbian learning rule on the performance of a perceptron are investigated. Both random classification and classification provided by a teacher perceptron are considered. It is seen that both the generalization and learning rate depend on the overlap between the teacher and the student and the signal-to-noise ratio in the local field. Furthermore, they are independent of the specific teacher distribution when the ratio between the number of training examples and the perceptron size is small. An analytic expression is obtained for the optimal modulation function for different classification schemes. For random and Gaussian teacher classifications the best choice for modulation appears to be linear. For binary teachers it is shown to be the hyperbolic tangent. The modifications on the latter from diluting the binary teacher are also obtained in analytic form.
ISSN: 0954-898X
Publication status: published
KU Leuven publication type: IT
Appears in Collections:Theoretical Physics Section
× corresponding author
# (joint) last author

Files in This Item:

There are no files associated with this item.

Request a copy


All items in Lirias are protected by copyright, with all rights reserved.

© Web of science