2134/5795
Jonathon Chambers
Jonathon
Chambers
Warren Sherliker
Warren
Sherliker
Danilo P. Mandic
Danilo P.
Mandic
A normalized gradient algorithm for an adaptive recurrent perceptron
Loughborough University
2010
untagged
Mechanical Engineering not elsewhere classified
2010-01-15 10:02:33
Conference contribution
https://repository.lboro.ac.uk/articles/conference_contribution/A_normalized_gradient_algorithm_for_an_adaptive_recurrent_perceptron/9556613
A normalized algorithm for on-line adaptation of a recurrent perceptron is derived. The algorithm builds upon the normalized backpropagation (NBP) algorithm for feedforward neural networks, and provides an adaptive learning rate and normalization for a recurrent perceptron learning algorithm. The algorithm is based upon local linearization about the current point in the state-space of the network. Such a learning rate is normalized by the squared norm of the gradient at the neuron, which extends the notion of normalized linear algorithms to the nonlinear case