2134/5795 Jonathon Chambers Jonathon Chambers Warren Sherliker Warren Sherliker Danilo P. Mandic Danilo P. Mandic A normalized gradient algorithm for an adaptive recurrent perceptron Loughborough University 2010 untagged Mechanical Engineering not elsewhere classified 2010-01-15 10:02:33 Conference contribution https://repository.lboro.ac.uk/articles/conference_contribution/A_normalized_gradient_algorithm_for_an_adaptive_recurrent_perceptron/9556613 A normalized algorithm for on-line adaptation of a recurrent perceptron is derived. The algorithm builds upon the normalized backpropagation (NBP) algorithm for feedforward neural networks, and provides an adaptive learning rate and normalization for a recurrent perceptron learning algorithm. The algorithm is based upon local linearization about the current point in the state-space of the network. Such a learning rate is normalized by the squared norm of the gradient at the neuron, which extends the notion of normalized linear algorithms to the nonlinear case