RESEARCH COMMONS
LIBRARY

Second Order Training Algorithms For Radial Basis Function Neural Networks

ResearchCommons/Manakin Repository

Second Order Training Algorithms For Radial Basis Function Neural Networks

Show full item record

Title: Second Order Training Algorithms For Radial Basis Function Neural Networks
Author: Tyagi, Kanishka
Abstract: A systematic two step batch approach for constructing and training of Radial basis function (RBF) neural networks is presented. Unlike other RBF learning algorithms, the proposed paradigm uses <italic>optimal learning factors </italic> (OLF's) to train the network parameters, i.e. spread parameters, mean vector parameters and weighted distance measure (DM) coefficients. Newton's algorithm is proposed for obtaining <italic>multiple optimal learning factors </italic> (MOLF) for the network parameters. The weights connected to the output layer are trained by a supervised-learning algorithm based on <italic>orthogonal least squares</italic> (OLS). The error obtained is then back-propagated to tune the RBF parameters. The proposed hybrid training algorithm has been compared with the Levenberg Marquardt and recursive least square based RLS-RBF training algorithms. Simulation results show that regardless of the input data dimension, the proposed algorithms are a significant improvement in terms of convergence speed, network size and generalization over conventional RBF training algorithms which use a <italic>single optimal learning factor</italic> (SOLF). Analyses of the proposed training algorithms on noisy input data have also been carried out. The ability of the proposed algorithm is further substantiated by using k-fold cross validation. Initialization of network parameters using Self Organizing Map (SOM), efficient calculation of Hessian matrix for network parameters, Newton's method for optimization, optimal learning factors and orthogonal least squares are the subject matter of present work
URI: http://hdl.handle.net/10106/9619
Date: 2012-04-11

Files in this item

Files Size Format View
Tyagi_uta_2502M_11435.pdf 11.01Mb PDF View/Open

This item appears in the following Collection(s)

Show full item record

Browse

My Account

Statistics

About Us