Abstract
In this paper the agent-based population learning algorithm designed to train RBF networks (RBFN’s) is proposed. The algorithm is used to network initialization and estimation of its output weights. The approach is based on the assumption that a location of the radial based function centroids can be modified during the training process. It is shown that such a floating centroids may help to find the optimal neural network structure. In the proposed implementation of the agent-based population learning algorithm, RBFN initialization and RBFN training based on the floating centroids are carried-out by a team of agents, which execute various local search procedures and cooperate to find-out a solution to the considered RBFN training problem. Two variants of the approach are suggested in the paper. The approaches are implemented and experimentally evaluated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Asuncion, A., Newman, D.J.: UCI Machine Learning Repository. University of California, School of Information and Computer Science, Irvine, CA (2007), http://www.ics.uci.edu/~mlearn/MLRepository.html
Barbucha, D., Czarnowski, I., Jędrzejowicz, P., Ratajczak-Ropel, E., Wierzbowska, I.: e-JABAT - An Implementation of the Web-Based A-Team. In: Nguyen, N.T., Jain, I.C. (eds.) Intel. Agents in the Evol. of Web & Appl. SCI, vol. 167, pp. 57–86. Springer, Heidelberg (2009)
Billings, S.A., Zheng, G.L.: Radial basis function networks configuration using genetic algorithms. Neural Networks 8(6), 877–890 (1995)
Bishop, C.: Neural Network for Pattern Recognition. Oxford University Press (1995)
Broomhead, D.S., Lowe, D.: Multivariable Functional Interpolation and Adaptive Networks. Complex Systems 2, 321–355 (1988)
Czarnowski, I., Jędrzejowicz, P.: An agent-based approach to ANN training. Knowledge-Based Systems 19, 304–308 (2006)
Czarnowski, I.: Cluster-based Instance Selection for Machine Classification. Knowledge and Information Systems 30(1), 113–133 (2012)
Czarnowski, I., Jędrzejowicz, P.: An Approach to Cluster Initialization for RBF Networks. In: Proceedings of the 16th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems, San Sebastian, Spain (to appear, 2012)
Datasets used for classification: comparison of results. Directory of data sets, http://www.is.umk.pl/projects/datasets.html (accessed September 1, 2009)
Esposito, A., Marinaro, M., Oricchio, D., Scarpetta, S.: Approximation of continuous and discontinuous mappings by a growing neural RBF-based algorithm. Neural Networks 13, 651–665 (2000)
Fasshauer, G.E., Zhang, J.G.: On Choosing “optimal” Shape Parameters for RBF Approximation. Numerical Algorithms 45(1-4), 345–368 (2007)
Gao, H., Feng, B., Hou, Y., Zhu, L.: Training RBF Neural Network with Hybrid Particle Swarm Optimization. In: Wang, J., Yi, Z., Żurada, J.M., Lu, B.-L., Yin, H. (eds.) ISNN 2006. LNCS, vol. 3971, pp. 577–583. Springer, Heidelberg (2006)
Hamo, Y., Markovitch, S.: The COMPSET Algorithm for Subset Selection. In: Proceedings of The Nineteenth International Joint Conference for Artificial Intelligence, Edinburgh, Scotland, pp. 728–733 (2005)
Huang, G.-B., Saratchandra, P., Sundararajan, N.: A Generalized Growing and Pruning RBF(GGAP-RBF) Neural Network for Function Approximation. IEEE Transactions on Neural Networks 16(1), 57–67 (2005)
Krishnaiah, P.R., Kanal, L.N.: Handbook of Statistics 2: Classification, Pattern Recognition and Reduction of Dimensionality. North Holland, Amsterdam (1982)
Lloyd, S.P.: Least Squares Quantization in PCM. IEEE Trans. Inf. Theory 28, 129–137 (1982)
Qasem, S.N., Shamsuddin, S.M.H.: Radial Basis Function Network Based on Multi-Objective Particle Swarm Optimization. In: Proceeding ofthe 6th International Symposium on Mechatronics and its Applications (ISMA 2009), Sharjah, UAE, March 24-26 (2009)
Ros, F., Pintore, M., Chretien, J.: Automatic design of growing radial basis function neural networks based on neighbourhood concepts. Chemometrics and Intelligence Laboratory Systems 87, 231–240 (2007)
Talukdar, S., Baerentzen, L., Gove, A., de Souza, P.: Asynchronous Teams: Co-operation Schemes for Autonomous, Computer-Based Agents. Technical Report EDRC 18-59-96, Carnegie Mellon University, Pittsburgh (1996)
Wang, L., Yang, B., Chen, Y., Abraham, A., Sun, H., Chen, Z., Wang, H.: Improvement of Neural Network Classifier Using Floating Centroids. Knowledge Information Systems 31, 433–454 (2012)
Wang, Z., Zhu, T.: An Efficient Learning Algorithm for Improving Generalization Performance of Radial Basis Function Neural Networks. Neural Networks 13, 545–553 (2000)
Wei, L.Y., Sundararajan, N., Saratchandran, P.: Performance Evaluation of a Sequential Minimal Radial Basis Function (RBF) Neural Network Learning Algorithm. IEEE Trans. Neural Networks 9, 308–318 (1998)
Shang, Y., Wah, B.W.: A global optimization method for neural network training. In: Conference of Neural Networks, vol. 29, pp. 45–54. IEEE Computer (1996)
Zhang, D., Tian, Y., Zhang, P.: Kernel-based Nonparametric Regression Method. In: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, pp. 410–413 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Czarnowski, I., Jędrzejowicz, P. (2012). Agent-Based Approach to RBF Network Training with Floating Centroids. In: Nguyen, NT., Hoang, K., Jȩdrzejowicz, P. (eds) Computational Collective Intelligence. Technologies and Applications. ICCCI 2012. Lecture Notes in Computer Science(), vol 7654. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34707-8_46
Download citation
DOI: https://doi.org/10.1007/978-3-642-34707-8_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34706-1
Online ISBN: 978-3-642-34707-8
eBook Packages: Computer ScienceComputer Science (R0)