Abstract
Radial Basis Function Neural Networks (RBFNs) are nowadays quite popular due to their ability to discover and approximate complex nonlinear dependencies within the data under analysis. Performance of the RBF network depends on numerous factors related to its initialization and training. The paper proposes an approach to the radial basis function networks design, where initial parameters of the network, output weights and parameters of the transfer function are set using the proposed agent-based population learning algorithm (PLA). The algorithm is validated experimentally. Advantages and main features of the PLA-based RBF designs are discussed basing on results of the computational experiment.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Asuncion, A. and Newman, D.J., “UCI Machine Learning Repository,” Irvine, CA: University of California, School of Information and Computer Science, http://www.ics.uci.edu/mlearn/MLRepository.html. 2007, Accessed 24 June 2009.
Barbucha, D., Czarnowski, I., Jȩdrzejowicz, P., Ratajczak-Ropel, E., Wierzbowska, I., “e-JABAT - An Implementation of the Web-Based A-Team,” Intelligent Agents in the Evolution of Web and Applications (N.T. Nguyen and I.C. Jain, eds.), Studies in Computational Intelligence, 167, pp. 57–86, Springer Berlin/Heidelberg, 2009.
Barbucha, D., Czarnowski, I., Jȩdrzejowicz, P., Ratajczak-Ropel, E., Wierzbowska, I., “Influence of the Working Strategy on A-Team Performance,” in Smart Information and Knowledge Management (Szczerbicki, E., Nguyen, N.T., eds.), Studies in Computational Intelligence, 260, Springer-Verlag Berlin Heidelberg, pp. 83–102, 2010.
Broomhead, D. S., Lowe D., “Multivariable Functional Interpolation and Adaptive Networks,” Complex Systems, 2, pp. 321–355, 2007.
Chen, S., Hong, X., Harris, C. J., “Particle Swarm Optimization Aided Orthogonal Forwarded Regression for Unified Data Modeling,” IEEE Transactions on Evolutionary Computation, 14, 4, pp. 477–499, 2012.
Czarnowski, I., Jȩdrzejowicz, P., “An agent-based approach to ANN training,” Knowledge-Based Systems, 19, pp. 304–308, 2006.
Czarnowski, I., Jȩdrzejowicz, P., “Selecting a Representative Data Set of the Required Size Using the Agent-Based Population Learning Algorithm,” Cybernetics and Systems, 43, 4, pp. 303–318, 2012.
Czarnowski, I. and Jȩdrzejowicz, P., “Agent-based Approach to RBF Network Training with Floating Centroids,” in ICCCI 2012 LNAI 7653 (Nguyen, N. T., Kiem, H., Jȩdrzejowicz, P., eds.), Springer-Verlag Berlin Heidelberg, 2012.
Czarnowski, I., “Cluster-based Instance Selection for Machine Classification,” Knowledge and Information Systems, 30, 1, pp. 113–133, 2012.
Czarnowski, I., Jȩdrzejowicz, P., “An Approach to Cluster Initialization for RBF Networks,” in Advances in Knowledge-Based and Intelligent Information and Engineering Systems, Frontiers in Artificial Intelligence and Applications (Grana, M., Toro., C., Posada, J., Howlett, R., Jain, L.C. eds.), 243, IOS Press, pp. 1151–1160, 2012.
Czarnowski, I., Jȩdrzejowicz, P., “Agent-Based Approach to the Design of RBF Networks,” Cybernetics and Systems, 44, 2-3, pp. 155–172, 2013.
Czarnowski, I., Jȩdrzejowicz, P., “Agent-Based Population Learning Algorithm for RBF Network Tuning,” in Artificial Intelligence and Soft Computing, LNAI Part I. LNAI 7894 (Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L. A., Zurada, J. M. eds.), Springer-Verlag Berlin Heidelberg, pp. 41–51, 2013.
“Datasets used for classification: comparison of results,” in Directory of Data Sets, http://www.is.umk.pl/projects/datasets.html. Accessed 1 Sep 2009.
Deng, J., Li, K., Irwin, G.W., “Locally regularized two-stage learning algorithm for RBF network centre selection,” International Journal of System Science, 43, 6, pp. 1157–1170, 2012.
Duch, W., Jankowski, N., “Transfer Functions: Hidden Possibilities for Better Neural Networks,” in Proc. of the 9th European Symposium on Artificial Neural Networks (ESANN), Brugge, pp. 81–94, 2011.
Fasshauer, G. E., Zhang, J. G., “On Choosing “Optimal” Shape Parameters for RBF Approximation,” Numerical Algorithms, 45, 1-4, pp. 345–368, 2007.
Gao, H., Feng, B., Zhu, L., “Training RBF Neural Network with Hybrid Particle Swarm Optimization” in ISNN 2006, LNCS 3971 (Weng, J. et al. eds.), Springer-Verlag Berlin Heidelberg, pp. 577–583, 2006.
Garca, S., Molina, D., Lozano, M., Herrera, F., “A Study on the Use of Non-Parametric Tests for Analyzing the Evolutionary Algorithms’ Behaviour: A Case Study on the CEC’ 2005 Special Session on Real Parameter Optimization,” Journal of Heuristics, 15, pp. 617–644, 2009.
Hanrahan, G., Artificial Neural Networks in Biological and Environmental Analysis, Analytical Chemistry Series, CRC Press, Taylor & Francis Group, 2011.
Hoffmann, G. A., “Adaptive Transfer Functions in Radial Basis Function (RBF) Networks,” in ICCS 2004, LNCS 3037 (Bubak, M. et al. eds.), Springer-Verlag Heidelberg, pp. 682–686, 2004.
Huang, G-B., Saratchandra, P., Sundararajan, N., “A Generalized Growing and Pruning RBF (GGAP-RBF) Neural Network for Function Approximation,” IEEE Transactions on Neural Networks, 16, 1, pp. 57–67, 2005.
Jȩdrzejowicz, P., “Social learning algorithm as a tool for solving some difficult scheduling problems,” Foundation of Computing and Decision Sciences, 24, pp. 51–66, 1999.
Jȩdrzejowicz, J., Jȩdrzejowicz, P., “Cellular GEP-Induced Classifiers,” in ICCCI 2010, Part I, LNAI 6421 (Pan J.-S., Chen S.-M. and Nguyen, N. T. eds.), Springer-Verlag Berlin Heidelberg, pp. 343–352, 2004.
Krishnaiah, P. R., Kanal, L. N., Handbook of Statistics 2: Classification, Pattern Recognition and Reduction of Dimensionality, North Holland, Amsterdam, 1982.
Król, D., Nguyen, N.T., “Special Issue on Knowledge Integration and Management in Autonomous Systems,” Journal of Intelligent and Fuzzy Systems, 21, 3, pp. 163–164, 2010.
Kuncheva, L., “Initializing of an RBF Network by a Genetic Algorithm,” Neurocomputing, 14, 3, pp. 273–288, 1997.
Liang, N-Y., Huang, G-B., Saratchandran, P., Sundararajan, N., “A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks,” IEEE Transactions on Neural Networks, 17, 6, pp. 1411–1423, 2006.
Michalewicz, Z., Genetic Algorithms + Data Structures = Evolution Programs, Springer, Berlin, 1996.
Qasem, S. N., Shamsuddin, S. M. H., “Radial Basis Function Network Based on Multi-Objective Particle Swarm Optimization,” in Proc. of the 6th International Symposium on Mechatronics and its Applications (ISMA09), Sharjah, UAE, March 24-26, 2009.
Ros, F., Pintore, M., Chretie, J. R., “Automatic Design of Growing Radial Basis Function Neural Networks Based on Neighborhood Concepts,” Chemometric-sand Intelligent Laboratory Systems, 87, pp. 231–240, 2007.
Sanchez, A.V.D., “Searching for a solution to the automatic RBF network design problem,” Neurocomputing, 42, 1-4, pp. 147–170, 2002.
“The European Network of Excellence on Intelligence Technologies for Smart Adaptive Systems (EUNITE)” - EUNITE World Competition in domain of Intelligent Technologies - http://neuron.tuke.sk/competition2 (accessed on 1 September 2002).
Wang, L., Yang, B., Chen, Y., Abraham, A., Sun, H., Chen, Z., Wang, H., “Improvement of Neural Network Classifier Using Floating Centroids,” Knowledge Information Systems, 31, pp. 433–454, 2012.
Wang, H-Q., Huang, D-S., “Non-linear Cancer Classification Using a Modified Radial Basis Function Classification Algorithm,” Journal of Biomedical Science, 12, 5, pp. 819–826, 2005.
Wei, L.Y., Sundararajan, N., Saratchandran, P., “Performance Evaluation of a Sequential Minimal Radial Basis Function (RBF) Neural Network Learning Algorithm,” IEEE Transactions on Neural Networks, 9, pp. 308–318, 1998.
Wilson, D.R., Martinez, T.R., “Reduction Techniques for Instance-based Learning Algorithm,” Machine Learning, 33, 3, pp. 257–286, 1998.
Talukdar, S., Baeretzen, L., Gove, A., de Souza, P., “Asynchronous teams: Cooperation schemes for autonomous agents,” Journal of Heuristics, 4, pp. 295–321, 1998.
Shang, Y. and Wah, B.W., “A Global Optimization Method for Neural Network Training,” in Proc. of the Conference of Neural Networks, 29, IEEE Computer, pp. 45–54, 1996.
Yonaba, H., Anctil, F., Fortin, V., “Comparing Sigmoid Transfer Functions for Neural Network Multistep Ahead Streamflow Forecasting,” Journal of Hydrologic Engineering, 15, 4, pp. 275–283, 2010.
Zhang, D., Tian, Y., Zhang, P., “Kernel-based Nonparametric Regression Method,” in Proc. of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, pp. 410–413, 2008.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Czarnowski, I., Jȩdrzejowicz, P. Designing RBF Networks Using the Agent-Based Population Learning Algorithm. New Gener. Comput. 32, 331–351 (2014). https://doi.org/10.1007/s00354-014-0408-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00354-014-0408-3