Abstract
Generating stable yet performant spiking neural reservoirs for classification applications is still an open issue. This is due to the extremely non-linear dynamics of recurrent spiking neural networks. In this perspective, a local and unsupervised learning rule that tunes the reservoir toward self-organized criticality is proposed, and applied to networks of leaky integrate-and-fire neurons with random and small-world topologies. Longer sustained activity for both topologies was elicited after learning compared to spectral radius normalization (global rescaling scheme). The ability to control the desired regime of the reservoir was shown and quick convergence toward it was observed for speech signals. Proposed regulation method can be applied online and leads to reservoirs more strongly adapted to the task at hand.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Triefenbach, F., Jalalvand, A., Schrauwen, B., Martens, J.P.: Phoneme Recognition with Large Hierarchical Reservoirs. In: Proceedings of Advances in Neural Information Processing Systems, NIPS (2010)
Maass, W., Natschläger, T., Markram, H.: Fading memory and kernel properties of generic cortical microcircuit models. Journal of Physiology 98, 315–330 (2004)
Bertschinger, N., Natschläger, T.: Real-time computation at the edge of chaos in recurrent neural networks. Neural Computation 16, 1413–1436 (2004)
Schrauwen, B., Büsing, L., Legenstein, R.: On computational power and the order-chaos phase transition in reservoir computing. In: Proceedings of Advances in Neural Information Processing Systems, NIPS (2008)
Roeschies, B., Igel, C.: Structure optimization of reservoir networks. Logic Journal of IGPL 18, 635–669 (2009)
Verstraeten, D., Schrauwen, B., D’Haene, M., Stroobandt, D.: An experimental unification of reservoir computing methods. Neural Networks 20, 391–403 (2007)
Kello, C.T., Mayberry, M.R.: Critical branching neural computation. In: Proceedings of International Joint Conference on Neural Networks, IJCNN (2010)
Kello, C.T., Kerster, B., Johnson, E.: Critical branching neural computation, neural avalanches, and 1/f scaling. In: Proceedings of the 33rd Annual Conference of the Cognitive Science Society (2011)
Goodman, D.F.M., Brette, R.: The brian simulator. Frontiers in Neuroscience 3, 192–197 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brodeur, S., Rouat, J. (2012). Regulation toward Self-organized Criticality in a Recurrent Spiking Neural Reservoir. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds) Artificial Neural Networks and Machine Learning – ICANN 2012. ICANN 2012. Lecture Notes in Computer Science, vol 7552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33269-2_69
Download citation
DOI: https://doi.org/10.1007/978-3-642-33269-2_69
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33268-5
Online ISBN: 978-3-642-33269-2
eBook Packages: Computer ScienceComputer Science (R0)