Abstract
Neuronal circuits can learn and replay firing patterns evoked by sequences of sensory stimuli. After training, a brief cue can trigger a spatiotemporal pattern of neural activity similar to that evoked by a learned stimulus sequence. Network models show that such sequence learning can occur through the shaping of feedforward excitatory connectivity via long term plasticity. Previous models describe how event order can be learned, but they typically do not explain how precise timing can be recalled. We propose a mechanism for learning both the order and precise timing of event sequences. In our recurrent network model, long term plasticity leads to the learning of the sequence, while short term facilitation enables temporally precise replay of events. Learned synaptic weights between populations determine the time necessary for one population to activate another. Long term plasticity adjusts these weights so that the trained event times are matched during playback. While we chose short term facilitation as a time-tracking process, we also demonstrate that other mechanisms, such as spike rate adaptation, can fulfill this role. We also analyze the impact of trial-to-trial variability, showing how observational errors as well as neuronal noise result in variability in learned event times. The dynamics of the playback process determines how stochasticity is inherited in learned sequence timings. Future experiments that characterize such variability can therefore shed light on the neural mechanisms of sequence learning.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abbott, L.F., & Blum, K.I. (1996). Functional significance of long-term potentiation for sequence learning and prediction. Cerebral Cortex, 6(3), 406–416.
Abraham, W.C. (2008). Metaplasticity: tuning synapses and networks for plasticity. Nature Reviews Neuroscience, 9(5), 387.
Alberini, C. (2009). Transcription factors in long-term memory and synaptic plasticity. Physiological Reviews, 89(1), 121–145.
Amari, S.I. (1972). Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Transactions on Computers, 21(11), 1197–1206.
Benda, J., & Herz, A.V. (2003). A universal model for spike-frequency adaptation. Neural Computation, 15 (11), 2523–2564.
Bernacchia, A., Seo, H., Lee, D., & Wang, X.J. (2011). A reservoir of time constants for memory traces in cortical neurons. Nature Neuroscience, 14(3), 366–72.
Bienenstock, E.L., Cooper, L.N., & Munro, P.W. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. The Journal of Neuroscience, 2(1), 32–48.
Bliss, T.V.P., & Lømo, T. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. The Journal of Physiology, 232(2), 331–356.
Brea, J., Senn, W., & Pfister, J.P. (2013). Matching recall and storage in sequence learning with spiking neural networks. The Journal of Neuroscience, 33(23), 9565–9575.
Brown, G.D., Preece, T., & Hulme, C. (2000). Oscillator-based memory for serial order. Psychological Review, 107(1), 127.
Bueti, D., & Buonomano, D.V. (2014). Temporal perceptual learning. Timing & Time Perception, 2(3), 261–289.
Buhusi, C.V., & Meck, W.H. (2005). What makes us tick? functional and neural mechanisms of interval timing. Nature Reviews Neuroscience, 6(10), 755–65.
Buonomano, D.V. (2000). Decoding temporal information: A model based on short-term synaptic plasticity. The Journal of Neuroscience, 20(3), 1129–1141.
Buonomano, D.V., & Maass, W. (2009). State-dependent computations: spatiotemporal processing in cortical networks. Nature Reviews Neuroscience, 10(2), 113–125.
Burgess, N., & Hitch, G.J. (1999). Memory for serial order: A network model of the phonological loop and its timing. Psychological Review, 106(3), 551.
Butts, D.A., Weng, C., Jin, J., Yeh, C.I., Lesica, N.A., Alonso, J.M., & Stanley, G.B. (2007). Temporal precision in the neural code and the timescales of natural vision. Nature, 449(7158), 92–95.
Clements, J. (1996). Transmitter timecourse in the synaptic cleft: its role in central synaptic function. Trends in Neurosciences, 19(5), 163–171.
Clopath, C., Büsing, L., Vasilaki, E., & Gerstner, W. (2010). Connectivity reflects coding: a model of voltage-based stdp with homeostasis. Nature Neuroscience, 13(3), 344–352.
Conway, C.M., & Christiansen, M.H. (2001). Sequential learning in non-human primates. Trends in Cognitive Sciences, 5(12), 539–546.
Costa, R.P., Sjöström, P.J., & Van Rossum, M.C. (2013). Probabilistic inference of short-term synaptic plasticity in neocortical microcircuits. Frontiers in computational neuroscience, 7.
Dayan, P., & Abbott, L.F. (2001). Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge, MA: MIT Press.
Dudek, S.M., & Bear, M.F. (1992). Homosynaptic long-term depression in area ca1 of hippocampus and effects of n-methyl-d-aspartate receptor blockade. Proceedings of the National Academy of Sciences of the United States of America, 89(10), 4363–4367.
Durstewitz, D. (2003). Self-organizing neural integrator predicts interval times through climbing activity. The Journal of Neuroscience, 23(12), 5342–5353.
Eagleman, S.L., & Dragoi, V. (2012). Image sequence reactivation in awake v4 networks. Proceedings of the National Academy of Sciences of the United States of America, 109(47), 19,450–19,455.
Faisal, A.A., Selen, L.P., & Wolpert, D.M. (2008). Noise in the nervous system. Nature Reviews Neurology, 9(4), 292–303.
Fiete, I.R., Senn, W., Wang, C.Z., & Hahnloser, R.H. (2010). Spike-time-dependent plasticity and heterosynaptic competition organize networks to produce long scale-free sequences of neural activity. Neuron, 65, 563–576.
Finney, S., & Palmer, C. (2003). Auditory feedback and memory for music performance: Sound evidence for an encoding effect. Memory & Cognition, 31(1), 51–64.
Fourcaud-Trocmé, N., Hansel, D., Van Vreeswijk, C., & Brunel, N. (2003). How spike generation mechanisms determine the neuronal response to fluctuating inputs. The Journal of Neuroscience, 23(37), 11,628–11,640.
Gardiner, C.W. (2004). Handbook of stochastic methods. Berlin: Springer.
Gavornik, J.P., & Bear, M.F. (2014). Learned spatiotemporal sequence recognition and prediction in primary visual cortex. Nature Neuroscience, 17(5), 732–737.
Gavornik, J.P., Shuler, M.G.H., Loewenstein, Y., Bear, M.F., & Shouval, H.Z. (2009). Learning reward timing in cortex through reward dependent expression of synaptic plasticity. Proceedings of the National Academy of Sciences of the United States of America, 106(16), 6826–6831.
Gerstner, W., & Kistler, W.M. (2002). Mathematical formulations of hebbian learning. Biological Cybernetics, 87(5-6), 404–15.
Gjorgjieva, J., Clopath, C., Audet, J., & Pfister, J.P. (2011). A triplet spike-timing–dependent plasticity model generalizes the Bienenstock–Cooper–Munro rule to higher-order spatiotemporal correlations. Proceedings of the National Academy of Sciences of the United States of America, 108(48), 19,383–19,388.
Goldman, M.S. (2009). Memory without feedback in a neural network. Neuron, 61(4), 621–634.
Graupner, M., & Brunel, N. (2012). Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location. Proceedings of the National Academy of Sciences of the United States of America, 109(10), 3991–3996.
Griffin, A.L., Eichenbaum, H., & Hasselmo, M.E. (2007). Spatial representations of hippocampal ca1 neurons are modulated by behavioral context in a hippocampus-dependent memory task. The Journal of Neuroscience, 27 (9), 2416–2423.
Grossberg, S., & Merrill, J.W. (1992). A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Cognitive Brain Research, 1(1), 3–38.
Gütig, R., Aharonov, R., Rotter, S., & Sompolinsky, H. (2003). Learning input correlations through nonlinear temporally asymmetric hebbian plasticity. The Journal of Neuroscience, 23(9), 3697–3714.
Haider, B., Häusser, M., & Carandini, M. (2013). Inhibition dominates sensory responses in the awake cortex. Nature, 493(7430), 97–100.
Hass, J., Blaschke, S., Rammsayer, T., & Herrmann, J.M. (2008). A neurocomputational model for optimal temporal processing. Journal of Computational Neuroscience, 25(3), 449–464.
Häusser, M., & Roth, A. (1997). Estimating the time course of the excitatory synaptic conductance in neocortical pyramidal cells using a novel voltage jump method. The Journal of Neuroscience, 17(20), 7606–7625.
Hennequin, G., Vogels, T.P., & Gerstner, W. (2014). Optimal control of transient dynamics in balanced networks supports generation of complex movements. Neuron, 82(6), 1394–1406.
Hikosaka, O., Nakamura, K., Sakai, K., & Nakahara, H. (2002). Central mechanisms of motor skill learning. Current Opinion in Neurobiology, 12(2), 217–222.
Huang, Y.Y., Colino, A., Selig, D.K., & Malenka, R.C. (1992). The influence of prior synaptic activity on the induction of long-term potentiation. Science, 255(5045), 730–3.
Itskov, V., Curto, C., Pastalkova, E., & Buzsáki, G. (2011). Cell assembly sequences arising from spike threshold adaptation keep track of time in the hippocampus. The Journal of Neuroscience, 31(8), 2828–2834.
Ivry, R.B., & Schlerf, J.E. (2008). Dedicated and intrinsic models of time perception. Trends in Cognitive Sciences, 12(7), 273–280.
Jenkins, I., Brooks, D., Nixon, P., Frackowiak, R., & Passingham, R. (1994). Motor sequence learning: a study with positron emission tomography. The Journal of Neuroscience, 14(6), 3775–3790.
Jun, J.K., & Jin, D.Z. (2007). Development of neural circuitry for precise temporal sequences through spontaneous activity, axon remodeling, and synaptic plasticity. PLoS ONE, 2(8), e723.
Kandel, E.R. (2001). The molecular biology of memory storage: a dialogue between genes and synapses. Science, 294(5544), 1030–1038.
Karmarkar, U.R., & Buonomano, D.V. (2007). Timing in the absence of clocks: encoding time in neural network states. Neuron, 53(3), 427–438.
Kempter, R., Gerstner, W., & van Hemmen, J.L. (1999). Hebbian learning and spiking neurons. Physical Review E, 59, 4498–4514.
Kleinfeld, D. (1986). Sequential state generation by model neural networks. Proceedings of the National Academy of Sciences of the United States of America, 83(24), 9469–9473.
Ko, H., Hofer, S.B., Pichler, B., Buchanan, K.A., Sjöström, P.J., & Mrsic-Flogel, T.D. (2011). Functional specificity of local synaptic connections in neocortical networks. Nature, 473(7345), 87–91.
Kok, P., Jehee, J.F., & de Lange F.P. (2012). Less is more: expectation sharpens representations in the primary visual cortex. Neuron, 75(2), 265–270.
Kraus, N., & Chandrasekaran, B. (2010). Music training for the development of auditory skills. Nature Reviews Neuroscience, 11(8), 599–605.
Laing, C.R., & Chow, C.C. (2002). A spiking neuron model for binocular rivalry. Journal of Computational Neuroscience, 12(1), 9–53.
Litwin-Kumar, A., & Doiron, B. (2012). Slow dynamics and high variability in balanced cortical networks with clustered connections. Nature Neuroscience, 15(11), 1498–505.
Lundstrom, B. (2015). Modeling multiple time scale firing rate adaptation in a neural network of local field potentials. Journal of Computational Neuroscience, 38(1), 189–202.
Ma, W.J., Beck, J.M., Latham, P.E., & Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nature Neuroscience, 9(11), 1432–1438.
Major, G., & Tank, D. (2004). Persistent neural activity: prevalence and mechanisms. Current Opinion in Neurobiology, 14(6), 675–84.
Malenka, R.C., & Bear, M.F. (2004). Ltp and ltd: an embarrassment of riches. Neuron, 44(1), 5–21.
von der Malsburg, C. (1973). Self-organization of orientation sensitive cells in the striate cortex. Kybernetik, 14(2), 85–100.
Markram, H., & Tsodyks, M. (1996). Redistribution of synaptic efficacy between neocortical pyramidal neurons. Nature, 382(6594), 807–810.
Markram, H., Wang, Y., & Tsodyks, M. (1998). Differential signaling via the same axon of neocortical pyramidal neurons. Proceedings of the National Academy of Sciences of the United States of America, 95(9), 5323–5328.
McAuley, J.D., & Jones, M.R. (2003). Modeling effects of rhythmic context on perceived duration: a comparison of interval and entrainment approaches to short-interval timing. Journal of Experimental Psychology: Human Perception and Performance, 29(6), 1102.
Meyer, T., & Olson, C.R. (2011). Statistical learning of visual transitions in monkey inferotemporal cortex. Proceedings of the National Academy of Sciences, 108(48), 19,401–19,406.
Miller, K.D. (1994). A model for the development of simple cell receptive fields and the ordered arrangement of orientation columns through activity-dependent competition between on-and off-center inputs. The Journal of Neuroscience, 14, 409–441.
Morrone, M.C., Ross, J., & Burr, D. (2005). Saccadic eye movements cause compression of time as well as space. Nature Neuroscience, 8(7), 950–4.
Nabavi, S., Fox, R., Proulx, C.D., Lin, J.Y., Tsien, R.Y., & Malinow, R. (2014). Engineering a memory with ltd and ltp. Nature, 511(7509), 348–52.
Oh, M.C., Derkach, V.A., Guire, E.S., & Soderling, T.R. (2006). Extrasynaptic membrane trafficking regulated by glur1 serine 845 phosphorylation primes ampa receptors for long-term potentiation. The Journal of Biological Chemistry, 281(2), 752–8.
Oja, E. (1982). Simplified neuron model as a principal component analyzer. Journal of Mathematical Biology, 15(3), 267–273.
Perin, R., Berger, T.K., & Markram, H. (2011). A synaptic organizing principle for cortical neuronal groups. Proceedings of the National Academy of Sciences of the United States of America, 108(13), 5419–5424.
Pfister, J.P., & Gerstner, W. (2006). Triplets of spikes in a model of spike timing-dependent plasticity. The Journal of Neuroscience, 26(38), 9673–9682.
Pfordresher, P.Q. (2003). Auditory feedback in music performance: Evidence for a dissociation of sequencing and timing. Journal of Experimental Psychology: Human Perception and Performance, 29(5), 949.
Philpot, B.D., Sekhar, A.K., Shouval, H.Z., & Bear, M.F. (2001). Visual experience and deprivation bidirectionally modify the composition and function of NMDA receptors in visual cortex. Neuron, 29(1), 157–169.
Pozzorini, C., Naud, R., Mensi, S., & Gerstner, W. (2013). Temporal whitening by power-law adaptation in neocortical neurons. Nature Neuroscience, 16(7), 942–948.
Rao, R.P., & Sejnowski, T.J. (2001). Spike-timing-dependent hebbian plasticity as temporal difference learning. Neural Computation, 13(10), 2221–2237.
Reutimann, J., Yakovlev, V., Fusi, S., & Senn, W. (2004). Climbing neuronal activity as an event-based cortical representation of time. The Journal of Neuroscience, 24(13), 3295–3303.
Sakai, K., Hikosaka, O., Miyauchi, S., Takino, R., Sasaki, Y., & Pütz, B. (1998). Transition of brain activation from frontal to parietal areas in visuomotor sequence learning. The Journal of Neuroscience, 18(5), 1827–1840.
Shea-Brown, E., Rinzel, J., Rakitin, B.C., & Malapani, C. (2006). A firing rate model of parkinsonian deficits in interval timing. Brain Research, 1070(1), 189–201.
Shuler, M.G., & Bear, M.F. (2006). Reward timing in the primary visual cortex. Science, 311(5767), 1606–1609.
Simen, P., Balci, F., Cohen, J.D., & Holmes, P., et al. (2011). A model of interval timing by neural integration. The Journal of Neuroscience, 31(25), 9238–9253.
Sjöström, P.J., Turrigiano, G.G., & Nelson, S.B. (2001). Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron, 32(6), 1149–1164.
Song, S., Sjöström, P.J., Reigl, M., Nelson, S., & Chklovskii, D.B. (2005). Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biology, 3(3), e68.
Takeuchi, T., Duszkiewicz, A.J., & Morris, R.G. (2014). The synaptic plasticity and memory hypothesis: encoding, storage and persistence. Philosophical Transactions of the Royal Society B, 369(1633), 20130–288.
Terao, M., Watanabe, J., Yagi, A., & Nishida, S. (2008). Reduction of stimulus visibility compresses apparent time intervals. Nature Neuroscience, 11(5), 541–2.
Tsodyks, M., Pawelzik, K., & Markram, H. (1998). Neural networks with dynamic synapses. Neural Computation, 10(4), 821–835.
Ulanovsky, N., Las, L., Farkas, D., & Nelken, I. (2004). Multiple time scales of adaptation in auditory cortex neurons. The Journal of Neuroscience, 24(46), 10,440–10,453.
Wang, D., & Arbib, M. (1990). Complex temporal sequence learning based on short-term memory. IEEE Pulse, 78(9), 1536–1543.
Wang, X., Wei, Y., Vaingankar, V., Wang, Q., Koepsell, K., Sommer, F.T., & Hirsch, J.A. (2007). Feedforward excitation and inhibition evoke dual modes of firing in the cat’s visual thalamus during naturalistic viewing. Neuron, 55(3), 465–78.
Wang, X.J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron, 36(5), 955–68.
Xu, M., Zhang, S.Y., Dan, Y., & Poo, Mm. (2014). Representation of interval timing by temporally scalable firing patterns in rat prefrontal cortex. Proceedings of the National Academy of Sciences of the United States of America, 111(1), 480–485.
Xu, S., Jiang, W., Poo, Mm., & Dan, Y. (2012). Activity recall in a visual cortical ensemble. Nature Neuroscience, 15, 449–455.
Zatorre, R.J., Chen, J.L., & Penhune, V.B. (2007). When the brain plays music: auditory–motor interactions in music perception and production. Nature Reviews Neuroscience, 8(7), 547–558.
Acknowledgments
We thank Jeffrey Gavornik helpful comments. Funding was provided by NSF-DMS-1311755 (Z.P.K.); NSF-DMS-1517629 (K.J. and Z.P.K.); NSF/NIGMS-R01GM104974 (A.V-C. and K.J.); and NSF-DMS-1122094 (A.V-C. and K.J.).
Conflict of interests
The authors declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Additional information
Action Editor: J. Rinzel
Krešimir Josić and Zachary P. Kilpatrick contributed equally to this work.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Veliz-Cuba, A., Shouval, H.Z., Josić, K. et al. Networks that learn the precise timing of event sequences. J Comput Neurosci 39, 235–254 (2015). https://doi.org/10.1007/s10827-015-0574-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10827-015-0574-4