Learning compositional sequences with multiple time scales through a hierarchical network of spiking neurons
Author(s)
Maes, Amadeus
Barahona, Mauricio
Clopath, Claudia
Type
Journal Article
Abstract
Sequential behaviour is often compositional and organised across multiple time scales: a set of individual elements developing on short time scales (motifs) are combined to form longer functional sequences (syntax). Such organisation leads to a natural hierarchy that can be used advantageously for learning, since the motifs and the syntax can be acquired independently. Despite mounting experimental evidence for hierarchical structures in neuroscience, models for temporal learning based on neuronal networks have mostly focused on serial methods. Here, we introduce a network model of spiking neurons with a hierarchical organisation aimed at sequence learning on multiple time scales. Using biophysically motivated neuron dynamics and local plasticity rules, the model can learn motifs and syntax independently. Furthermore, the model can relearn sequences efficiently and store multiple sequences. Compared to serial learning, the hierarchical model displays faster learning, more flexible relearning, increased capacity, and higher robustness to perturbations. The hierarchical model redistributes the variability: it achieves high motif fidelity at the cost of higher variability in the between-motif timings.
Date Issued
2021-03-25
Date Acceptance
2021-03-08
Citation
PLoS Computational Biology, 2021, 17 (3)
ISSN
1553-734X
Publisher
Public Library of Science (PLoS)
Journal / Book Title
PLoS Computational Biology
Volume
17
Issue
3
Copyright Statement
© 2021 Maes et al. This is an open
access article distributed under the terms of the
Creative Commons Attribution License, which
permits unrestricted use, distribution, and
reproduction in any medium, provided the original
author and source are credited.
access article distributed under the terms of the
Creative Commons Attribution License, which
permits unrestricted use, distribution, and
reproduction in any medium, provided the original
author and source are credited.
License URL
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Wellcome Trust
Biotechnology and Biological Sciences Research Council (BBSRC)
Biotechnology and Biological Sciences Research Cou
Simons Foundation
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000634792900004&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
EP/N014529/1
200790/Z/16/Z
BB/P018785/1
ORCA 64155 (BB/N013956/1)
Award ID:564408
Subjects
Science & Technology
Life Sciences & Biomedicine
Biochemical Research Methods
Mathematical & Computational Biology
Biochemistry & Molecular Biology
Publication Status
Published
Article Number
ARTN e1008866
Date Publish Online
2021-03-25