Acetylcholine-modulated plasticity in reward-driven navigation: a computational study.
Springer Science and Business Media LLC
MetadataShow full item record
Zannone, S., Brzosko, Z., Paulsen, O., & Clopath, C. (2018). Acetylcholine-modulated plasticity in reward-driven navigation: a computational study.. Sci Rep, 8 (1), 9486. https://doi.org/10.1038/s41598-018-27393-2
Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules.
Animals, Acetylcholine, Exploratory Behavior, Reward, Neuronal Plasticity, Models, Neurological, Cholinergic Neurons, Spatial Navigation
Biotechnology and Biological Sciences Research Council (BB/P019560/1)
Biotechnology and Biological Sciences Research Council (BB/N019008/1)
External DOI: https://doi.org/10.1038/s41598-018-27393-2
This record's URL: https://www.repository.cam.ac.uk/handle/1810/280076
Attribution 4.0 International (CC BY 4.0)
Licence URL: https://creativecommons.org/licenses/by/4.0/