Jaldert Rombouts - Neurally plausible reinforcement learning of memory representations in delayed-response tasks
A key function of brains is undoubtedly the abstraction and maintenance of information from the environment for later use. Neurons in association cortex play an important role in this process: during learning these neurons become tuned to relevant features and represent the information that is required later as a persistent elevation of their activity. It is however not well known how these neurons acquire their task-relevant tuning.
Here we present a biologically plausible neural network model based on reinforcement learning that explains how neurons learn to represent task-relevant information in delayed response tasks. This model generalizes the Attention-Gated Reinforcement Learning (AGREL) model by Roelfsema and van Ooyen (2005) to the temporal domain. An attention-based feedback signal from the motor layer to earlier processing layers is combined with a novel memory mechanism to solve the structural and temporal credit-assignment problems. We can show that on average the updates are equal to a variant of the Error-Backpropagation algorithm.
The model can explain how neurons in lateral intraparietal cortex (LIP) learn to represent task-relevant information in 1) a memory (anti)saccade task, 2) an orientation discrimination task and 3) a probabilistic classification task. Comparisons with experimental results from animals trained on these same tasks show that the model neurons learn representations that are similar to those observed in biological neurons.
This is joint work with Pieter Roelfsema and Sander Bohte
Laatst gewijzigd: | 10 februari 2021 14:56 |
Meer nieuws
-
07 juli 2025
Masterstudent Industrial Engineering and Management Ana Lazar wint GUF-100 prijs
Tijdens de RUG Ceremony of Merits op 4 juli is Ana Lazar uitgeroepen tot winnaar van de GUF-100 prijs en daarmee tot de beste student van de Faculty of Science and Engineering 2024-2025.
-
03 juli 2025
Erik Heeres ontvangt RUG Impact Innovator Excellence Award
Tijdens de RUG Ventures Innovation Day heeft Prof. dr. ir. Erik Heeres van de Faculty of Science and Engineering (RUG) de Impact Innovator Excellence Award ontvangen.
-
02 juli 2025
Investering van € 30 miljoen voor RUG spin-off Portal Biotech
Portal Biotech, een pionier op het gebied van eiwitidentificatie en -sequencing met behulp van nanoporiën, heeft een bedrag van € 30 miljoen aan serie A-financiering opgehaald. De financiering zal worden gebruikt voor de commerciële uitrol en...