Skip to ContentSkip to Navigation
Over onsNieuws en agendaNieuwsberichten

Jaldert Rombouts - Neurally plausible reinforcement learning of memory representations in delayed-response tasks

08 mei 2012

A key function of brains is undoubtedly the abstraction and maintenance of information from the environment for later use. Neurons in association cortex play an important role in this process: during learning these neurons become tuned to relevant features and represent the information that is required later as a persistent elevation of their activity. It is however not well known how these neurons acquire their task-relevant tuning.

Here we present a biologically plausible neural network model based on reinforcement learning that explains how neurons learn to represent task-relevant information in delayed response tasks. This model generalizes the Attention-Gated Reinforcement Learning (AGREL) model by Roelfsema and van Ooyen (2005) to the temporal domain. An attention-based feedback signal from the motor layer to earlier processing layers is combined with a novel memory mechanism to solve the structural and temporal credit-assignment problems. We can show that on average the updates are equal to a variant of the Error-Backpropagation algorithm.

The model can explain how neurons in lateral intraparietal cortex (LIP) learn to represent task-relevant information in 1) a memory (anti)saccade task, 2) an orientation discrimination task and 3) a probabilistic classification task. Comparisons with experimental results from animals trained on these same tasks show that the model neurons learn representations that are similar to those observed in biological neurons.

This is joint work with Pieter Roelfsema and Sander Bohte

Laatst gewijzigd:31 mei 2018 16:05
printView this page in: English

Meer nieuws

  • 15 februari 2019

    Groningse ingenieurs studeren straks af in Drachten

    De Rijksuniversiteit Groningen (RUG) start in het collegejaar 2019-2020 met een masteropleiding Mechanical Engineering; oftewel werktuigbouwkunde. Prof. dr. ir. Jacquelien Scherpen, voorzitter van het Groningen Engineering Center (GEC) noemde het eerder...

  • 12 februari 2019

    Het klimaatverdriet van Maarten Loonen

    De klimaatverandering op Spitsbergen; Maarten Loonen maakt het al jaren aan den lijve mee. Hij kan uren vertellen over ganzen, rendieren en gletsjers, over de onmetelijke en ons onbekende natuur. Maar het meest raakt hem de klimaatklok die voorttikt...

  • 05 februari 2019

    Master's programme in Nanoscience assessed as excellent for the 3rd time

    The Top Master's programme in Nanoscience has been assessed by an international peer review committee, organized by QANU, and their report has now been published and confirmed by the NVAO (Accreditation Organisation of the Netherlands and Flanders)...