Skip to ContentSkip to Navigation
About us Latest news News News articles

Jaldert Rombouts - Neurally plausible reinforcement learning of memory representations in delayed-response tasks

08 May 2012

A key function of brains is undoubtedly the abstraction and maintenance of information from the environment for later use. Neurons in association cortex play an important role in this process: during learning these neurons become tuned to relevant features and represent the information that is required later as a persistent elevation of their activity. It is however not well known how these neurons acquire their task-relevant tuning.

Here we present a biologically plausible neural network model based on reinforcement learning that explains how neurons learn to represent task-relevant information in delayed response tasks. This model generalizes the Attention-Gated Reinforcement Learning (AGREL) model by Roelfsema and van Ooyen (2005) to the temporal domain. An attention-based feedback signal from the motor layer to earlier processing layers is combined with a novel memory mechanism to solve the structural and temporal credit-assignment problems. We can show that on average the updates are equal to a variant of the Error-Backpropagation algorithm.

The model can explain how neurons in lateral intraparietal cortex (LIP) learn to represent task-relevant information in 1) a memory (anti)saccade task, 2) an orientation discrimination task and 3) a probabilistic classification task. Comparisons with experimental results from animals trained on these same tasks show that the model neurons learn representations that are similar to those observed in biological neurons.

This is joint work with Pieter Roelfsema and Sander Bohte

Last modified:10 February 2021 2.56 p.m.
View this page in: Nederlands

More news

  • 05 September 2024

    ERC Starting Grants for two UG researchers

    Two UG researches, both working at the Faculty of Science and Engineering, have been awarded an ERC Starting Grant: Jingxiu Xie and Gosia Wlodarczyk-Biegun. The European Research Council's (ERC) Starting Grants consist of €1.5 million each, for a...

  • 23 July 2024

    The chips of the future

    Our computers use an unnecessarily large amount of energy, and we are reaching the limits of our current technology. That is why CogniGron is working on new materials that mimic the way the brain computes, and Professor Tamalika Banerjee will...

  • 18 July 2024

    Smart robots to make smaller chips

    A robotic arm in a factory that repeatedly executes the same movement: that’s a thing of the past, states Ming Cao. Researchers of the University of Groningen are collaborating with high-tech companies to make production processes more autonomous.