Skip to ContentSkip to Navigation
About us Latest news News News articles

Marijn Stollenga - Using Guided Autoencoders on Face Recognition

10 May 2011

afstudeercolloquium

In this master thesis we will create guided autoencoders (GAE) and apply them to face recognition. GAEs are agents that interact with the image. They perceive part of an image through a window, use an autoencoder to encode it, and react to what they see by moving the window. They are trained to move the window to find and encode specific parts of the face -- in our case the eyes, nose and mouth. We use the LFWC (cropped Labeled Faces in the Wild) dataset which is very varied and has many uncontrolled variables. We train GAEs using the CACLA reinforcement learning algorithm which can deal with continuous states and actions. To create a state, GAEs evaluate their separately trained autoencoder on what is visible through their window. They use the resulting encoding as a state to guide their actions. We show that GAEs can find the way to their parts provided they are relatively close to them. We use both shallow and deep (stacked) autoencoders. Surprisingly, deep GAEs do not outperform shallow GAEs on this task. The GAEs are finally used to classify the gender of faces and whether a person is smiling or not. Their classification performance is lower than expected due to the unstable nature of GAEs. At their current performance, GAEs are applicable for fine-tuning guesses of positions of parts of the face. We discuss possible future directions to address the unstable nature. In summary, the GAEs are not stable enough to be applied directly on classification, but their ability to find parts is promising. We think that if the stability issues are addressed, GAEs can improve automatic facerecognition and computer vision systems in general.

Last modified:13 June 2019 1.40 p.m.
Share this Facebook LinkedIn

More news

  • 03 July 2025

    Erik Heeres receives RUG Impact Innovator Excellence Award

    During the RUG Ventures Innovation Day, Prof. Erik Heeres of the Faculty of Science and Engineering (RUG) was awarded the Impact Innovator Excellence Award.

  • 02 July 2025

    € 30 million investment for UG spin-off Portal Biotech

    Portal Biotech, a pioneer in nanopore-based protein identification and sequencing technology, has raised € 30 million in Series A funding. The funding will support commercial rollout and team growth.

  • 01 July 2025

    ‘Give seals space’

    The Wadden Sea is constantly changing. Native animals need to be able to adapt in   order to thrive in an environment that is shaped by the tides. By conducting research on seals in the area, PhD students Margarita Méndez-Aróstegui and Beatriz...