Skip to ContentSkip to Navigation
Over onsNieuws en agendaNieuwsberichten

Marco Wiering - Deep Extensions of Support Vector Machines

22 januari 2013

Machine learning algorithms are very useful for regression and classification problems. These algorithms learn to extract a predictive model using a dataset of examples containing input vectors and target outputs. Among all machine learning algorithms, currently the most popular method is the Support Vector Machine (SVM). SVMs have been used for many engineering applications such as object recognition, face recognition, fMRI-scan classification and medical diagnosis.

In this presentation we will study two different extensions of the standard SVM. The first method that will be presented is the deep Support Vector Machine (DSVM). The original SVM has a single layer with kernel functions and is therefore a shallow model. The DSVM can use an arbitrary number of layers, in which lower-level layers contain support vector machines that learn to extract relevant features from the outputs of one layer below. The highest level model then performs the actual prediction using the extracted features as inputs. The DSVM is compared to the regular SVM on a large number of regression datasets and the results show that the DSVM significantly outperforms the SVM on most datasets. Another extension which will be presented is the neural SVM (NSVM). The NSVM uses neural networks to extract features that are given to an SVM to finally predict the output. We have used the NSVM to construct an autoencoder, basically a method for doing non-linear principle component analysis (PCA). The autoencoding NSVM is compared to standard PCA and a neural network autoencoder on the task of dimensionality reduction of eye images. The results show very favorable results for the autoencoding NSVM compared to these state-of-the-art methods.

Laatst gewijzigd:31 mei 2018 16:05

Meer nieuws

  • 12 november 2018

    Symposium 'Gaswinning, aardbevingen en wat nu?' op 15 november a.s.

    Het Groninger Universiteitsfonds (GUF) bestaat dit jaar 125 jaar. Tijdens een speciaal symposium met de titel ‘Gaswinning, aardbevingen en wat nu?’ op donderdag 15 november 2018, wordt daarom de 'Ubbo Emmiuspenning voor bijzondere maatschappelijke verdiensten'...

  • 06 november 2018

    Groningen blijft in trek bij Nederlandse en internationale studenten

    De Rijksuniversiteit Groningen telt per 1 november 2018 31.115 studenten met een ‘actieve eerste inschrijving’ voor een bachelor of masteropleiding. Dit is een stijging van 4,6% ten opzichte van 2017.Het totale aantal studenten dat ingeschreven is aan...

  • 16 oktober 2018

    Digital Society Conferentie Nederlandse universiteiten

    De digitale informatietechnologie dringt steeds dieper door in onze samenleving. Daarom organiseren de veertien Nederlandse universiteiten, verenigd in de VSNU, op dinsdag 27 november de internationale Digital Society Conference in de Rijtuigenloods...