Machine Learning

Faculteit Science and Engineering
Jaar 2021/22
Vakcode WMAI010-05
Vaknaam Machine Learning
Niveau(s) master
Voertaal Engels
Periode semester I b

Uitgebreide vaknaam Machine Learning
Leerdoelen At the end of the course, the student is able to:
1) understand and appreciate universal challenges that arise in (almost) every machine learning (ML) project: curse of dimensionality, bias-variance tradeoff, choice of loss function, architecture design (structural bias), and know about standard coping strategies (dimension Reduction, regularization, cross-validation)
2) give a coarse overview of the rich landscape of modern ML (supervised / unsupervised / reinforcement learning,
different modeling attitudes, goals and methods in different subfields of ML)
3) understand basic algorithmic techniques that is sufficient to allow him/her to practically apply these techniques by programming from scratch or using a high-level toolbox
4) easily and quickly implement simple (but not necessarily poorly performing) linear, baseline ML pipelines for supervised learning problems
5) design, implement, run, test and evaluate a more complex, multi-module, nonlinear ML pipeline for supervised learning problems, possibly including unsupervised components
Omschrijving Machine learning (ML) is about algorithms which are fed with (large quantities of) real-world data, and which return a compressed model of the data. An example is a spoken language model: the input data are speech recordings, from which ML methods build a model of spoken English -- useful, for instance, in automated speech recognition systems. There exists a large number of formalisms in which such models can be formulated and implemented, and an even larger diversity of learning algorithms to estimate such models from data. However, there is only a relatively small number of fundamental challenges which are common to all of these formalisms and algorithms. This lecture introduces such fundamental concepts and a choice of standard model formalisms (decision trees, linear classifiers and regressors, K-means clustering, self-organizing feature maps, sampling / energy based distribution modeling, hidden Markov models and graphical models, feedforward and recurrent neural networks).
There will be a practical where students will implement their own machine learning system and they will write a report about this system and the obtained results. Furthermore, there will be a written final exam at the end of the course.
Uren per week
Onderwijsvorm Hoorcollege (LC), Opdracht (ASM), Practisch werk (PRC), Werkcollege (T)
(There will be lectures given by the lecturer and a computer practicum.)
Toetsvorm Schriftelijk tentamen (WE), Verslag (R)
(The examination will count for 50% of the final mark and the practical report also for 50%. The grade of the exam needs to be higher or equal to 5.0 in order to pass this course.)
Vaksoort master
Coördinator Prof. Dr. H. Jaeger
Docent(en) Prof. Dr. H. Jaeger
Verplichte literatuur
Titel Auteur ISBN Prijs
Lecture notes, specific for this course. Open access; online via Nestor Herbert Jaeger
Entreevoorwaarden Mandatory: No prior knowledge is assumed. Please note that the student is expected to have a relevant BSc degree.
Advised: Knowledge about linear algebra is essential in order to do well for this course; knowledge of calculus and statistics is very helpful.
Opmerkingen This course is NOT an introduction to deep learning! But it is a highly recommended preparation for the follow-up course Deep Learning (WMAI017-05).
Opgenomen in
Opleiding Jaar Periode Type
MSc Artificial Intelligence  (A - General Mandatory Course Units) - semester I b verplicht
MSc Astronomy: Quantum Universe  (Optional Courses in Data Science (DS)) - semester I b keuze
MSc Behavioural and Cognitive Neurosciences: Behavioural Neurosciences  (Electives: courses from other programmes) 2 semester I b keuze
MSc Behavioural and Cognitive Neurosciences: Cognitive Neuroscience & Modelling  (Electives: courses from other programmes) 2 semester I b keuze
MSc Behavioural and Cognitive Neurosciences: Molecular & Clinical Neurosciences  (Electives: courses from other programmes) 2 semester I b keuze
MSc Computational Cognitive Science  (C - Elective Course Units) - semester I b keuze
MSc Computational Cognitive Science  (B - Mandatory Course Units Computational Cognitive Neuroscience) - semester I b verplicht CCN
MSc Computing Science: Data Science and Systems Complexity  (Guided choice course units) - semester I b keuze
MSc Computing Science: Intelligent Systems and Visual Computing  (Compulsory course units) 2 semester I b verplicht
MSc Computing Science: Software Engineering and Distributed Systems  (Guided choice course units) - semester I b keuze
MSc Mathematics: Science, Business and Policy  (Science, Business and Policy: Statistics and Big Data) - semester I b keuzegroep
MSc Mathematics: Statistics and Big Data  (Statistics and Big Data: Guided Choice) - semester I b guided choice
ReMa Taalwetenschappen / Linguistics  (ReMa Language and Communication Technologies (LCT); Erasmus Mundus) 1 semester I b keuzegroep