Introduction to Deep Learning

IDL

Topics covered:

Deep learning technologies are at the core of the current revolution in artificial intelligence for multimedia data analysis. The convergence of large-scale annotated datasets and affordable GPU hardware has allowed the training of neural networks for data analysis tasks which were previously addressed with hand-crafted features.

This is a short course (based on 4 lectures) that will cover the basic principles of deep learning.

The course webpage can be found: [2020], [2019], [2018]

lDL Lectures (2020)

D1L2-MachineLearning_2020.pdf

Lecture 1.1: Introduction to Machine Learning

Learning Paradigms

Instructor: Xavier Giró-i-Nieto

D1L3_Perceptron_2020.pdf

Lecture 1.2: The Perceptron

Architectures

Instructor: Xavier Giró-i-Nieto

D1L4_Multilayer_Perceptron_2020.pdf

Lecture 1.3: Multi-Layer Perceptron

Architectures

Instructor: Elisa Sayrol

D2L1_Backpropagation_2020.pdf

Lecture 2.1: Backpropagation

Training

Instructor: Xavier Giró-i-Nieto

D2L2_Optimization.pdf

Lecture 2.2: Optimization

Training

Instructor: Veronica Vilaplana

D2L3_LossFunctions.pdf

Lecture 2.3: Loss functions

Training

Instructor: Javier Ruiz

D2L4_Methodology.pdf

Lecture 2.4: Training methodology

Training

Instructor: Javier Ruiz

D3L1_CNN.pdf

Lecture 3.1: Convolutional Neural Networks

Architectures

Instructor: Veronica Vilaplana

D3L2_TransferLearning.pdf

Lecture 3.2: Transfer learning

Training

Instructor: Ramon Morros

D3L3_RecurrentNeuralNetworks.pdf

Lecture 3.3: Recurrent Neural Networks

Architectures

Instructor: Marta R. Costa-jussà

D3L4_GatedUnits.pdf

Lecture 3.4: Gated RNNs

Architectures

Instructor: Marta R. Costa-jussà

D4L1_Attention.pdf

Lecture 4.1: Attention models

Architectures

Instructor: Marta R. Costa-jussà

D4L2_BeyondSupervised.pdf

Lecture 4.2: Beyond Supervised Learning

Learning Paradigms

Instructor: Xavier Giró

D4L3_GAN.pdf

Lecture 4.3: Generative Adversial Networks

Generative models

Instructor: Veronica Vilaplana

D4L4_TheNeuralNetworkZoo.pdf

Lecture 4.4: The Neural Network zoo

Architectures

Instructor: Xavier Giró-i-Nieto