INQ0092522 - MACHINE LEARNING (MOD. B) (A) 2022-2023 - LAST DIGIT ID 0-4 - PROF. FEDERICO CHIARIOTTI

Target skills and knowledge:     

The aim of this course is to provide the fundamentals and basic principles of the learning problem as well as to introduce the most common machine learning algorithms. The course will be complemented by hands-on experience.

Examination methods:    

The evaluation of the acquired skills and knowledge will be performed using two contributions:

1. A written exam (30 points).
2. Three simple homeworks to be done using Python (up to 3 bonus points).

Exam dates:

1. 24/01/2023
2. 09/02/2023
3. 28/06/2023
4. 07/09/2023
5. 21/09/2023
   

Course Program   

1. Motivation: components of the learning problem and applications of Machine Learning. Supervised and unsupervised learning.

2. Introduction: The supervised learning problem, Classes of models, Losses, Probabilistic models and assumptions on the data.  Regression and Classification.

3. When is a model good?  Model complexity, bias variance tradeoff/generalization (VC dimension, generalization error), Cross Validation.

4. Models for Regression: Linear Regression, linear-in-the-parameters models, regularization.

5. Simple Models for Classification: Logistic Regression, Perceptron, Naïve Bayes Classifier

6. Kernel Methods: Support Vector Machines.

7. Random Forests

8. Neural Networks

9. Deep Learning: Convolutional Neural Networks, advanced models

10. Unsupervised learning: Cluster analysis, Linkage-based clustering, K-means Clustering.

11. Dimensionality reduction: Principal Component Analysis (PCA).

Laboratories:

1. Introduction to Python

2. Linear models for regression and classification

3. Support Vector Machines

4. Neural Networks

5. Deep Learning with Keras

  - Shalev-Shwartz, Shai; Ben-David, Shai, Understanding machine learning: From theory to algorithms, Cambridge University Press, 2014.

  - Slides and other material will also be provided by the instructor.