(INFO5161 & MATH5107)
Course CR15 of the M2SIF joint with the joint Master of Advanced Mathematics, Probability & Statistics Track.
Links
- Student registration and more : on official course page
- Up to date information, presence sheet, on the M2SIF pad (password protected)
- Course page maintained by Aurélien Garivier
Lecturers
Guillaume Aubrun, Aurélien Garivier, Rémi Gribonval
Course description
This course will introduce the notion of concentration of measure and highlight its applications, notably in high dimensional data processing and machine learning. The course will start from deviations inequalities for averages of independent variables, and illustrate their interest for the analysis of random graphs and random projections for dimension reduction. It will then be shown how other high-dimensional random functions concentrate, and what guarantees this concentration yields for randomized algorithms and machine learning procedures to learn from large training collections.
Prerequisite
Basic knowledge of probability theory, linear algebra and analysis over the reals.
Evaluation
Homework, in-class exercices and final exam: 50%. Presentation of a research article: 50% (details to come)
Bibliography
- Concentration Inequalities, by Stéphane Boucheron, Pascal Massart and Gabor Lugosi
- High-Dimensional Probability – An Introduction with Applications in Data Science, by Roman Vershynin
- Understanding Machine Learning, From Theory to Algorithms, by Shai Shalev-Shwartz and Shai Ben-David
- Foundations of Machine Learning by Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar
Course outline and rooms (2020-2021):
Rooms and schedule subject to change, in particular depending on the Covid-19 situation.
Weekly schedule: Mondays 13:30-15:30, Fridays 10:15-12:15
Up to date schedule on course page maintained by Aurélien Garivier