Statistical learning theory 2021 — различия между версиями

Материал из Wiki - Факультет компьютерных наук
Перейти к: навигация, поиск
Строка 81: Строка 81:
 
| 23 Nov
 
| 23 Nov
 
|| Dimensionality reduction and the Johnson-Lindenstrauss lemma
 
|| Dimensionality reduction and the Johnson-Lindenstrauss lemma
 +
||
 +
||
 +
|-
 +
| 30 Nov
 +
|| Active learning
 +
||
 +
||
 +
|- 7 or 14 Dec
 +
|| Colloquium
 
||
 
||
 
||
 
||
Строка 178: Строка 187:
 
Foundations of machine learning 2nd ed, Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalker, 2018. This book can be downloaded from http://gen.lib.rus.ec/ .
 
Foundations of machine learning 2nd ed, Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalker, 2018. This book can be downloaded from http://gen.lib.rus.ec/ .
  
For online learning, we also study a few topics from  [http://machinelearning.ru/wiki/index.php?title=%D0%A2%D0%B5%D0%BE%D1%80%D0%B8%D1%8F_%D1%81%D1%82%D0%B0%D1%82%D0%B8%D1%81%D1%82%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%BE%D0%B3%D0%BE_%D0%BE%D0%B1%D1%83%D1%87%D0%B5%D0%BD%D0%B8%D1%8F_(%D0%BA%D1%83%D1%80%D1%81_%D0%BB%D0%B5%D0%BA%D1%86%D0%B8%D0%B9%2C_%D0%9D._%D0%9A._%D0%96%D0%B8%D0%B2%D0%BE%D1%82%D0%BE%D0%B2%D1%81%D0%BA%D0%B8%D0%B9) lecture notes] by Н. К. Животовский
 
  
 
== Office hours ==
 
== Office hours ==
Строка 186: Строка 194:
 
! Person !! Monday !! Tuesday !! Wednesday !! Thursday !! Friday !!  
 
! Person !! Monday !! Tuesday !! Wednesday !! Thursday !! Friday !!  
 
|-
 
|-
|  [https://www.hse.ru/en/org/persons/160550073 Bruno Bauwens], [https://zoom.us/j/5579743402 Zoom] (email in advance) || 14h-18h || 16h15-20h || || || || Room S834 Pokrovkaya 11
+
|  [https://www.hse.ru/en/org/persons/160550073 Bruno Bauwens], [https://zoom.us/j/5579743402 Zoom] (email in advance) ||  || 12h30-14h30 || || || 14h-20h || Room S834 Pokrovkaya 11
 
|-
 
|-
 
|}
 
|}
  
It is always good to send an email in advance. Questions are welcome.
+
It is always good to send an email in advance. Questions and feedback are welcome.
  
 
<!--
 
<!--

Версия 12:37, 2 сентября 2021

General Information

Grading

Teachers: Bruno Bauwens and Nikita Lukianenko

Lectures: Tuesdays 9h30 - 10h50, zoom

Seminars: Tuesday 11h10 - 12h30

Practical information on telegram group


Course materials

Date Summary Lecture notes Problem list Solutions
Part 1. Online learning
7 Sept Introduction, the online mistake bound model, the weighted majority and perceptron algorithms
14 Sept The standard optimal algorithm, prediction with expert advice, exponentially weighted algorithm
21 Sept Better mistake bounds using VC-dimensions. Recap probability theory. Leave on out risk for SVM.
Part 2. Supervised classification
28 Sept Sample complexity in the realizable setting, simple example and bounds using VC-dimension
5 Oct Risk decomposition and the fundamental theorem of statistical learning theory
12 Oct Rademacher complexity
26 Oct Support vector machines and margin risk bounds
2 Nov Kernels: risk bounds, design, and representer theorem
9 Nov AdaBoost and risk bounds
Part 3. Other topics
16 Nov Clustering
23 Nov Dimensionality reduction and the Johnson-Lindenstrauss lemma
30 Nov Active learning
Colloquium


The lectures in October and November are based on the book: Foundations of machine learning 2nd ed, Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalker, 2018. This book can be downloaded from http://gen.lib.rus.ec/ .


Office hours

Person Monday Tuesday Wednesday Thursday Friday
Bruno Bauwens, Zoom (email in advance) 12h30-14h30 14h-20h Room S834 Pokrovkaya 11

It is always good to send an email in advance. Questions and feedback are welcome.