Просмотр исходного текста страницы Глубинное обучение 2 2025

== Общая информация ==
Курс предназначен для студентов 4 курса ФКН ПМИ (МОП и КНАД).

Занятия проходят '''по понедельникам 14:40-17:40''' (переносы будут сообщаться в чате).


Полезные ссылки:
* Чат с обсуждением: https://t.me/+8dcjl4gHlyEwYzcy
* Репозиторий курса: https://github.com/thecrazymage/DL2_HSE
* Таблица с оценками: https://docs.google.com/spreadsheets/d/18rfZbf7Zsm-xmbiQn_eJVDXXbDfesbHT/edit?usp=sharing&ouid=115132401804687564737&rtpof=true&sd=true
* Anytask: https://anytask.org/course/1219


Формула итоговой оценки (округление арифметическое):
# МОП:        О<sub>итог</sub> = 0.25 * О<sub>соревнование</sub> + 0.75 * О<sub>ДЗ</sub>,
# КНАД:       О<sub>итог</sub> = О<sub>ДЗ</sub>,
где О<sub>ДЗ</sub> - средняя оценка за практические домашние задания.

== Преподаватели и ассистенты ==

Кому писать, если кажется, что все пропало: [https://t.me/MishanAliev Мишан Алиев]

{| class="wikitable"
|-
! Группа !! Семинарист !! Ассистенты !! Чаты групп !! Инвайт в anytask
|-
| 221 (МОП) || [https://t.me/mightyneighbor Федя Великонивцев] || [https://t.me/vsem_paket Динар Саберов], [https://t.me/annvasileeva Анна Василева] || [https://t.me/+XzlFh0Y8GHs3NTMy МОП 221] || yvZZTIS
|-
| 222 (МОП) || [https://t.me/cocosinca Ева Неудачина] || [https://t.me/mat_os Александр Матосян], [https://t.me/kade1shvili Полина Кадейшвили] || [https://t.me/+PpxiIpF7wLYyMjE6 МОП 222] || W38CfZf
|-
| 223 (МОП) || [https://t.me/tutugarin Иван Ершов] || [https://t.me/Andrew_ut Андрей Уткин], [https://t.me/uzhedevyat Георгий Фатахов] || [https://t.me/+xRZkDO4TjiA1YjQ6 МОП 223] || ph91Jlz
|-
| 224 (МОП) || [https://t.me/Stepyndriy Степан Беляков] || [https://t.me/ponomarchuk_anna Анна Пономарчук], [https://t.me/bogsolntca Татьяна Яковлева] || [https://t.me/+XtcOG352A-IxMmY6 МОП 224] || iPwd342
|-
| КНАД || [https://t.me/burakevi4 Даня Бураков] || [https://t.me/anapluslap Анастасия Лапшина], [https://t.me/irbix7 Иван Галий] || [https://t.me/+JNPUgVxh6ophOGQy КНАД] || zTn4sRP
|}

== Лекции и семинары ==

'''Лекция / Семинар 1 (08.09).''' 

<u>Тема:</u> Essentials of GPU, Deep Learning Bottlenecks, and Benchmarking Basics

<u>Аннотация:</u> In this session, we will explore the reasons behind the dominance of GPUs in Deep Learning and examine the common sources of performance bottlenecks in DL code. You will learn how to identify these bottlenecks using profiling tools and apply techniques to optimize and accelerate your code.

<u>Лектор и семинарист:</u> [https://www.hse.ru/org/persons/816100677/ Fedor Velikonivtsev]

<u>Локация:</u> лекция - R208, семинар - D102.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_01.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_01.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_01 материалы].


'''Лекция / Семинар 2 (15.09).''' 

<u>Тема:</u> On Transformers and Bitter Lesson

<u>Аннотация:</u> In this talk we’ll dive into the landscape of model architectures in deep learning, with a focus on the world around transformers. We’ll briefly recall what a transformer is, trace the evolution from encoder–decoder to encoder-only and decoder-only models, and touch on the rise of “efficient mixers” such as state space models, linear attention, and beyond. We’ll conclude by reflecting on the role of data and compute. The lecture is inspired in part by [http://incompleteideas.net/IncIdeas/BitterLesson.html The Bitter Lesson] and blends a brain dump with some entertaining insights from recent years of architectural exploration.

<u>Лектор и семинарист:</u> [https://www.hse.ru/org/persons/190912012/ Ivan Rubachev]

<u>Локация:</u> лекция - R206, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture%2Bseminar_02.mp4 запись лекции и семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_02 материалы].


'''Лекция / Семинар 3 (22.09).''' 

<u>Тема:</u> Modern LLMs essentials

<u>Аннотация лекции:</u> This week, we will discuss LLMs. We will discuss why they are so effective for text generation, how they can be applied to different NLP problems, and the risks they pose. You will learn the details of RLHF, PEFT, and RAG, which make LLMs robust in various cases.

<u>Лектор:</u> [https://www.hse.ru/org/persons/208533329/ Alexander Shabalin]

<u>Локация:</u> онлайн.


<u>Аннотация семинара:</u> In this seminar, we will explore the concept of LLM-based agents and how they extend the capabilities of modern language models. We will discuss function calling as a way to integrate external tools, chain-of-thought reasoning for structured problem solving, and reinforcement learning techniques for training agents.

<u>Семинарист:</u> [http://www.instagram.com/tugarin_vanya Ivan Ershov]

<u>Локация:</u> R208.


<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_03.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_03.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_03 материалы].


'''Лекция / Семинар 4 (29.09).''' 

<u>Тема:</u> Basics of Efficient LLM Training Infrastructure

<u>Аннотация:</u> In this lecture, we will study the basic rules that underpin the infrastructure for efficient large language model training. We will also examine common problems that may arise in this process and explore practical ways to address them.

<u>Лектор и семинарист:</u> [https://habr.com/ru/users/MichaelEk/ Michael Khrushchev]

<u>Локация:</u> лекция - G002, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture%2Bseminar_04.mp4 запись лекции и семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_04 материалы].


'''Лекция / Семинар 5 (06.10).''' 

<u>Тема:</u> Segmentation and Detection

<u>Аннотация лекции:</u> This week, we'll explore the evolution of object detection and segmentation — from R-CNN to real-time methods like YOLO-World and CLIP-based approaches. We'll examine how U-Net architectures have transcended computer vision to power neural operators and how to use diffusion models for segmentation tasks.

<u>Аннотация семинара:</u> We will implement architectures and train a semantic segmentation model. We will discuss regularization methods for convolutional layers. In addition, we will learn how to use pre-trained models and apply them.

<u>Лектор и семинарист:</u> [https://www.hse.ru/org/persons/956617478/ Alexander Oganov]

<u>Локация:</u> лекция - G002, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_05.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_05.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_05 материалы].


'''Лекция / Семинар 6 (13.10).''' 

<u>Тема:</u> Segmentation and Detection 2

<u>Аннотация лекции и семинара:</u> In this lecture, we will continue in more detail about segmentation and detection.

<u>Лектор:</u> [https://szagoruyko.github.io/ Sergey Zagoruyko]

<u>Семинарист:</u> [https://www.hse.ru/org/persons/401628708/ Eva Neudachina]

<u>Локация:</u> лекция - G002, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_06.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_06.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_06 материалы].


'''Лекция / Семинар 7 (20.10).''' 

<u>Тема:</u> Diffusion models 1

<u>Аннотация лекции и семинара:</u> Tomorrow's lecture and seminar will be devoted to an introduction to diffusion models. Diffusion models are currently the most popular approach to generative modeling due to their high-quality generation and diversity (mode coverage) of the learned distribution. The idea behind diffusion models is to consider the process of gradually transforming data into pure noise and construct its inverse in time, which will transform noise into data. In the lecture and seminar, we will work with noise processes and derive the classic [https://arxiv.org/abs/2006.11239 DDPM] model, which proposes to minimize the KL-divergence between the “true” reverse process that converts noise into data and the denoising process specified by the neural network. In the process, we will see that this procedure is equivalent to training a denoiser neural network that predicts a clean object from a noisy one. In addition, we will interpret the resulting denoising process: in it, each step corresponds to replacing part of the current noisy image with an (increasingly high-quality) prediction of the denoiser.

<u>Лектор и семинарист:</u> [https://www.hse.ru/org/persons/190910999/ Denis Rakitin]

<u>Локация:</u> лекция - G002, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_07.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_07.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_07 материалы].


'''Лекция / Семинар 8 (03.11).''' 

<u>Тема:</u> Diffusion models 2

<u>Аннотация лекции и семинара:</u> In this lecture and seminar, we will continue our exploration of diffusion models. We will introduce the score function and score identity, present classifier and classifier-free guidance, and derive DDIM model.

<u>Лектор и семинарист:</u> [https://www.hse.ru/org/persons/190910999/ Denis Rakitin]

<u>Локация:</u> лекция - R205, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_08.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_08.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_08 материалы].


'''Лекция / Семинар 9 (10.11).''' 

<u>Тема:</u> Diffusion models 3

<u>Аннотация лекции:</u> This lecture presents applied aspects of diffusion models, a class of generative methods that have demonstrated strong performance across images, text, and audio. We will review modern architectures, with a focus on [https://github.com/black-forest-labs/flux FLUX], and unpack the key principles of their design and training.

<u>Лектор:</u> [https://scholar.google.com/citations?user=o6pRm_gAAAAJ&hl=ru Nikita Starodubcev]

<u>Аннотация семинара:</u> The seminar will provide a hands-on, in-depth inspection of [https://github.com/PixArt-alpha/PixArt-alpha PixArt] model. Then ee will attempt further fine-tuning via [https://dreambooth.github.io/ DreamBooth], review common evaluation metrics, and compare different models and configurations.

<u>Семинарист:</u> [https://www.hse.ru/org/persons/401628708/ Eva Neudachina]

<u>Локация:</u> лекция - R205, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_09.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_09.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_09 материалы].


'''Лекция / Семинар 10 (17.11).''' 

<u>Тема:</u> 3D CV

<u>Аннотация лекции и семинара:</u> This lecture and seminar will discuss how diffusion models can be used for 3D computer vision tasks such as generation and reconstruction, and how they relate to methods like NeRF and Gaussian splatting. We will also look at how these models can be applied to problems like novel view synthesis, relighting, and camera pose or depth estimation.

<u>Лектор и семинарист:</u> [https://www.hse.ru/org/persons/885876805/ Mishan Aliev]

<u>Локация:</u> лекция - R205, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_10.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_10.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_10 материалы].


'''Лекция / Семинар 11 (24.11).''' 

<u>Тема:</u> Neural Recommender Systems

<u>Аннотация лекции и семинара:</u> Modern recommender systems also make heavy use of deep learning — both discriminative and generative models. A system has to understand content (tracks, products, videos, etc.), model user behavior (short- and long-term preferences), and predict which content each user is likely to enjoy. At the same time, recommender systems come with their own challenges: cold start for new items and users, huge billion-scale item catalogs with heavy-tailed popularity distributions (popularity bias), and constant distribution drift, where all the underlying distributions keep changing along with the rest of the world. We will discuss: 1) Two-tower neural networks for candidate generation; 2) Sequential recommendation and more modern approaches to generative modeling of users; 3) Semantic IDs and tuning LLMs for recommendation 4) What makes the recommendation domain different from other deep learning domains.

<u>Лектор:</u> [https://www.hse.ru/org/persons/1085421573/ Kirill Khrylchenko]

<u>Семинарист:</u> [https://www.linkedin.com/in/artem-matveev-7b2725255/ Artem Matveev]

<u>Локация:</u> лекция - R205, семинар - R208.

<u>Материалы:</u> [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/lecture_11.mp4 запись лекции], [https://disk.yandex.ru/d/mzXlT0U3MzEZkQ/%D0%9F%D0%9C%D0%98/DL%202/seminar_11.mp4 запись семинара], [https://github.com/thecrazymage/DL2_HSE/tree/main/week_11 материалы].

== Домашние задания ==

{| class="wikitable"
! № !! Домашнее задание !! Ссылка !! Дедлайн (жёсткий)
|-
| 1 || Tensor and DL Libraries || https://github.com/thecrazymage/DL2_HSE/tree/main/homeworks/homework_01 || 30 сентября, 23:59
|-
| 2 || Transformers for Named Entity Recognition || https://github.com/thecrazymage/DL2_HSE/tree/main/homeworks/homework_02 || 14 октября, 23:59
|-
| 3 || Image Segmentation || https://github.com/thecrazymage/DL2_HSE/tree/main/homeworks/homework_03 || 2 ноября, 23:59
|-
| 4 || Diffusion Models || https://github.com/thecrazymage/DL2_HSE/tree/main/homeworks/homework_04 || 18 ноября, 23:59
|-
| 5 || Retrieval || https://github.com/thecrazymage/DL2_HSE/tree/main/homeworks/homework_05 || 10 декабря, 23:59

|}

== Соревнование ==

'''Задание:''' https://github.com/thecrazymage/DL2_HSE/tree/main/homeworks/competition

'''Возможность перезачета:''' https://t.me/c/2969026465/2/1601.

'''Дедлайн (жёсткий):''' 19 декабря 2025, 23:59