МОВС MLOps (2023-24 уч. год, 2 модуль) — различия между версиями
м (UPD before sem1) |
(подправлены ссылки по датам) |
||
(не показано 7 промежуточных версии 2 участников) | |||
Строка 32: | Строка 32: | ||
! Занятие !! Тема !! Дата !! Ссылки | ! Занятие !! Тема !! Дата !! Ссылки | ||
|- | |- | ||
− | | style="background:#eaecf0;" | '''1''' [[ Запись]] || [[ Ноутбук]] Intro to MLOps. Python Project Setup, Dependency Management || 21.11.23, Вт. || | + | | style="background:#eaecf0;" | '''1''' [[ Запись]] || [[ Ноутбук]] Intro to MLOps. Python Project Setup, Dependency Management || 21.11.23, Вт. || https://www.youtube.com/watch?v=WVJBNYfud6M&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=1 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''2''' [[ Запись]] || [[ Ноутбук]] Code Management and VCS. Code Quality Tools and CI/CD || 25.11.23, Сб. || | + | | style="background:#eaecf0;" | '''2''' [[ Запись]] || [[ Ноутбук]] Code Management and VCS. Code Quality Tools and CI/CD || 25.11.23, Сб. || https://www.youtube.com/watch?v=6pH-bLD33ig&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=2 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''3''' [[ Запись]] || [[ Ноутбук]] Data Management. DVC Setup || 28.11.23, Вт. || | + | | style="background:#eaecf0;" | '''3''' [[ Запись]] || [[ Ноутбук]] Data Management. DVC Setup || 28.11.23, Вт. || https://www.youtube.com/watch?v=nBsnr3GanAI&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=3 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''4''' [[ Запись]] || [[ Ноутбук]] Logging for Experiments and Production. MLFlow Setup || | + | | style="background:#eaecf0;" | '''4''' [[ Запись]] || [[ Ноутбук]] Logging for Experiments and Production. MLFlow Setup || 09.12.23, Сб. || https://www.youtube.com/watch?v=DivHNbhbJj8&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=4 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''5''' [[ Запись]] || [[ Ноутбук]] Computing Power & Clouds. Moving to Remote Queued Runs || | + | | style="background:#eaecf0;" | '''5''' [[ Запись]] || [[ Ноутбук]] Computing Power & Clouds. Moving to Remote Queued Runs || 16.12.23, Сб. || https://www.youtube.com/watch?v=5nHdd8CIAyM&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=6 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''6''' [[ Запись]] || [[ Ноутбук]] Production Hacks in ML. Practicing kNN Indexes and Quantization || | + | | style="background:#eaecf0;" | '''6''' [[ Запись]] || [[ Ноутбук]] Production Hacks in ML. Practicing kNN Indexes and Quantization || 19.12.23, Сб. || https://www.youtube.com/watch?v=qPc1unz1bO4&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=5 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''7''' [[ Запись]] || [[ Ноутбук]] ''Effective Inference'' || | + | | style="background:#eaecf0;" | '''7''' [[ Запись]] || [[ Ноутбук]] ''Effective Inference'' || 21.12.23, Вт. || https://www.youtube.com/watch?v=ZLt06OIP1Jk&list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c&index=7 |
|- | |- | ||
− | | style="background:#eaecf0;" | '''запасное''' [[ Запись]] || [[ Ноутбук]] || 21.12.23, Чт. || | + | | style="background:#eaecf0;" | '''запасное''' [[ Запись]] || [[ Ноутбук]] || 21.12.23, Чт. || |
|- | |- | ||
|} | |} | ||
Строка 57: | Строка 57: | ||
== Домашние задания == | == Домашние задания == | ||
+ | [https://anytask.org/course/1074 Anytask]: | ||
+ | * (1-й курс) <code></code> | ||
+ | * (2-й курс) <code></code> <br/><br/> | ||
+ | |||
# Poetry Setup | # Poetry Setup | ||
# Code Quality Tools Setup | # Code Quality Tools Setup | ||
Строка 63: | Строка 67: | ||
# Running on Remote Machine | # Running on Remote Machine | ||
# ... | # ... | ||
+ | |||
+ | [https://docs.google.com/document/d/18lgAHGVNruSYuzCLBWzRx33Bh1dvuUACbtu0kFOA7_0/edit Полная формулировка задачи для проекта] | ||
+ | |||
+ | [https://docs.google.com/forms/d/e/1FAIpQLSejilvimE50GaPlx48K0VjiaM_c2CSmOOZRa59roHadR3AaPQ/viewform Форма для сдачи] | ||
== Литература == | == Литература == | ||
* "Machine Learning Engineering" by Andriy Burkov, 2020 | * "Machine Learning Engineering" by Andriy Burkov, 2020 | ||
* "Practical MLOps: Operationalizing Machine Learning Models (2021)", Noah Gift & Alfredo Deza | * "Practical MLOps: Operationalizing Machine Learning Models (2021)", Noah Gift & Alfredo Deza |
Текущая версия на 17:31, 23 декабря 2023
Содержание
О курсе
The MLOps course covers a wide range of topics essential for effectively managing and deploying machine learning projects. It begins with an introduction to MLOps, providing an overview of principles and best practices. Students gain hands-on experience in creating ML projects using Python and learn about containerization using Docker. Code management and version control using Git servers are emphasized, enabling collaborative development. The course explores Continuous Integration and Continuous Deployment (CI/CD) techniques for automating the ML workflow. Data management, including storage, versioning, and management using tools like DVC, is covered. Students learn about experiment logging to track and analyze model performance. The course addresses computational power requirements, cloud-based solutions, and transferring learning to the cloud. Additional topics include knn indices, embeddings quantification, crowdsourcing, data labeling using platforms like Toloka, and an overview of the Amazon SageMaker stack. Talks by students and external lecturers provide practical insights. By course completion, students gain a comprehensive understanding of MLOps principles and practical skills for managing and deploying ML projects.
Занятия проводятся в Zoom по вторникам в 17:30 и субботам в 10:30
Контакты
Чат курса в TG: https://t.me/+VBBJVl19s5BiYmU6
Преподаватель: Гончаренко Владислав, Dzen.ru
Ассистенты
Ассистент | Контакты |
---|---|
Владислав Наумов | @vlad21naumov |
Алексей Макарчук | @alexmak123 |
[1] |
Материалы курса
Плейлист курса на YouTube: https://www.youtube.com/playlist?list=PLmA-1xX7IuzCRcPf_aGos3d2uvAQrd46c
GitHub с материалами курса: GitHub repository
Записи консультаций
Формула оценивания
Оценка = Среднее за домашние задания
Домашние задания
- (1-й курс)
- (2-й курс)
- Poetry Setup
- Code Quality Tools Setup
- DVC Setup
- MLFlow Setup
- Running on Remote Machine
- ...
Полная формулировка задачи для проекта
Литература
- "Machine Learning Engineering" by Andriy Burkov, 2020
- "Practical MLOps: Operationalizing Machine Learning Models (2021)", Noah Gift & Alfredo Deza