Neurobayesian models 2020
Lector: Dmitry Vetrov
Contacts: All the questions should be addressed to email@example.com. Subject line of any letter must contain the following tag: [HSE NBM20]. Letters without the tag will be most probably lost in the inbox.
We also have a chat in Telegram (invite TBA). Its main language is English. All important news will be announced in the chat.
This course is devoted to Bayesian reasoning in application to deep learning models. Attendees would learn how to use probabilistic modeling to construct neural generative and discriminative models, how to use the paradigm of generative adversarial networks to perform approximate Bayesian inference and how to model the uncertainty about the weights of neural networks. Selected open problems in the field of deep learning would also be discussed. The practical assignments will cover implementation of several modern Bayesian deep learning models.
Course syllabus TBA
- The course contains four practical assignments. Solutions should be submitted to anytask (url TBA). To get the invite, please write to the course e-mail. The site has an interface only in Russian, so non-Russian speaking students may submit their solutions to the course e-mail. In this case, the subject line of the letter in addition to the tag should contain your name, surname and assignment number.
- All assignments should be coded in Python 3 using PyTorch.
- Students have to complete all assignments by themselves. Using code of your colleagues or code from open implementations is prohibited and will be considered as plagiarism. All involved students (including those who shared their solutions) will be severely punished.
- Assignments are scored up to TBA. Each assignment has a deadline, a penalty is charged in the amount of 0.3 points for each day of delay, but in total not more than 6 points. Usually you will have 2 weeks to solve an assignment. Some assignments may contain bonus parts.
Approximate dates of assignments' upload: TBA
A hard deadline for all assignments: TBA
- Murphy K.P. Machine Learning: A Probabilistic Perspective. The MIT Press, 2012.
- Bishop C.M. Pattern Recognition and Machine Learning. Springer, 2006.
- Mackay D.J.C. Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003.
- Ian Goodfellow, Yoshua Bengio & Aaron Courville. Deep Learning. MIT Press, 2016.