Theory of Computation 2022
Date: Tuesday December 20th, 13h-16h, D501
The exam consists out of 8 exercises that you must solve in 3 hours time.
There will be copies of Sipser's book available (as well as Arora and Barak and Mertens and Moore). You may bring your own copy if you have it, as well as handwritten notes.
Feedback exam: Friday 30.12 at 14h on zoom
Seminars: Monday 14:40 - 16:00 in Pokrovkaya and on zoom by Pavel Zakharov
Dates and Deadlines
Homeworks 1, 2, 3:
September 26 October 3 (update of 2.7 and 3.7 on 26/09)
Homeworks 4, 5: October 10
Homeworks 6, 7, 8: November 7
Homeworks 9, 10, 11: November 28
Submit homework in google classroom in this link, code: 27kcgjp You should upload either scanned handwriting or pdf file into the corresponding section.
Table with grades
The main reference is Sipser's book "Introduction to the theory of computation", chapters 3, 4, 7–10.
For students abroad: the first 5 lectures are covered in chapters 3, 4, 7 and 9.1. Other lectures will be recorded. See also recordings of previous year.
|05.09||Turing machines, multitape Turing machines, connection between them. Universal Turing machine. Examples. Time and space complexity. Complexity classes P, PSPACE, EXP.||Problem set 1|
|12.09||Time and space hierarchy theorems. Time and space constructible functions.||Problem set 2 update 26.09|
|19.09||Because of various problems, the materials of last 2 weeks were repeated.||Problem set 3 update 25.09|
|26.09||Complexity class NP. Examples. Polynomial reductions. NP-hardness and NP-completeness.||Problem set 4|
|3.10||Non-deterministic TMs. Another definition of NP. Proving NP-hardness by reduction from an NP-complete problem. Examples of NP-complete problems. HAMPATH is NP-complete||Problem set 5|
|10.10||Circuit complexity. Classes AC^i, NC^i, P/poly. All functions are computed by circuits. Existence of functions with exponential circuit complexity. NC1 = Boolean formulas of polynomial size. P is in P/poly. Addition in AC0. Multiplication is in NC1. circuit_notes.pdf||Problem set 6|
|17.10||Classes L, NL, PSPACE and NPSPACE. Inclusions between P, NP, and PSPACE. Cook–Levin theorem, NP-completeness of: subsetsum, set-splitting, 3-colorability and exactly 1-in-3 SAT.||Problem set 7|
|31.10||Directed Reachability is in SPACE(log^2 n). TQBF problem, its PSPACE-completeness. PSPACE = NPSPACE. NSPACE(s(n)) is in SPACE(s(n)^2) for space constructible s. PSPACE completeness of generalized geography.||Problem set 8|
|07.11||Oracle computation definitions. There exists an oracle A for which PA = NPA. There is an oracle B such that PB is not equal to NPB.||Problem set 9update 23.11|
|14.11||Probabilistic computation. Probabilistic machines, the class BPP, invariance of the definition BPP for different thresholds, RP, coRP, PP, ZPP. BPP is in P/poly. Most of it is also here||Problem set 10|
|21.11||Streaming algorithms: finding the majority element, computation of the number of different elements in logarithmic space. See Chapts 6.1-6.2 in foundations of datascience by Avrim Blum and others. Another nice chapter in Tim Roughgarden's lecture notes||Problem set 11 update 21.11|
|28.11||More streaming algorithms: calculation F_0 moments, Hash functions, finding the frequent items in streams of data: SpaceSaving.||Problem set 12|
|12.12||Approximation algorithms and complexity of clustering Slides.||Sample exam|
For interested students: parameterized complexity. We review topics from chapters 1, 2, 3, 13 in "Parameterized algorithms" by Cygan, Fomin and others, 2016.
19 Sept: Fixed parameter tracktability and examples. Kernels. presentation.
26 Sept: feedback vertex set, linear programming kernel for vertex cover, k-path problem, exercises on chapters 2 and 3.
Project (for PI students)
During the 3rd module Januari till March 2023. The task is to understand a theoretical paper better by either
(Th) Rewrite some mathematical proof of a research paper in a more accessible way using your own words. You also need to give a lecture (you are not allowed to look at the paper during the lecture). I need to work out examples. Possibly examples that I give you on the spot.
(Imp) Implement an algorithm (or parts of an algorithm) from a research paper and demonstrate that it works.
Here are examples of each type concerning the vertex cover problem:
(Th) prove lemma 4.1 of the paper https://epubs.siam.org/doi/pdf/10.1137/1.9781611973402.127 , you need to study some parameterized complexity, see below the table with course materials for references.
(Th) prove theorem 5 from https://www.researchgate.net/profile/Lars-Jaffke/publication/329181540_What_is_known_about_Vertex_Cover_Kernelization/links/5cb319df92851c8d22ea17b6/What-is-known-about-Vertex-Cover-Kernelization.pdf
(Imp) implement a kernel and a simple branch and bound variant from https://arxiv.org/pdf/1908.06795.pdf, as well as compare your algorithm with the results in the contest https://pacechallenge.org/2019/vc/vc_exact/
You can propose projects yourself, but it is not allowed to have a theoretical paper about software verification. (Because there are too many definitions, and during the lecture it usually turns out the student does not understand them.)
Both books contain a lot of extra materials and describe more recent discoveries in computational complexity. The first book has a gentel and pleasant style. The second book is a rigurous textbook for students theoretical computer science at the beginning master level.
C. Moore and S. Mertens, The nature of computation, 2011.
S. Arora and B. Barak, Computational Complexity: A Modern Approach, 2009.
For AMI students:
Final score = 0.35 * [score homework] + 0.35 * [score colloquium] + 0.3 * [score exam]
For PI students (the course is called "computational complexity" and takes 3 modules):
Final score = 0.25 * [score homework] + 0.25 * [score colloquium] + 0.25 * [score exam] + 0.25 * [score project]
Some homework assignments contain extra problems. Each solution of an extra problem will give 1 extra point on the final exam. There will be around 6 extra problems.
December 5, 13h00 -- 16h00, room D206 (room D102 after 14h40)
rules and questions (updated 25.11)
Bruno Bauwens: Mondays 14h30-20h. Fridays 18h-20h.
Alexey Talambutsa: First contact by email.