CMSC 39600: Derandomizing Space-Bounded Computation (Winter 2025)
Full Course Title: "Topics in Theoretical Computer Science: Derandomizing Space-Bounded Computation"
Term: Winter 2025 at the University of Chicago
Instructor: William Hoza (williamhoza@uchicago.edu)
Meetings: Tuesdays and Thursdays | 2:00pm - 3:20pm | JCL 011
Office Hours: Tuesdays | 3:30pm - 4:45pm | JCL 311
Jump to: (loading...)
Course Description
What is the relationship between space complexity and randomness? Both space and random bits can be considered "expensive" computational resources, so it is desirable to use as little of each as possible. One of the major goals of computational complexity theory is to prove that every randomized decision algorithm can be "derandomized" (i.e., converted into a deterministic algorithm) without increasing its space complexity by more than a constant factor. Complexity theorists have made a great deal of progress toward proving this conjecture over the past several decades, and it is an active and exciting area of research today. In this seminar course, we will study both classic and cutting-edge work on this problem and closely related problems. This will involve topics such as pseudorandom generators, expander graphs, Laplacian solvers, and the Fourier analysis of Boolean functions.
This is a graduate-level, research-oriented course. My intention is that this course will prepare you to conduct original research on the derandomization of space-bounded computation. If you're an undergraduate student and you want to take this course, you'll need to discuss it with me and get approval. If you're a graduate student, there are no firm prerequisites, but it would be helpful to have some familiarity with computational complexity theory and probability theory. The course does not have a textbook per se, but the following surveys might be helpful:
- Pooya Hatami and William M. Hoza. Paradigms for Unconditional Pseudorandom Generators. FnT TCS 2024.
- William M. Hoza. Recent Progress on Derandomizing Space-Bounded Computation. BEATCS 2022.
- Salil Vadhan. Pseudorandomness. FnT TCS 2012.
- Michael Saks. Randomization and Derandomization in Space-Bounded Computation. CCC 1996.
Course Timeline
(The information below will be updated throughout the quarter.)
Tuesday 1/7: Random walks in undirected graphs; the expansion parameter $\lambda(G)$. Reading:
|
Thursday 1/9: The complexity class $\mathsf{BPL}$; variants of the model; $\mathsf{BPL}$ algorithms run in polynomial time; expander graphs. Reading:
|
Tuesday 1/14: The expander mixing lemma; the INW pseudorandom generator. Reading:
|
Thursday 1/16: The expander decomposition lemma; the derandomized square operation; undirected connectivity is in $\mathsf{L}$. Reading:
|
Tuesday 1/21: Undirected connectivity is in $\mathsf{L}$ (continued); standard-order ROBPs can be simulated by standard-order regular ROBPs. Reading (regarding the reduction to regular ROBPs):
|
Thursday 1/23: The BRRY analysis of the INW generator on regular ROBPs; basics of Boolean Fourier analysis. Reading:
|
Tuesday 1/28: Arbitrary-order ROBPs; the Forbes-Kelley PRG. Reading:
|
Thursday 1/30: Small-bias generators; simplification of read-once CNFs under mild random restrictions; iterated restrictions with early termination; near-optimal PRGs for read-once CNFs. Reading:
|
Tuesday 2/4: [Student presentations.] |
Thursday 2/6: [Student presentations.] |
Tuesday 2/11: [Student presentations.] |
Thursday 2/13: |
Tuesday 2/18: |
Thursday 2/20: |
Tuesday 2/25: |
Thursday 2/27: |
Tuesday 3/4: |
Thursday 3/6: |
Finals week: |
Student Presentations
As part of this course, you will study two research papers on your own and present them to the class. The first presentation will be near the middle of the quarter, and the second presentation will be near the end of the quarter. You should think of your classmates as your target audience. Further details will be determined later, based in part on the number of students who enroll in the course.
Each presentation should be 30-35 minutes, which will give us a few minutes for questions. For each presentation, I encourage you to pick just one theorem from your paper to focus on. Start your presentation by clearly explaining what the theorem says and why it matters. Then tell us something about the proof. You won't have enough time to present all the details of the proof, and that's okay. You could give us a high-level overview of the proof as a whole, or you could present a detailed proof of a single interesting lemma. You can use the whiteboard or you can use slides, whichever you prefer. I encourage you to practice your presentation at least once on your own time.
You get to choose your papers from the two lists below, with the caveat that if two students choose the same paper, then one of them will need to do a different paper instead. (I will coordinate the paper selection process.) With approval, you can select papers that are not on the lists.
You can use the UChicago library proxy server to access papers that are behind paywalls. I've linked to the most "official" versions available of the papers below, but you might want to also look for other versions, such as ECCC preprints.
Round 1 (mid-quarter) presentation papers:
- Harm Derksen, Peter Ivanov, Chin Ho Lee, and Emanuele Viola. Pseudorandomness, Symmetry, Smoothing: I. CCC 2024.
- Lijie Chen, Xin Lyu, Avishay Tal, and Hongxun Wu. New PRGs for Unbounded-Width/Adaptive-Order Read-Once Branching Programs. ICALP 2023.
- Chin Ho Lee, Edward Pyne, and Salil Vadhan. Fourier Growth of Regular Branching Programs. RANDOM 2022.
- William M. Hoza, Edward Pyne, and Salil Vadhan. Limitations of the Impagliazzo-Nisan-Wigderson Pseudorandom Generator Against Permutation Branching Programs. COCOON 2021 [Pyne-Vadhan], Algorithmica 2024.
- Dean Doron, Raghu Meka, Omer Reingold, Avishay Tal, and Salil Vadhan. Pseudorandom Generators for Read-Once Monotone Branching Programs. RANDOM 2021.
- William M. Hoza, Edward Pyne, and Salil Vadhan. Pseudorandom Generators for Unbounded-Width Permutation Branching Programs. ITCS 2021.
- Dean Doron, Pooya Hatami, and William M. Hoza. Log-Seed Pseudorandom Generators via Iterated Restrictions. CCC 2020.
- Chin Ho Lee. Fourier Bounds and Pseudorandom Generators for Product Tests. CCC 2019.
- Raghu Meka, Omer Reingold, and Avishay Tal. Pseudorandom Generators for Width-3 Branching Programs. STOC 2019.
- Eshan Chattopadhyay, Pooya Hatami, Kaave Hosseini, and Shachar Lovett. Pseudorandom Generators from Polarizing Random Walks. CCC 2018, ToC 2019.
- Eshan Chattopadhyay, Pooya Hatami, Omer Reingold, and Avishay Tal. Improved Pseudorandom Generators for Unordered Branching Programs through Local Monotonicity. STOC 2018.
- Parikshit Gopalan, Daniel M. Kane, and Raghu Meka. Pseudorandomness via the Discrete Fourier Transform. FOCS 2015, SICOMP 2018.
- Thomas Steinke. Pseudorandomness for Permutation Branching Programs Without the Group Theory. ECCC 2012.
- Noam Nisan and David Zuckerman. Randomness is Linear in Space. STOC 1993, JCSS 1996.
Round 2 (end-of-quarter) presentation papers:
- Dean Doron and William M. Hoza. Implications of Better PRGs for Permutation Branching Programs. ECCC 2024.
- Gil Cohen, Dean Doron, Tomer Manket, Edward Pyne, Yichuan Wang, and Tal Yankovitz. A Study of Error Reduction Polynomials. ECCC 2024.
- Kuan Cheng and Yichuan Wang. $\mathsf{BPL} \subseteq \mathsf{L}\text{-}\mathsf{AC}^1$. CCC 2024.
- Edward Pyne. Derandomizing Logspace with a Small Shared Hard Drive. CCC 2024.
- Eshan Chattopadhyay and Jyun-Jie Liao. Recursive Error Reduction for Regular Branching Programs. ITCS 2024.
- Lijie Chen, William M. Hoza, Xin Lyu, Avishay Tal, and Hongxun Wu. Weighted Pseudorandom Generators via Inverse Analysis of Random Walks and Shortcutting. FOCS 2023.
- Edward Pyne, Ran Raz, and Wei Zhan. Certified Hardness vs. Randomness for Log-Space. FOCS 2023.
- Aaron (Louie) Putterman and Edward Pyne. Near-Optimal Derandomization of Medium-Width Branching Programs. STOC 2023.
- Uma Girish, Ran Raz, and Wei Zhan. Is Untrusted Randomness Helpful? ITCS 2023.
- Andrej Bogdanov, William M. Hoza, Gautam Prakriya, and Edward Pyne. Hitting Sets for Regular Branching Programs. CCC 2022.
- William M. Hoza. Better Pseudodistributions and Derandomization for Space-Bounded Computation. RANDOM 2021.
- AmirMahdi Ahmadinejad, Jonathan Kelner, Jack Murtagh, John Peebles, Aaron Sidford, and Salil Vadhan. High-precision Estimation of Random Walks in Small Space. FOCS 2020.
- Ofer Grossman and Yang P. Liu. Reproducibility and Pseudo-Determinism in Log-Space. SODA 2019.
- Nathan Linial, Michael Luby, Michael Saks, and David Zuckerman. Efficient Construction of a Small Hitting Set for Combinatorial Rectangles in High Dimension. STOC 1993, Combinatorica 1997.
Grading Policies
Your grade will be based on class participation (34%) and your two presentations (33% each).
Inclusion and Accessibility
This course, like every course you take, ought to be an enjoyable and enriching experience. You have a right to be treated with respect and a responsibility to treat others with respect. I want all students to be able to fully participate in this course. Let me know if you need an accommodation for any reason, so we can explore possible solutions together. If applicable, please follow the protocols established by UChicago Student Disability Services.
To highlight a few facets of these topics:
- You are encouraged to ask questions in class, and you should make your classmates feel comfortable asking questions in class. There is no shame in not knowing something or not understanding something. Questions make the course better for everyone.
- I am happy to work with any students who are pregnant/parenting to figure out the best way to make the course work for you.
- Computer scientists and mathematicians can come from many diverse backgrounds, and nobody should experience prejudice or discrimination in this course.