Lecture Topics
 |
|
Lecture Activities
- Watch the Lecture 16: Markov Chains - I Video by Prof. Tsitsiklis (00:52:06)
- Review the Lecture 16: Markov Chains - I Slides (PDF)
- Read Sections 7.1–7.2 in the textbook
Recitation Problems and Recitation Help Videos
Review the recitation problems in the PDF file below and try to solve them on your own. Two of the problems have an accompanying video where a teaching assistant solves the same problem.
Recitation Help Videos
| PROBLEM # | PROBLEM TITLE | PROBLEM SOLVED BY |
|---|---|---|
| 1 | Setting Up a Markov Chain (00:10:36) | Jimmy Li |
| 3 | Markov Chain Practice 1 (00:11:41) | Qing He |
Tutorial Problems
Review the tutorial problems in the PDF file below and try to solve them on your own.
- Tutorial 9 Problems (PDF) Do ONLY Problems 1 and 2
- Tutorial 9 Solutions (PDF)