CS446/ECE449: Machine Learning (Fall 2026)
Course Information
The goal of Machine Learning is to find structure in data. In this course we will cover three main areas, (1) supervised learning, (2) unsupervised learning, and (3) reinforcement learning models. In particular we will cover the following: perceptron, decision trees, Naive Bayes, Gaussian Bayes, linear regression, logistic regression, support vector machines, deep nets, structured methods, learning theory, kMeans, Gaussian mixtures, expectation maximization, VAEs, GANs, Markov decision processes, Q-learning and Reinforce.Pre-requisites: Probability, linear algebra, and proficiency in Python.
Recommended Text: (1) Machine Learning: A Probabilistic Perspective by Kevin Murphy, (2) Machine Learning, Tom Mitchell, (3) Pattern Recognition and Machine Learning by Christopher Bishop, (4) The Elements of Statistical Learning: Data Mining, Inference, and Prediction by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie.
Course Deliverables:
(1) Homework, see below for dates
(2) Midterm
(3) Final
Grading:
3 credit: Homework 60% (drop 1 homework), Midterm 20%, Final 20%
4 credit: Homework 60% (drop 0 homework), Midterm 20%, Final 20%
Grading policy is subject to change.
Late Policy: 3 late days in total.
Instructor & TAs
Siyin Wang
Teaching AssistantEmail: ziyin[at]illinois.edu
Sirui Xu
Teaching AssistantEmail: siruixu2[at]illinois.edu
Yucheng Zhang
Teaching AssistantEmail: yx90[at]illinois.edu
Dayuan Zhao
Teaching AssistantEmail: dayuan[at]illinois.edu
Lusen Zhao
Teaching AssistantEmail: lusenz2[at]illinois.edu
Logistics
Class Location: CourseraOffice Hours: [link] Monday: 4-5 PM CT (by TA); Tuesday: 8-9 PM CT (by TA); Wednesday: 9-10 AM CT (by TA); Thursday: 8-9 PM CT (by TA); Friday: 2-3 PM CT (by instructor); 4-5 PM CT (by TA)
Campuswire for discussions: [link] (code in class email)
GradeScope for assignments : [link] (code in class email)
Lectures
The syllabus is subject to change.
| Event | Date | Description | Slides | References | ||
|---|---|---|---|---|---|---|
| Lecture 1 | 08/24/2026 | Introduction | [Slides] | |||
| Lecture 2 | 08/26/2026 | kNN | [Slides] | Bishop: Sec 2.5; Murphy: Sec 1.4 | ||
| Assignment Released | 08/26/2026 | Assignment 0 | ||||
| Assignment Released | 08/30/2026 | Assignment 1 | ||||
| Lecture 3 | 08/31/2026 | Perceptron | [Slides] | The Perceptron | ||
| Lecture 4 | 09/02/2026 | PyTorch Tutorial | ||||
| Lecture 5 | 09/07/2026 | Probability and Estimation | [Slides] | Mitchell: Chapter 2, Goodfellow et al.: Chapter 3 | ||
| Lecture 6 | 09/09/2026 | Naive Bayes | [Slides] | Mitchell: Chapter 3 | ||
| Assignment Due | 09/09/2026 | Assignment 0 Due (11:59AM Central Time) | ||||
| Assignment Due | 09/13/2026 | Assignment 1 Due (11:59AM Central Time) | ||||
| Assignment Released | 09/13/2026 | Assignment 2 Released | ||||
| Lecture 7 | 09/14/2026 | Gaussian Naive Bayes | [Slides] | Mitchell: Chapter 3 | ||
| Lecture 8 | 09/16/2026 | Logistic Regression | [Slides] | Mitchell: Chapter 3 | ||
| Lecture 9 | 09/21/2026 | Optimization | [Slides] | Murphy: Sec 8.1,8.2,8.3 | ||
| Lecture 10 | 09/23/2026 | Linear Regression | [Slides] | Murphy: Sec 7, 8.3; Bishop: Sec 9.2 | ||
| Assignment Due | 09/27/2026 | Assignment 2 Due (11:59AM Central Time) | ||||
| Assignment Released | 09/27/2026 | Assignment 3 Released | ||||
| Lecture 11 | 09/28/2026 | SVM | [Slides] | Murphy: Sec 14.5; Bishop: Sec 7.1 | ||
| Lecture 12 | 09/30/2026 | SVM II | [Slides] | Murphy: Sec 14.5; Bishop: Sec 7.1 | ||
| Lecture 13 | 10/05/2026 | Empirical Risk Minimization | [Slides] | |||
| Lecture 14 | 10/07/2026 | Midterm Review | [Slides], [Sample Questions] | |||
| Assignment Due | 10/11/2026 | Assignment 3 Due (11:59AM Central Time) | ||||
| Assignment Released | 10/11/2026 | Assignment 4 Released | ||||
| Exam | 10/12/2026-10/15/2026 (TBD) | Midterm Exam | ||||
| Lecture 15 | 10/19/2026 | Bias-Variance Tradeoff | [Slides] | |||
| Lecture 16 | 10/21/2026 | Model Selection | [Slides] | |||
| Lecture 17 | 10/26/2026 | Kernels | [Slides] | Bishop: Sec 6.1, 6.2 | ||
| Lecture 18 | 10/28/2026 | Kernels II | [Slides] | Bishop: Sec 6.1, 6.2 | ||
| Assignment Due | 11/01/2026 | Assignment 4 Due (11:59AM Central Time) | ||||
| Assignment Released | 11/01/2026 | Assignment 5 Released | ||||
| Lecture 19 | 11/02/2026 | Decision Tree Learning | [Slides] | Mitchell: 3; Bishop: Sec 14.4 | ||
| Lecture 20 | 11/04/2026 | Ensemble Methods, AdaBoost | [Slides] | Bishop: Sec 14.3, 14.4 | ||
| Lecture 21 | 11/09/2026 | Hierarchical Clustering, K-Means | [Slides] | Murphy, 21.3; Hastie et.al.: Sec 14.3.6, 14.3.7 | ||
| Lecture 22 | 11/11/2026 | PCA, SVD | [Slides] | Murphy, 12.2; Hastie et.al.: Sec 14.5.1, 14.5.2 | ||
| Assignment Due | 11/15/2026 | Assignment 5 Due (11:59AM Central Time) | ||||
| Assignment Released | 11/15/2026 | Assignment 6 Released | ||||
| Lecture 23 | 11/16/2026 | Neural Networks | [Slides] | Goodfellow et al.: Chapter 6.1-6.4 | ||
| Lecture 24 | 11/18/2026 | Deep Learning | [Slides] | Goodfellow et al.: Chapter 6.1-6.5 | ||
| 11/23/2026-11/29/2026 | Fall Break | |||||
| Lecture 25 | 11/30/2026 | Generative Modelling | [Slides-CNNs][Slides-Generative Modelling] | Goodfellow et al.: Chapter 6-9 | ||
| Lecture 26 | 12/02/2026 | Generative Modelling II | [Slides] | |||
| Assignment Due | 12/06/2026 | Assignment 6 Due (11:59AM Central Time) | ||||
| Lecture 27 | 12/07/2026 | Sequential Models | [Slides] | |||
| Lecture 28 | 12/09/2026 | Review | [Slides] | |||
| Exam | 12/11/2026-12/16/2026 (TBD) | Final Exam |
