CS446/ECE449: Machine Learning (Fall 2026)

Course Information

The goal of Machine Learning is to find structure in data. In this course we will cover three main areas, (1) supervised learning, (2) unsupervised learning, and (3) reinforcement learning models. In particular we will cover the following: perceptron, decision trees, Naive Bayes, Gaussian Bayes, linear regression, logistic regression, support vector machines, deep nets, structured methods, learning theory, kMeans, Gaussian mixtures, expectation maximization, VAEs, GANs, Markov decision processes, Q-learning and Reinforce.

Pre-requisites: Probability, linear algebra, and proficiency in Python.

Recommended Text: (1) Machine Learning: A Probabilistic Perspective by Kevin Murphy, (2) Machine Learning, Tom Mitchell, (3) Pattern Recognition and Machine Learning by Christopher Bishop, (4) The Elements of Statistical Learning: Data Mining, Inference, and Prediction by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie.

Course Deliverables:
(1) Homework, see below for dates
(2) Midterm
(3) Final

Grading:
3 credit: Homework 60% (drop 1 homework), Midterm 20%, Final 20%
4 credit: Homework 60% (drop 0 homework), Midterm 20%, Final 20%

Grading policy is subject to change.

Late Policy: 3 late days in total.


Instructor & TAs

Liangyan Gui

Instructor
Email: lgui[at]illinois.edu





Siyin Wang

Teaching Assistant
Email: ziyin[at]illinois.edu

Sirui Xu

Teaching Assistant
Email: siruixu2[at]illinois.edu

Yucheng Zhang

Teaching Assistant
Email: yx90[at]illinois.edu





Dayuan Zhao

Teaching Assistant
Email: dayuan[at]illinois.edu

Lusen Zhao

Teaching Assistant
Email: lusenz2[at]illinois.edu

Logistics

Class Location: Coursera
Office Hours: [link] Monday: 4-5 PM CT (by TA); Tuesday: 8-9 PM CT (by TA); Wednesday: 9-10 AM CT (by TA); Thursday: 8-9 PM CT (by TA); Friday: 2-3 PM CT (by instructor); 4-5 PM CT (by TA)
Campuswire for discussions: [link] (code in class email)
GradeScope for assignments : [link] (code in class email)



Lectures

The syllabus is subject to change.

EventDateDescriptionSlides References
Lecture 1 08/24/2026 Introduction [Slides]  
Lecture 2 08/26/2026 kNN [Slides] Bishop: Sec 2.5; Murphy: Sec 1.4
Assignment Released 08/26/2026 Assignment 0  
Assignment Released 08/30/2026 Assignment 1  
Lecture 3 08/31/2026 Perceptron [Slides] The Perceptron
Lecture 4 09/02/2026 PyTorch Tutorial  
Lecture 5 09/07/2026 Probability and Estimation [Slides] Mitchell: Chapter 2, Goodfellow et al.: Chapter 3
Lecture 6 09/09/2026 Naive Bayes [Slides] Mitchell: Chapter 3
Assignment Due 09/09/2026 Assignment 0 Due (11:59AM Central Time)    
Assignment Due 09/13/2026 Assignment 1 Due (11:59AM Central Time)    
Assignment Released 09/13/2026 Assignment 2 Released    
Lecture 7 09/14/2026 Gaussian Naive Bayes [Slides] Mitchell: Chapter 3
Lecture 8 09/16/2026 Logistic Regression [Slides] Mitchell: Chapter 3
Lecture 9 09/21/2026 Optimization [Slides] Murphy: Sec 8.1,8.2,8.3
Lecture 10 09/23/2026 Linear Regression [Slides] Murphy: Sec 7, 8.3; Bishop: Sec 9.2
Assignment Due 09/27/2026 Assignment 2 Due (11:59AM Central Time)    
Assignment Released 09/27/2026 Assignment 3 Released    
Lecture 11 09/28/2026 SVM [Slides] Murphy: Sec 14.5; Bishop: Sec 7.1
Lecture 12 09/30/2026 SVM II [Slides] Murphy: Sec 14.5; Bishop: Sec 7.1
Lecture 13 10/05/2026 Empirical Risk Minimization [Slides]  
Lecture 14 10/07/2026 Midterm Review [Slides], [Sample Questions]  
Assignment Due 10/11/2026 Assignment 3 Due (11:59AM Central Time)    
Assignment Released 10/11/2026 Assignment 4 Released    
Exam 10/12/2026-10/15/2026 (TBD) Midterm Exam    
Lecture 15 10/19/2026 Bias-Variance Tradeoff [Slides]  
Lecture 16 10/21/2026 Model Selection [Slides]    
Lecture 17 10/26/2026 Kernels [Slides] Bishop: Sec 6.1, 6.2
Lecture 18 10/28/2026 Kernels II [Slides] Bishop: Sec 6.1, 6.2
Assignment Due 11/01/2026 Assignment 4 Due (11:59AM Central Time)    
Assignment Released 11/01/2026 Assignment 5 Released    
Lecture 19 11/02/2026 Decision Tree Learning [Slides] Mitchell: 3; Bishop: Sec 14.4
Lecture 20 11/04/2026 Ensemble Methods, AdaBoost [Slides] Bishop: Sec 14.3, 14.4
Lecture 21 11/09/2026 Hierarchical Clustering, K-Means [Slides] Murphy, 21.3; Hastie et.al.: Sec 14.3.6, 14.3.7
Lecture 22 11/11/2026 PCA, SVD [Slides] Murphy, 12.2; Hastie et.al.: Sec 14.5.1, 14.5.2
Assignment Due 11/15/2026 Assignment 5 Due (11:59AM Central Time)    
Assignment Released 11/15/2026 Assignment 6 Released    
Lecture 23 11/16/2026 Neural Networks [Slides] Goodfellow et al.: Chapter 6.1-6.4
Lecture 24 11/18/2026 Deep Learning [Slides] Goodfellow et al.: Chapter 6.1-6.5
11/23/2026-11/29/2026 Fall Break    
Lecture 25 11/30/2026 Generative Modelling [Slides-CNNs][Slides-Generative Modelling] Goodfellow et al.: Chapter 6-9
Lecture 26 12/02/2026 Generative Modelling II [Slides]      
Assignment Due 12/06/2026 Assignment 6 Due (11:59AM Central Time)    
Lecture 27 12/07/2026 Sequential Models [Slides]      
Lecture 28 12/09/2026 Review [Slides]      
Exam 12/11/2026-12/16/2026 (TBD) Final Exam