ECE 364: Programming Methods for Machine Learning (Fall 2025)

 

Teaching Staff

Prof. Corey Snyder

Instructor
Email: cesnyde2[at]illinois.edu
 

Kamila Abdiyeva

Graduate Teaching Assistant
Email: kamilaa2[at]illinois.edu

Ayush Barik

Undergraduate Course Assistant
Email: barik2[at]illinois.edu

 


Class Time & Location

Class Time: Tuesday, Thursday 9:30AM-10:50AM
Location: ECEB 3081 (Electrical and Computer Engineering Building)

Work Submission Logistics

Gradescope for assignments (self-enrollment code ): [link]

Class Campuswire

Join the class campuswire with code 2568: [link]

 


 

Course Information

In this course, you will learn how to use auto-differentiation tools like PyTorch, how to leverage them for basic machine learning algorithms (linear regression, logistic regression, deep nets, k-means clustering), and how to extend them with custom methods to fit your needs. Auto-differentiation is one of the most important tools for data analysis and a solid understanding is increasingly important in many disciplines. In contrast to existing courses that focus on algorithmic and theoretical aspects, here we focus on studying material that permits deploying auto-diff tools to your area of interest.

Pre-requisites: Math 257 (Linear Algebra with Computational Applications) or equivalent, basic probability, and proficiency in Python.

Recommended Reference Texts: (1) Pattern Recognition and Machine Learning by Christopher Bishop
(2) Machine Learning: A Probabilistic Perspective by Kevin Murphy
(3) Deep Learning by Ian Goodfellow and Yoshua Bengio and Aaron Courville

Please note that these books are more comprehensive than the material covered in this class.

Course Deliverables:
(1) Homeworks (submission on Gradescope).
(2) Midterm Exams: There will be two midterm exams.
(3) Final Project

Final Project:

Due Date: December 21, 11:59pm

Students will complete one of the following projects in groups of 1 to 3 students.

Text Classification: Project Statement, Project Data

Semantic Segmentation: Project Statement, Project Data

Office Hours for Bonus Project:

To be announced!

Homework and Late Policy:

We will drop the lowest homework grade (1 assignment) for each student. Late submissions will be deducted 20% per day that the assignment is submitted late.


Grading:

25% Homeworks; 25% each Midterm; 25% Final Project

Office Hours

Ayush Kamila Prof. Snyder
Tuesdays: 1-2pm Wednesdays: 12-1pm Thursday: 12-1pm
ECEB 2034 ECEB 2034 ECEB 2034

Lectures

Lecture recordings may be found here.

The syllabus is subject to minor changes.

Event Date Description Materials Assignments
Lecture 1     08/26/2025 Course introduction
Blank Notebook Complete Notebook Other Materials
Lecture1 Lecture1-Complete Setting up Python
 
Lecture 2 08/28/2025 PyTorch basics
Blank Notebook Complete Notebook Other Materials
Lecture2 Lecture2-Complete -
 
Lecture 3 09/02/2025 Linear algebra and calculus review
Blank Notebook Complete Notebook Other Materials
Lecture3 Lecture3-Complete -
 
Lecture 4 09/04/2025 Matrix calculus and primal optimizations
Blank Notebook Complete Notebook Other Materials
Lecture4 Lecture4-Complete Lecture4-Written
HW1 Latex Files, HW1 PDF, HW1 Solutions
Lecture 5 09/09/2025 Automatic differentiation 1 (gradient descent)
Blank Notebook Complete Notebook Other Materials
Lecture5 Lecture5-Complete  

 

 
Lecture 6 09/11/2025 Automatic differentation 2 (computational graphs and backpropagation)
Blank Notebook Complete Notebook Other Materials
Lecture6 Lecture6-Complete Lecture6-Written

 

HW2 Latex Files, HW2 PDF, HW2 Solutions
Lecture 7 09/16/2025 Automatic differentiation 3 (backpropagation and PyTorch)
Blank Notebook Complete Notebook Other Materials
Lecture7 Lecture7-Complete -
 
Lecture 8 09/18/2025 Linear regression 1
Blank Notebook Complete Notebook Other Materials
Lecture8 Lecture8-Complete -
HW3 Latex Files, HW3 PDF, hw3_p2.zip, HW3 Solutions
Lecture 9 09/23/2025 Linear regression 2
Blank Notebook Complete Notebook Other Materials
Lecture9 Lecture9-Complete -
 
Lecture 10  09/25/2025 Logistic regression 1
Blank Notebook Complete Notebook Other Materials
Lecture10 Lecture10-Complete -
HW4 Latex Files, HW4 PDF, HW4 Solutions
Lecture 11 09/30/2025 Logistic regression 2
Blank Notebook Complete Notebook Other Materials
Lecture11 Lecture11-Complete -

 

 
Lecture 12 10/02/2025 Midterm 1 review
Blank Notebook Complete Notebook Other Materials
Lecture12 Lecture12-Complete Written Solutions
 
Lecture 13 10/07/2025 Midterm 1 (in class)

Practice Exam Fall 2024, Practice Exam Fall 2024 Solutions

Practice Exam Spring 2025 (skip Problems 4 and 7), Practice Exam Spring 2025 Solutions

Midterm 1 Solutions

 
Lecture 14 10/09/2025 PyTorch optimizers, datasets, dataloaders 1
Blank Notebook Complete Notebook Other Materials
Lecture14 Lecture14-Complete Lecture14-Written
 
Lecture 15 10/14/2025 PyTorch optimizers, datasets, dataloaders 2
Blank Notebook Complete Notebook Other Materials
Lecture15 Lecture15-Complete -
 
Lecture 16 10/16/2025 Deep nets 1 (MLPs)
Blank Notebook Complete Notebook Other Materials
Lecture16 Lecture16-Complete Course Informal Early Feedback, Lecture16-Written
 
Lecture 17 10/21/2025 Deep nets 2 (CNNs)
Blank Notebook Complete Notebook Other Materials
Lecture17 Lecture17-Complete -
 
Lecture 18    10/23/2025 Deep nets 3 (CNNs)
Blank Notebook Complete Notebook Other Materials
Lecture18 Lecture18-Complete -
HW5 Latex Files, HW5 PDF, hw5_p2.zip, hw5_p4.zip, HW5 Solutions
Lecture 19 10/28/2025 Deep nets 4 (RNNs)
Blank Notebook Complete Notebook Other Materials
Lecture19 Lecture19-Complete -
 
Lecture 20 10/30/2025 Transformers 1
Blank Notebook Complete Notebook Other Materials
Lecture20 Lecture20-Complete -
 
  11/04/2025 No class    
Lecture 21 11/06/2025 Transformers 2
Blank Notebook Complete Notebook Other Materials
Lecture21 Lecture21-Complete 3Blue1Brown Video on Attention
HW6 Latex Files, HW6 PDF, hw6_p1.zip, HW6 Solutions
Lecture 22 11/11/2025 Transformers 3
Blank Notebook Complete Notebook Other Materials
Lecture22 Lecture22-Complete -
 
Lecture 22 Part 2 11/13/2025 Final Project Discussion + Transformers 3    
Lecture 23 11/18/2025 Transformers 4
Blank Notebook Complete Notebook Other Materials
Lecture23 Lecture23-Complete -
 
Lecture 24 11/20/2025 Object Detection + Semantic Segmentation
Blank Notebook Complete Notebok Other Materials
Lecture24 Same as Blank Notebook -
HW7 Latex Files, HW7 PDF, hw7_p1.zip, HW7 Solutions (Problem 2)
Break 11/25/2025 Thanksgiving    
Break 11/27/2025 Thanksgiving    
Lecture 25 12/02/2025 Midterm 2 review
Blank Notebook Complete Notebook Other Materials
Lecture25    
 
Lecture 26 12/04/2025 Midterm 2 (in class)

Midterm 2 Study Guide, Midterm 2 Note Sheet (Provided during exam)

Practice Fall 2024, Practice Solutions Fall 2024 (skip 1.(a), (i), (j) and 5.(c))

Practice Spring 2025, Practice Solutions Spring 2025 (skip 1.(a), (b), (d), (k), (n) and 6)

 
Lecture 27 12/09/2025 TBD