Schedule

(subject to further revisions)

# Date Topic Key concepts Slides Homework Solutions 4th hour projects
1 01/20 Introduction Overview, Class policies pdf HW0 (not graded) HW0 solutions  
2 01/22 Supervised learning Instance, label, and hypothesis spaces, learning algorithms pdf    
3 01/27 Decision Trees Entropy, Information Gain pdf      
4 01/29 Linear classifiers Linear separability, loss and risk, (stochastic) gradient descent pdf HW1 out HW1 solutions
5 02/03 Bias/Variance tradeoff Overfitting vs underfitting, bias and variance of a classifier pdf      
6 02/05 Online learning algorithms Perceptron and Winnow update rules pdf  
7 02/10 Analyzing online learners Concept learning, convergence and mistake bounds pdf      
8 02/12 Kernels and Dual Dual representation, Kernel trick pdf HW1 due; HW2 out HW2 solutions
9 02/17 Hypothesis testing t-Test etc. pdf      
10 02/19 Max-margin classifiers   pdf     Tell us about your project.
11 02/24 Support Vector Machines   pdf      
12 02/26 Multiclass classification   pdf HW2 due; HW3 out HW3 solutions
13 03/03 Midterm Review   pdf     Previous midterm, solutions
14 03/05 Midterm Exam        
15 03/10 Multiclass classification   pdf      
16 03/12 Learning Theory Concept learning, PAC learning, VC dimension pdf HW3 due; HW4 out HW4 solutions
17 03/17 Ensemble Learning Boosting and Bagging pdf      
18 03/19 Probabilistic models Graphical models, Bayes rule, MLE, MAP; Naive Bayes  pdf     Submit first report (template here) (Email to Julia)
19 03/31 Logistic regression Tom Mitchell's notes pdf      
20 04/02 Expectation-Maximization EM algorithm, applied to mixture models, k-means pdf HW4 due; HW5 out HW5 solutions
21 04/07 Hidden Markov Models Viterbi pdf      
22 04/09 Learning HMMs Forward-Backward pdf  
23 04/14 Still HMMs   pdf      
24 04/16 Neural networks Class canceled pdf HW5 due; HW6 out HW6 solutions
25 04/21 The EM algorithm Mixture models pdf      
26 04/23 Clustering k-means, agglomerative clustering, etc. pdf     Submit second report
27 04/28 Wrap-up   pdf      
28 04/30 Final Review   pdf HW6 due
29 05/05 Final Exam          
30 05/08           Submit final report