Machine Learning

CSCI 567, Fall 2021

Haipeng Luo


General Information  |  Schedule & Readings  |  Homework & Quizzes |  Other Resources

*Schedule is subject to small adjustments. Slides will be posted before each lecture (and might be updated slightly soon after the lecture).

Date Topics Recommended Reading Discussion Session
08/26 Overview; nearest neighbor classification; core ML concepts slides handouts (1-page, 4-page) Math exercise solutions (by Mengxiao)
09/02 Linear regression; regression with nonlinear basis;
regularized regression		 slides handouts (1-page, 4-page)
[MLaPP] 1.4.5, 7.1-7.3, 7.5.1, 7.5.2, 7.5.4, 7.6, 1.4.7, 1.4.8
[ESL] 7.1, 7.2, 7.3, 7.10 		Practice solutions (by Liyu)
09/09 Linear classifiers; Perceptron; logistic regression; general optimization algorithms slides handouts (1-page, 4-page)
[MLaPP] 4.2.1 - 4.2.5, 8.5.1-8.5.4, 1.4.6, 8.1-8.3
[ESL] 4.1-4.2, 4.4 		Practice solutions (by Chen-Yu)
09/16 Multiclass classification; neural networks slides handouts (1-page, 4-page)
[MLaPP] 16.5.1-16.5.6, 28
[ESL] 11.3-11.7		 HW1 review (by Chung-Wei)
09/23 Convolutional neural nets; kernel methods slides handouts (1-page, 4-page)
[MLaPP] 14.1, 14.2.1-14.2.4, 14.4.1, 14.4.3
[ESL] 5.8, 6.3, 6.7		 Practice solutions (by Mengxiao)
09/30 Lagrangian duality; SVM slides handouts (1-page, 4-page)
[MLaPP] 14.5.2-14.5.4
[ESL] 12.1-12.3		 HW2 review (by Liyu)
10/07 Quiz 1 No discussions
10/14 Fall Recess
10/21 Decision trees; boosting slides handouts (1-page, 4-page)
[MLaPP] 16.4.1-16.4.5, 16.4.8, 16.4.9
[ESL] 16.3
 Quiz 1 review (by Chen-Yu)
10/28 Clustering; k-means; Gaussian mixture models; EM slides handouts (1-page, 4-page) EM_demo
[MLaPP] 3.5, 11.1-11.3, 11.4.1-11.4.4, 11.5
[ESL] 6.6.3, 8.5, 14.3.1-14.3.9 		HW3 review (by Chung-Wei)
11/04 Density estimation; naive Bayes; dimensionality reduction and visualization; PCA slides handouts (1-page, 4-page)
[MLaPP] 10.1, 10.2.1-10.2.3, 10.3-10.5, 12.2
[ESL] 14.5.1 		practice solutions slides (by Mengxiao)
11/11 Hidden Markov models, HW4 review slides handouts (1-page, 4-page)
[MLaPP] 17.1-17.4, 17.5.1-17.5.2 		Practice solutions (by Liyu)
11/18 Multi-armed bandits; reinforcement learning slides handouts (1-page, 4-page)
 HW4 review cont. practice solutions slides (by Chung-Wei)
11/25 Thanksgiving practice solutions
12/02 Quiz 2 No discussions