Machine Learning

CSCI 567, Fall 2020

Haipeng Luo

Date	Topics	Recommended Reading	Discussion Session
08/27	Overview; nearest neighbor classification; core ML concepts	slides handouts	Math exercise (solutions) (by Mengxiao)
09/03	Linear regression; regression with nonlinear basis; regularized regression	slides handouts [MLaPP] 1.4.5, 7.1-7.3, 7.5.1, 7.5.2, 7.5.4, 7.6, 1.4.7, 1.4.8 [ESL] 7.1, 7.2, 7.3, 7.10	Practice solutions (by Mengxiao)
09/10	Linear discriminant analysis; Perceptron; logistic regression	slides handouts [MLaPP] 4.2.1 - 4.2.5, 8.5.1-8.5.4, 1.4.6, 8.1-8.3 [ESL] 4.1-4.2, 4.4	Practice solutions (by Liyu)
09/17	Multiclass classification; neural networks	slides handouts [MLaPP] 16.5.1-16.5.6, 28 [ESL] 11.3-11.7	HW1 review practice solutions (by Sungyong)
09/24	Convolutional neural nets; kernel methods	handouts [MLaPP] 14.1, 14.2.1-14.2.4, 14.4.1, 14.4.3 [ESL] 5.8, 6.3, 6.7	Practice solutions (by Sungyong)
10/01	Lagrangian duality; SVM	slides handouts [MLaPP] 14.5.2-14.5.4 [ESL] 12.1-12.3	HW2 review practice solutions (by Liyu)
10/08	Quiz 1		No discussions
10/15	Decision trees; boosting	slides handouts [MLaPP] 16.4.1-16.4.5, 16.4.8, 16.4.9 [ESL] 16.3	Quiz 1 review v1 v2 (by Mengxiao)
10/22	Clustering; Gaussian mixture models	slides handouts EM_demo [MLaPP] 3.5, 11.1-11.3, 11.4.1-11.4.4, 11.5 [ESL] 6.6.3, 8.5, 14.3.1-14.3.9	Quiz 1 review (cont.) and HW3 review (by Sungyong)
10/29	Density estimation; naive Bayes; dimensionality reduction and visualization; PCA	slides handouts [MLaPP] 10.1, 10.2.1-10.2.3, 10.3-10.5, 12.2 [ESL] 14.5.1	HW3 review (cont.) and practice (solutions) (by Sungyong)
11/05	Hidden Markov models, HW4 review	slides handouts [MLaPP] 17.1-17.4, 17.5.1-17.5.2	Practice solutions (by Liyu)
11/12	Multi-armed bandit; reinforcement learning	slides handouts	HW5 review (by Mengxiao)
11/19	Quiz 2		No discussions