Schedule for In-class Presentations
Date | Topic | Suggested Readings | Reference | Homework |
---|---|---|---|---|
Aug. 26, 30 |
Introduction
Mathematics Machine Learning Basics |
Deep Learning Book
Chap. 2 Chap. 3 Chap. 5 |
||
Sep. 9, 6 |
Feedforward Neural Networks & Optimization Tricks
|
Deep Learning Book
Chap. 6 Chap. 7 Chap. 8 |
||
Sep. 16, 13 |
PyTorch part 1
PyTorch Part 2 |
Python Numpy Tutorial
Neural Network from Scratch Dive into Deep Learning |
HW1 (to be announced)
|
|
Sep. 23, 20 |
Convolutional Neural Networks & Recurrent Neural Networks
|
Deep Learning Book
Chap. 9 Chap. 10 |
ResNet
GRU DenseNet |
|
Oct. 1, 27 |
NLP Basis
|
Word2Vec
|
SGNS
|
|
Oct. 7, 4 |
Attention, Transformers
|
Transformer
|
||
Oct. 16, 11 |
Introduction to Huggingface & Kaggle Challenge (Notebook)
|
HW2 (to be announced)
|
||
Oct. 28, 25 |
Large Language Models I
|
BERT
GPT-3 Survey of Pre-trained LMs |
TBD
|
|
Nov. 04, 01 |
Large Language Models II - Prompt Tuning
|
Chain-of-Thought
Self Consistency ReAct |
||
Nov. 11, 08 |
Generative Models I
|
GAN
VAE |
TBD
|
|
Nov. 18, 15 |
Diffusion, text-to-image generation
|
CLIP
Sora |
||
Nov. 25, 22 |
Graph Representation Learning
|
DeepWalk
LINE GCN |