Skip to the content.

Schedule for In-class Presentations

Date Topic Suggested Readings Reference Homework
Aug.
26, 30
Introduction
Mathematics
Machine Learning Basics
Deep Learning Book
Chap. 2
Chap. 3
Chap. 5
Sep.
9, 6
Feedforward Neural Networks & Optimization Tricks
Deep Learning Book
Chap. 6
Chap. 7
Chap. 8
Sep.
16, 13
PyTorch part 1
PyTorch Part 2
Python Numpy Tutorial
Neural Network from Scratch
Dive into Deep Learning
HW1 (to be announced)
Sep.
23, 20
Convolutional Neural Networks & Recurrent Neural Networks
Deep Learning Book
Chap. 9
Chap. 10
ResNet
GRU
DenseNet
Oct.
1, 27
NLP Basis
Word2Vec
SGNS
Oct.
7, 4
Attention, Transformers
Transformer
Oct.
16, 11
Introduction to Huggingface & Kaggle Challenge (Notebook)
HW2 (to be announced)
Oct.
28, 25
Large Language Models I
BERT
GPT-3
Survey of Pre-trained LMs
TBD
Nov.
04, 01
Large Language Models II - Prompt Tuning
Chain-of-Thought
Self Consistency
ReAct
Nov.
11, 08
Generative Models I
GAN
VAE
TBD
Nov.
18, 15
Diffusion, text-to-image generation
CLIP
Sora
Nov.
25, 22
Graph Representation Learning
DeepWalk
LINE
GCN