TTIC 31230: Fundamentals of Deep Learning Winter 2020

Generalization and Regularization

Slides

Problems

PAC-Bayes Tutorial

The Alexnet Paper Demonstraing Dropout (2012)

The Journal Dropout Reference (2014)

Effective Dropout for RNNs (2015)

Paper on Over-Parameterization (2017)

Non-Vacuous PAC-Bayes Bounds (2017)

Non-Vacuous PAC-Bayes Bounds at ImageNet Scale (2018)

Double Descent Paper (2019)

Follow-up Double Descent Paper (2020)