References on Controlling Gradients

Kaiming He's ICML 2016 Tutorial Slides

Xavier and He Initialization

Look Linear Initialization

Identity Initialization

Original paper on Batch Normalization

Original Resnet Paper

Schmidhuber's Original Highway Network Paper

Fractalnet

Wide-Resnet

Densenet

Resnext