Sergey Ioffe
(2 articles)2015
Variance Scaling
Variance scaling is a technique used in machine learning to ensure weights of layers are initialized in a way that maintains consistent variance of activations throughout a neural network.
Generality: 525
2015
Batch Normalization
A technique used to improve the training speed and performance of neural networks by normalizing layer inputs.
Generality: 675