He Initialization
Identity Initialization
LeCun Initialization
Orthogonal Initialization
Random Initialization
Xavier (Glorot) Initialization
-
D
Dive into Deep Learning 5.4 — Xavier initialization and variance stability across layers Art… 2 terms
-
-
P
Understanding the difficulty of training deep feedforward neural networks (Xavier initialization) Pap… 2 terms
-
L
Efficient BackProp (LeCun, Bottou, Orr & Müller, 1998) — the 1/√fan-in initialization rule Art… 1 term
-
-
A
Fixup Initialization: Residual Learning Without Normalization (Zhang, Dauphin & Ma, ICLR 2019) Pap… 1 term
-
-
-
-
A
ReZero is All You Need: Fast Convergence at Large Depth — zero-initialized residual gate = identity at init Pap… 1 term
-
C
Stanford CS231n — Setting up the data and the model: “Pitfall: all zero initialization” Art… 1 term
No terms or links match your search.