Initialization (NN)

Initialization of weights and biases in neural network affect the training of the network a lot. Without careful initialization the network might not even converge or converge slowly.

• Kaiming He
• Xaiver Golrot
• Uniform
• Orthogonal initialization is used in RL (See The 37 Implementation Details of Proximal Policy Optimization)