Gradient Descent
Table of Contents
1. Beyond Gradient Descent
- papers/The Forward-Forward Algorithm - Some Preliminary Investigations - 2212.13345.pdf
- NoProp: Training Neural Networks without Back-propagation or Forward-propagation [https://arxiv.org/abs/2503.24322]
- Evolutionary algorithms and Genetic Algorithms also fall under this. They tradeoff computation for bias.
- Random Feedback Weights Support Learning In Deep Neural Networks - 1411.0247.pdf
See also: Meta Learning