Gradient Descent

• papers/The Forward-Forward Algorithm - Some Preliminary Investigations - 2212.13345.pdf
• NoProp: Training Neural Networks without Back-propagation or Forward-propagation [https://arxiv.org/abs/2503.24322]
• Evolutionary algorithms and Genetic Algorithms also fall under this. They tradeoff computation for bias.
• Random Feedback Weights Support Learning In Deep Neural Networks - 1411.0247.pdf
• The Cascaded Forward Algorithm for Neural Network Training https://arxiv.org/abs/2303.09728

See also: Meta Learning