trends.barnas.net

method · first seen 5 Oct 2026

natural gradient descent

Also: NGD, natural gradient, natural gradient flow, natural policy gradient

Optimization that preconditions gradient steps with the Fisher information metric to follow steepest descent on the statistical manifold.

Mentions per week

0219 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

constrained Markov decision processFisher-Rao distancesparse autoencodersuperposition in neural representationsprimal-dual optimizationpredictive codingphysics-informed neural networkfinite element method