Early-Signal Detector

method · first seen 5 Oct 2026

low-rank gradient projection

Also: LoGRA

Compressing gradients into low-rank sketches to reduce memory use during training.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

reinforcement learning from policy gradients for language modelsKL-divergence step controlquantization-aware trainingmemory-efficient optimizer