Early-Signal Detector

architecture · first seen 15 Oct 2026

sparse activation functions

Also: ReLU

Activation functions like ReLU that output many exact zeros, enabling sparse storage of activations.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

activation compression