Early-Signal Detector

architecture · first seen 4 Oct 2026

softpick attention

Also: Softpick

Attention variant replacing softmax with rectified scores to eliminate attention sinks and massive activations.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

attention sinkstop-gradient normalization