architecture · first seen 14 Oct 2026
finite-state transducer
Also: FST
Finite automaton that maps input strings to output strings, used here to model tokenizer segmentation.
Mentions per week
PapersCodeDiscussion
Earliest sources
- Towards Efficient Simultaneous Inverse Text Normalization with Pretrained Text-to-Text Language Model and Read-Tag-Write PolicyPapers · 14 Oct 2026 · Kiet Anh Hoang, Khanh Le, Bao Nguyen, Linh Pham, Dung Vo, Thai Tran, Mai Nguyen,…
- Finitely Verifiable Segmentation: Decidability for Every Tokenizer with a Finite-State VerifierPapers · 16 Oct 2026 · Nicklas Nidhögg
- Differentiable Exact LearningPapers · 16 Nov 2026 · Hristo Papazov, Francesco D'Angelo, Nicolas Flammarion
Latest sources
- Differentiable Exact LearningPapers · 16 Nov 2026 · Hristo Papazov, Francesco D'Angelo, Nicolas Flammarion
- Finitely Verifiable Segmentation: Decidability for Every Tokenizer with a Finite-State VerifierPapers · 16 Oct 2026 · Nicklas Nidhögg
- Towards Efficient Simultaneous Inverse Text Normalization with Pretrained Text-to-Text Language Model and Read-Tag-Write PolicyPapers · 14 Oct 2026 · Kiet Anh Hoang, Khanh Le, Bao Nguyen, Linh Pham, Dung Vo, Thai Tran, Mai Nguyen,…