model · first seen 5 Oct 2026
small language model
Also: SLM, small language model fine-tuning
Compact language model with relatively few parameters, designed for low-latency deployment.
Small language models are compact models, typically under a few billion parameters, meant for cheap, low-latency, or on-device use, usually fine-tuned for a narrow task. The sources apply them widely: edge classification of IoT data models, per-call-site routing in an agentic home-automation system, distillation for e-commerce topic labeling, Vietnamese paraphrasing with a 0.8B Qwen fine-tune, clinical synthetic data, UAV voice command, and calculator-grounded reasoning training. A University of Washington-style system automates building quantized SLMs for phones. Hobbyist repos test constrained-decoding workflows and a DOS model on a floppy. The label is broad and long in use; the spread here reflects routine adoption, not a new idea.
The recurring thread is replacing a single frontier model with task-sized small models at specific call sites, which cuts cost and latency and enables offline, private deployment. As that pattern matures, routing and per-task fine-tuning become standard engineering practice.
Analyst note (established), 17 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 14 on 14 Nov 2026 · 18 mentions in 28 days · 18 independent groups · papers → discussion → code · first seen 6 weeks ago · acceleration +2.20
Earliest sources
- Small Language Models for Smart Data Model Classification at the Edge: A Cost-Aware Hybrid ApproachPapers · 5 Oct 2026 · Cristian Martella, Angelo Martella, Antonella Longo, Motaz Saad
- Not Every Call Needs a Frontier Model: Per-Call-Site Evaluation of Small Language Models in a Deployed Agentic Home-Automation SystemPapers · 6 Oct 2026 · Panagiotis Kasnesis, Christos Chatzigeorgiou, Lazaros Toumanidis, Amalia Contier…
- Multi-Label Topic Assignment via LLM Distillation: A Comparative Analysis of Generative vs. Discriminative Student ModelsPapers · 6 Oct 2026 · Sourabh Kasliwal, Shubhranshu Singh
- Using Small Language Models to Reverse-Engineer Machine Learning Pipelines StructuresPapers · 7 Oct 2026 · Nicolas Lacroix, Frederic Precioso, Mireille Blay-Fornarino, Sebastien Mosser
- Grammar Concept Annotation at Scale: Deployed Fine-Tuned Small Language Models Outperform Prompted Frontier ModelsPapers · 7 Oct 2026 · Marjan Celikik, Ana Peleteiro Ramallo, Javier Morales
- Strands Decider 2B: a small, open-source, decision modelDiscussion · 7 Oct 2026 · gmays · 286 points
Latest sources
- Procedure without Judgment: What Small Language Models Learn under an Exact VerifierPapers · 16 Nov 2026 · Arunkumar V, Manoranjan Gandhudi, Gangadharan G. R., Arun Prakash, S. Senthilkum…
- Nemotron 3.5 Bolt E4B 4GB: An Open and Efficient Small Language Model for Fast Conversational AgentsPapers · 16 Nov 2026 · NVIDIA, :, Adi Margolin, Aditya Malte, Aishwarya Chhabra, Alex Hodson, Ameya Sun…
- WollyMonjac/Tiny-2.1Code · 15 Nov 2026 · WollyMonjac · 192 stars
- Dependable Voice Command for Multi-UAV Swarms Using Small Language ModelsPapers · 13 Nov 2026 · Afshin Ameri, Luiz Giacomossi, Håkan Forsberg, Ivan Tomasic, Baran Cürüklü
- ARCHER: From Rationale Imitation to Executable Reasoning in Small Language ModelsPapers · 13 Nov 2026 · Dhruv Dixit, Khushi Patel, Congcong Xu, Min Song
- I'm making LLMs work on small and old devicesDiscussion · 12 Nov 2026 · mrashad74 · 483 points
- Fine-Tuned Small Language Model for Synthetic Clinical Data Generation and Predictive Healthcare AnalyticsPapers · 12 Nov 2026 · Mihnea Sebastian Burlacu, Ionut Anghel, Tudor Cioara
- Small Language Models for Inference-Capability Routing: Effects of Model Capacity and Prompt Optimization on Downstream Quality and EfficiencyPapers · 12 Nov 2026 · Sailendra Kolluru, Maheshkumar Duvvarapu
- VWEN: A Curated Small Language Model for Vietnamese ParaphrasingPapers · 11 Nov 2026 · Sang Quang Nguyen
- Mobile AI Factory: Building Specialized Language Models for Your Mobile DevicePapers · 10 Nov 2026 · Evan Li, Krishna Deshpande, Wen Cheng, Shyamnath Gollakota
- Decalage: Uncovering the Gap Between Model-Generated Reasoning and Actual Code Implementation in Small Language ModelsPapers · 9 Nov 2026 · Saif Uddin Mahmud, Afsana Tasnim, Ahmed Ryan, Md Rayhanur Rahman
- Compact Greek Language Models from Scratch: Pretraining 500M- and 1B-Parameter Decoder-Only TransformersPapers · 6 Nov 2026 · Konstantinos Perifanos, Anne Laure Poite, Giannis Tsilikas, Ilias Katis, Stavros…