tool · first seen 6 Oct 2026
llama.cpp
C/C++ library for running quantized LLMs efficiently on consumer hardware.
llama.cpp is the C/C++ inference engine from ggml-org for running quantized models, typically in GGUF format, on CPUs, GPUs and Apple Silicon. The sources treat it as infrastructure rather than something new. Repos build on it for MoE expert streaming from SSD, Android offline assistants, a jailbroken PS5 port and multi-machine local servers. Papers use it as a backend for reproducible local inference and compile it to WebAssembly for in-browser models. Hacker News threads cover its v1.0 release with a native macOS app. The recent mention spike reflects that release and steady downstream use, not a newly emerging idea.
The v1.0 milestone and the growing set of projects built on top of it, including SSD-offloaded MoE inference and browser and phone deployment, suggest llama.cpp is settling in as the default runtime for local LLM work.
Analyst note (established), 17 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 143 on 14 Nov 2026 · 24 mentions in 28 days · 24 independent groups · code → discussion → papers · first seen 6 weeks ago · acceleration -0.60
Earliest sources
- 0xPD33/commonplaceCode · 6 Oct 2026 · 0xPD33 · 37 stars
- basecompute/superfluidCode · 8 Oct 2026 · basecompute · 31 stars
- IbrahimSiddiqui007/moe-cacheCode · 8 Oct 2026 · IbrahimSiddiqui007 · 22 stars
- abhi245y/PS5LM-PlusCode · 9 Oct 2026 · abhi245y · 524 stars
- freriadoc/AvalonCode · 9 Oct 2026 · freriadoc · 454 stars
- amurgola/LumaBrowserCode · 9 Oct 2026 · amurgola · 152 stars
Latest sources
- scarletkc/colab-playgroundCode · 16 Nov 2026 · scarletkc · 112 stars
- Llama.cpp hits v1.0 with a native app for macOSDiscussion · 14 Nov 2026 · shubham0204 · 26 points
- Llama.cpp v1 Is OutDiscussion · 13 Nov 2026 · unofficialmerve · 20 points
- Clean Tickets, Wrong Orders: Catching Silent Errors with a Language Model in Your Browser TabPapers · 13 Nov 2026 · Umar Ahmed, Maxim Dunaev, Mohammad Nour Al Awad, Sergey Ivanov, Ivan Khodnenko
- Superfluid: Local AI Server for Distributed LLM InferencePapers · 13 Nov 2026 · Prabod Rathnayaka, Isura Manchanayake, Srikandabala Kogul, Steve Siu, Fabian Was…
- Veloresearch/kineticCode · 10 Nov 2026 · Veloresearch · 90 stars
- huawei-csl/MACaQCode · 10 Nov 2026 · huawei-csl · 353 stars
- Llama-modchip: 284B DeepSeek on 64GB RAM, no GPUDiscussion · 8 Nov 2026 · joshcsimmons · 487 points
- Caleta: An Evidence-Oriented Trust Layer for Reproducible Local Large Language Model InferencePapers · 6 Nov 2026 · Joan-Marc Fisa
- sdalberto/ia-da-sobrevivenciaCode · 5 Nov 2026 · sdalberto · 47 stars
- johnpsasser/lifeboatCode · 3 Nov 2026 · johnpsasser · 44 stars
- ewhacc/tandem.cppCode · 1 Nov 2026 · ewhacc · 79 stars