trends.barnas.net

phenomenon · first seen 13 Oct 2026

CPU-based LLM inference

Also: CPU inference, CPU-only inference, CPU inference for large language models

Running large language models on system RAM and CPUs instead of GPU memory, trading throughput for capacity.

Mentions per week

0119 May11 Aug10 NovPapersCodeDiscussion

PapersCodeDiscussion

Earliest sources

Latest sources

Mentioned together with

low-rank adaptationINT4 quantizationfederated fine-tuningoptical character recognitionmixture of expertsspeculative decodingquantization