tool · first seen 5 Oct 2026
vLLM
High-throughput serving engine for large language models using paged attention and continuous batching.
Mentions per week
PapersCodeDiscussion
Rank 25 on 16 Nov 2026 · 18 mentions in 28 days · 18 independent groups · code → papers → discussion · first seen 6 weeks ago · acceleration -0.40
Earliest sources
- Kinference-AI/kinferenceCode · 5 Oct 2026 · Kinference-AI · 110 stars
- vLLM-Omni Technical Report: A Unified Serving Runtime for Omni-Modality GenerationPapers · 7 Oct 2026 · vLLM-Omni Team
- Reproducible LLM Inference Benchmarking: A Sequential Isolation Protocol for Regression TestingPapers · 7 Oct 2026 · Arnold Olympio, Juan Manuel Servera Bondroit, Wael Abdelmalek, Guang Lu, João C…
- salient-data/qwen38-next-dgx-recipeCode · 8 Oct 2026 · salient-data · 35 stars
- qshine/llm-lora-tutorialCode · 11 Oct 2026 · qshine · 26 stars
- xp2001-coder/zero2vllmCode · 12 Oct 2026 · xp2001-coder · 86 stars
Latest sources
- Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLMDiscussion · 14 Nov 2026 · wondersky · 149 points
- 6 Hours of YouTube and 85 handtyped pages of notes on LLM Inference – Start hereDiscussion · 9 Nov 2026 · samirswr · 80 points
- Reproducible LoRA Inference Through Deterministic Split-K ReductionPapers · 7 Nov 2026 · Dhayaneshwar Balusamy, Ankur Mohan
- Cancellation Is Not Enough: What Retries Leave Behind in an Overloaded LLM EnginePapers · 5 Nov 2026 · Xindan Zhang, Fei Wang
- Show HN: GPUWorks – A 40 MB GPU cluster manager for vLLM/SGLang, no K8s neededDiscussion · 4 Nov 2026 · wangweinoo1 · 30 points
- A Controlled Experimental Evaluation of Configuration and Cache Architecture in LLM Serving EnginesPapers · 4 Nov 2026 · Muhammad Faizan Anwar, Sina Keshvadi
- ProprietaryLegal/Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4Code · 3 Nov 2026 · ProprietaryLegal · 33 stars
- Inferact/zero-mismatch-rlCode · 3 Nov 2026 · Inferact · 44 stars
- ZhuLinsen/LiteMoECode · 1 Nov 2026 · ZhuLinsen · 32 stars
- Huage001/Ascend-H3Code · 30 Oct 2026 · Huage001 · 36 stars
- atdev-company/atdev-serveCode · 30 Oct 2026 · atdev-company · 43 stars
- Matching Workloads to Blackwell: Power-Resolved Benchmarking of NVIDIA B200 and B300 across HPC and AI WorkloadsPapers · 30 Oct 2026 · Mohsen Zand, Trung Dac Nguyen, H. Birali Runesha