task · first seen 4 Oct 2026
GPU kernel optimization
Also: CUDA kernels, kernel optimization, GPU kernel generation, CUDA kernel optimization, automated kernel generation, automated kernel optimization
Automatically writing and tuning GPU kernels for speed and correctness.
The idea is using LLM agents to write, tune and check GPU and accelerator kernels automatically. Most of the sources are recent arXiv papers from many separate groups, and they look past one-shot generation. Several systems keep and reuse knowledge across runs, among them ForgeKernel, CompoundingKernel and a benchmark for cross-DSL transfer. Others use RL for Ascend Triton kernels, or have small models write compiler optimization scripts. A third strand works on correctness: Lean-based formal verification and mutation testing of accepted CUDA candidates. Huawei Ascend benchmarks, a PaddlePaddle operator repo and two Hacker News primers show interest outside academia.
Hand-written kernels are a bottleneck for every new model architecture and chip. Agents that produce fast kernels which are also verifiably correct could cut that cost and reduce dependence on scarce kernel experts.
Analyst note (emerging), 17 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 21 on 16 Nov 2026 · 14 mentions in 28 days · 13 independent groups · papers → code → discussion · first seen 6 weeks ago · acceleration -0.69
Earliest sources
- MetaKernelBench: Measuring GPU Kernel Knowledge Transfer Beyond CodePapers · 4 Oct 2026 · Xueyi Chen, Shiyu Liu, Xin Jin, Yuhua Zheng, Xin Li, Haolei Bai, Junhan Zhu, Hua…
- Compaction-Aware Reinforcement Learning For Ascend Triton Kernel GenerationPapers · 9 Oct 2026 · Chuansai Zhou, Yanlin Liu, Bingning Huang, Shidi Xi, Chao Huang, Boxing Chen, Mi…
- TileCas: Cascading Kernel Development Across Programming AbstractionsPapers · 10 Oct 2026 · Xinyu Xiao, Zihe Song, Dezhi Ran, Wei Yang, Tao Xie
- How to Train Your Little Dragon: Teaching a Small Language Model to Construct and Refine GPU Optimization ScriptsPapers · 14 Oct 2026 · Annabelle Sujun Tang, Wei Tang, Songyao Jiang, Tianhui Li, Shengzhe Xu, Jiin Woo…
- Beyond Experience: Knowledge-Guided Evolution for NPU Kernel GenerationPapers · 20 Oct 2026 · Xi Chen, Ming Shen, Haotian Yan, Ruoyu Sun, Tianjun Yao
- PaddlePaddle/HALOpsCode · 20 Oct 2026 · PaddlePaddle · 25 stars
Latest sources
- CompoundingKernel: Self-Improving from Zero to FirstPapers · 14 Nov 2026 · Qian Qu, Hongyang Wang, Wenbo Chen, Yichuan Li, Jingguo Liu, Xian Li, Xuan Wang,…
- AscendGYM: A Cost-Aware Kernel Optimization Benchmark for Real-World Workloads on Ascend NPUsPapers · 13 Nov 2026 · AI Training Platform Team, Bingwei Zhang, Jing Li, Amir Abdullin, Sihang Chen, X…
- KernelMutate: Mutation-Guided Validation of Generated GPU KernelsPapers · 11 Nov 2026 · Ziyuan Li, Zihe Song, Shuxiao Xie, Mingfang Ji, Xiaofang Qi, Wei Yang, Tao Xie
- Write your own kernel optimiserDiscussion · 10 Nov 2026 · speckx · 42 points
- Reconstructing Fine-grained Memory Reuse Structure in GPU KernelsPapers · 10 Nov 2026 · Yanbo Zhao, Yueming Hao, Zecheng Li, Mao Lin, Shuyin Jiao, Keren Zhou, Xu Liu, J…
- A primer on GPUs and kernel optimizationDiscussion · 5 Nov 2026 · nomi_uw · 191 points
- ForgeKernel: Self-Evolving Kernels Catching and Surpassing Experts and AgentsPapers · 3 Nov 2026 · Yaojian Chen, Dazhi Peng, Yiyun Zheng, Zhui Zhu, Shengye Xiang, Leshan Li, Zhen…
- Ask, Don't Equip: Question-Driven Coding Agents for Deep Kernel OptimizationPapers · 2 Nov 2026 · Gabriele Oliaro, Jaeseong Lee, Zhaoyuan Su, Sreeram Vennam, Zhihao Jia, Samyam R…
- LARK: Lean-Assisted Reasoning for LLM-Generated GPU KernelsPapers · 1 Nov 2026 · Zixi Zhang, Jiayi Nie, Haoran Wu, Yujie Yan, Yann Herklotz, Rika Antonova, Rober…
- Evolving Agent TeamsPapers · 27 Oct 2026 · Shiyi Cao, Ziming Mao, Dacheng Li, Joseph E. Gonzalez, Ion Stoica
- God Does Not Play Dice: Enforcing Batch Invariance in Agentic Kernel GenerationPapers · 27 Oct 2026 · Youwei Bao, Chengpeng Wang, Simin Chen
- JustGoal: With Only a Goal, the AI Baseline Is Above the Expert KernelsPapers · 27 Oct 2026 · Yaojian Chen, Dazhi Peng, Zhui Zhu, Leshan Li, Haojun Sun, Yiyun Zheng, Qingfeng…