method · first seen 5 Oct 2026
zeroth-order optimization
Also: ZO, DFO, ZO optimization, zero-order optimization, zeroth-order fine-tuning, forward-only optimization, gradient-free optimization
Gradient-free optimization that estimates gradients from function evaluations, used to fine-tune models with low memory.
Mentions per week
PapersCodeDiscussion
Rank 192 on 15 Nov 2026 · 17 mentions in 28 days · 17 independent groups · papers · first seen 6 weeks ago · acceleration +0.54
Earliest sources
- VLA-ZO: Fast Zeroth-Order Adaptation for Vision-Language-Action ModelsPapers · 5 Oct 2026 · Jaemin Kim, Jiahn Kim, Taesik Gong
- Sample-Adaptive Zeroth-Order Post-TrainingPapers · 8 Oct 2026 · Haiyuan Wan, Yanyi Li, Weicheng Lin, Cong Fang
- Optimal Algorithms for Nonsmooth Nonconvex Stochastic Optimization with ConstraintsPapers · 9 Oct 2026 · Gon Buzaglo, Guy Kornowski
- Partially Informed Stochastic Optimization via Zeroth-Order Residual TrackingPapers · 9 Oct 2026 · El Mahdi Chayti, Alireza Mirrokni, Martin Jaggi
- Zeroth-Order Fine-Tuning of LLMs in Learnable Low-Rank SubspacesPapers · 10 Oct 2026 · Chuang Tong, Ling Chen
- ZOIF: Zeroth-Order Influence Function Estimation for LLM Data Selection Using Only Forward PassesPapers · 11 Oct 2026 · Lisong He, Yunxuan Jiang, Haishan Ye, Xiangyu Chang
Latest sources
- Contrastive Activation-Guided Zeroth-Order Preference Optimisation for Memory-Efficient LLM AlignmentPapers · 16 Nov 2026 · Weiyun Huang, Alessio Galatolo
- Wanda-Guided Sparse Perturbations for Efficient Zeroth-Order OptimizationPapers · 12 Nov 2026 · Ziqing Wen, Xiaohui Song, Jiahuan Wang, Ping Luo, Junlin Zeng, Dongsheng Li, Tao…
- Zeroth-Order Riemannian Optimization on Fixed-Rank Manifolds for LLM Fine-TuningPapers · 7 Nov 2026 · Xinjue Wang, Xiuheng Wang, Yejun Zhang, Sergiy A. Vorobyov, Esa Ollila
- Breaking Precision Walls in First-, Second-, and Zeroth-Order Optimizers: One Constant, Set in AdvancePapers · 7 Nov 2026 · Lngel Kyo
- Zeroth-Order Langevin Dynamics for Stochastic Nonconvex Optimization: Curvature Regularization and Non-Asymptotic GuaranteesPapers · 7 Nov 2026 · Stefano Bruno, Dong-Young Lim
- Lower-Level Agnostic Bilevel OptimizationPapers · 6 Nov 2026 · Peiwen Qiu, Prashant Khanduri, Jia Liu
- An Educated Guess: Deriving Statistically Aligned Gradient Estimates for Zeroth-Order OptimisationPapers · 5 Nov 2026 · Justus Huebotter, Serge Thill, Marcel van Gerven, Nasir Ahmad
- Training Specialist LLMs on Your Phone: Forward-Only Optimization via Block-Spectral CoordinatesPapers · 3 Nov 2026 · Liyan Tan, Yequan Zhao, Ziyue Liu, Yupeng Su, Ruijie Zhang, Zheng Zhang
- ENGINE: Endogenous Variational MultiScale Optimization for Zeroth-Order LLM Fine-TuningPapers · 2 Nov 2026 · Zhuoli Ouyang, Changxi Chi, Siyuan Li, Tailin Wu
- The Cost of Mismatch: Noise Amplification in Zeroth-Order Reinforcement LearningPapers · 2 Nov 2026 · Lianmin Chen, Junbin Qiu, Chenxing Wei, Yao Shu, Kun He
- Accelerating LLM Pretraining with Zeroth-Order Curvature on Idle Serving ComputePapers · 2 Nov 2026 · Mingchuan Ma, Dongqi Cai, Daqian Yang, Zhenyan Lu, Chen Chen, Teresa Lv, Yan Gao…
- Zeroth-Order Policy Optimization for Scheduling in Queueing NetworksPapers · 31 Oct 2026 · Deyi Wang, Qining Zhang, Lei Ying