method · first seen 9 Oct 2026
private inference for large language models
Also: secure inference, private inference, encrypted model inference, secure transformer inference, cryptographically secure inference
Protecting sensitive user inputs sent to hosted language models during inference.
Mentions per week
PapersCodeDiscussion
Earliest sources
- DP-MIND: Differentially private memory-guided Long context InferencePapers · 9 Oct 2026 · Zhihao Liu, Yitian Cheng, Shuang Liu, Rui Wen, Yuke Hu, Zhan Qin
- A Graph-Based Analysis of Comparability, Scale, and Attribution in Private Transformer InferencePapers · 14 Oct 2026 · Souvik Das, Ariful Azad, Nitesh Saxena
- Pacifo: An Efficient Fully Homomorphic Encryption-based Lightweight ResNet for Trustworthy Machine Learning as a ServicePapers · 24 Oct 2026 · Yang Li, Gang He, Ruichen Zhang, Guangyuan Liu, Yinqiu Liu
- CipherFlow: Compiling AI Programs for Efficient Cryptographically Secure InferencePapers · 1 Nov 2026 · Hedong Zhang, Mengxin Zheng, Qian Lou
- Perseus: A Full-Stack System for Homomorphic Model InferencePapers · 3 Nov 2026 · Alessandro Zirilli, Davide Marincione, Evgenios M. Kornaropoulos, Giuseppe Ateni…
- MOAI: Module-Optimizing Architecture for non-interactive secure transformer InferencePapers · 10 Nov 2026 · Linru Zhang, Xiangning Wang, Jun Jie Sim, Zhicong Huang, Jiahao Zhong, Huaxiong…
Latest sources
- MOAI: Module-Optimizing Architecture for non-interactive secure transformer InferencePapers · 10 Nov 2026 · Linru Zhang, Xiangning Wang, Jun Jie Sim, Zhicong Huang, Jiahao Zhong, Huaxiong…
- Perseus: A Full-Stack System for Homomorphic Model InferencePapers · 3 Nov 2026 · Alessandro Zirilli, Davide Marincione, Evgenios M. Kornaropoulos, Giuseppe Ateni…
- CipherFlow: Compiling AI Programs for Efficient Cryptographically Secure InferencePapers · 1 Nov 2026 · Hedong Zhang, Mengxin Zheng, Qian Lou
- Pacifo: An Efficient Fully Homomorphic Encryption-based Lightweight ResNet for Trustworthy Machine Learning as a ServicePapers · 24 Oct 2026 · Yang Li, Gang He, Ruichen Zhang, Guangyuan Liu, Yinqiu Liu
- A Graph-Based Analysis of Comparability, Scale, and Attribution in Private Transformer InferencePapers · 14 Oct 2026 · Souvik Das, Ariful Azad, Nitesh Saxena
- DP-MIND: Differentially private memory-guided Long context InferencePapers · 9 Oct 2026 · Zhihao Liu, Yitian Cheng, Shuang Liu, Rui Wen, Yuke Hu, Zhan Qin