tool · first seen 18 Oct 2026
TensorRT
Also: TorchInductor, deep learning compiler
NVIDIA's library for optimizing and deploying neural networks with low-precision inference on GPUs.
TensorRT is NVIDIA's SDK for compiling trained neural networks into optimized GPU inference engines, using layer fusion, kernel auto-tuning and reduced precision such as FP16 and INT8. In the sampled sources it appears as routine deployment infrastructure, not as a research subject. Edge-vision papers use it on Jetson Orin and Jetson Thor: a depth-estimator benchmark, a multi-site video anomaly system, a cucumber-sizing study and a license-plate reader. Two small GitHub repos ship TensorRT backends for speech separation and batched motion generation. The alias grouping also mixes in general deep learning compiler work, including a survey, a verification framework and a NUMA-aware TorchInductor paper, so this is not one coherent new idea.
The mentions show that TensorRT remains the default path for running models on NVIDIA edge hardware. The small rise reflects ordinary publication volume, not new adoption.
Analyst note (established), 18 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 64 on 15 Nov 2026 · 9 mentions in 28 days · 9 independent groups · papers → code · first seen 4 weeks ago · acceleration -1.28
Earliest sources
- PanoDent-KD: From Generalist Knowledge Distillation to Cross-Dataset Specialist Detection and Embedded Deployment in Panoramic RadiographsPapers · 18 Oct 2026 · Muhammad Waqas Ashraf, Imad Ali Shah, Ali Hassan
- YUTELA: A Scalable Edge Cloud AIoT System for Multi-Site Video Anomaly Detection with Scene Specific AdaptationPapers · 19 Oct 2026 · Shanle Yao, Babak Rahimi Ardabili, Amir Kimiyaie, Hamed Tabkhi
- Which Depth Estimator for Jetson AGX Orin? A 2026 Benchmark of Monocular and Stereo MethodsPapers · 19 Oct 2026 · Leaf Jiang
- higurashi-ai/FastDialogueSidonCode · 26 Oct 2026 · higurashi-ai · 35 stars
- ProCerDCL: Query-Efficient Black-Box Probabilistic Verification of Deep Learning Compiler OptimizationPapers · 27 Oct 2026 · Zexin Li, Weibo Zhang, Linyi Li, Arvind Easwaran, Simin Chen
- patch-gg/crowdbricksCode · 27 Oct 2026 · patch-gg · 168 stars
Latest sources
- A Unified Framework for License Plate Identification and Character-RecognitionPapers · 8 Nov 2026 · Saurabh Kumar, Dewant Katare, Prakriti Jain
- CucumberVision at the Edge: Accuracy, Throughput, and Energy of RGB-D Cucumber Sizing on Jetson Orin Nano and Raspberry Pi 4Papers · 6 Nov 2026 · Manveen Kaur, Rajmeet Singh, Saeed Mozaffari, Majid Ahmadi, Shahpour Alirezaee
- NUMA-Torch: Compiler-Driven NUMA-Aware LLM Prefill on Multi-Socket CPUsPapers · 4 Nov 2026 · Thisara Rathnayaka Weerakoon, Ishan Dewpura, Niman Ransindu, Shavin Anjitha, Tha…
- Deep Learning Compilers: Architecture, Optimization, and Empirical CharacterizationPapers · 3 Nov 2026 · Jinghao Wen, Ruixuan Wang, Xun Jiao
- patch-gg/crowdbricksCode · 27 Oct 2026 · patch-gg · 168 stars
- ProCerDCL: Query-Efficient Black-Box Probabilistic Verification of Deep Learning Compiler OptimizationPapers · 27 Oct 2026 · Zexin Li, Weibo Zhang, Linyi Li, Arvind Easwaran, Simin Chen
- higurashi-ai/FastDialogueSidonCode · 26 Oct 2026 · higurashi-ai · 35 stars
- Which Depth Estimator for Jetson AGX Orin? A 2026 Benchmark of Monocular and Stereo MethodsPapers · 19 Oct 2026 · Leaf Jiang
- YUTELA: A Scalable Edge Cloud AIoT System for Multi-Site Video Anomaly Detection with Scene Specific AdaptationPapers · 19 Oct 2026 · Shanle Yao, Babak Rahimi Ardabili, Amir Kimiyaie, Hamed Tabkhi
- PanoDent-KD: From Generalist Knowledge Distillation to Cross-Dataset Specialist Detection and Embedded Deployment in Panoramic RadiographsPapers · 18 Oct 2026 · Muhammad Waqas Ashraf, Imad Ali Shah, Ali Hassan