model · first seen 5 Oct 2026
video diffusion model
Also: VDM, video diffusion, Stable Video Diffusion, video generation model, diffusion video generation
Generative diffusion models that synthesise video frames conditioned on text or other inputs.
Video diffusion models generate or edit video by iteratively denoising spatiotemporal latents, usually conditioned on text, images or camera signals. The sources show the concept serving mainly as a pretrained backbone that other work builds on. Papers repurpose it for robot world models and action prediction, dense 3D tracking, exocentric-to-egocentric view synthesis, avatars and plant reconstruction. Others work on the generator itself: sparse attention for faster inference, training-free resolution extension, and mixing serial and parallel denoising so physical events stay consistent. GitHub has research code releases, and a Show HN post describes compressing a 31B video-and-audio diffusion model to 14B parameters with INT8 weights.
Video diffusion models have been a standard tool since about 2022. The current activity reflects their use as general priors for 3D vision and robotics, not a new idea, and the weekly counts are flat to slightly falling.
Analyst note (established), 17 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 82 on 14 Nov 2026 · 40 mentions in 28 days · 36 independent groups · papers → code → discussion · first seen 6 weeks ago · acceleration -0.49
Earliest sources
- S2PD: Serial-to-Parallel Diffusion for Physically and Logically Consistent Video GenerationPapers · 5 Oct 2026 · Jeffrey Hu, Daniel Olmeda Reino, Ayush Tewari
- DepthWorld: 3D World Model for Robot ManipulationPapers · 6 Oct 2026 · Jai Bardhan, Josef Sivic, Vladimir Petrik
- RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot LearningPapers · 7 Oct 2026 · Seungjun Moon, Subin Jeon, Sangwoo Kim, Hanbyul Joo, Jinwoo Shin
- LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video GenerationPapers · 8 Oct 2026 · Suhwan Cho, Yonwoo Choi, Soongjin Kim, Jicheol Park, Taegyu Lim
- StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo CamerasPapers · 8 Oct 2026 · Jason Chen, I-Chun Arthur Liu, Gaurav Sukhatme, Daniel Seita
- Unified Generative Video Compression with Autoregressive and Bidirectional Video DiffusionPapers · 9 Oct 2026 · Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei, Tianwen Wu, Jiawen G…
Latest sources
- ZhouTimeMachine/JVTCode · 16 Nov 2026 · ZhouTimeMachine · 39 stars
- PoCoAttn: Position-Content Collaborative Sparse Attention for Fast and High-Fidelity Video GenerationPapers · 15 Nov 2026 · Jianwen Wu, Meiling Wang, Junkang Zhou, Yipeng Shen, Haoran You
- TRACE: Trajectory Synchronization for Training-Free Resolution Extension in Video GenerationPapers · 11 Nov 2026 · Libo Zhu, Fan Li, Zhixin Wang, Binglu Wang, Weisheng Dong, Yulun Zhang
- Track4D: Representing Dense 3D Tracking for Video Diffusion ModelsPapers · 11 Nov 2026 · Yushi Lan, Zeren Jiang, Kelvin Li, Xingang Pan, Chuanxia Zheng, Andrea Vedaldi
- Reframing Video Inverse Tone Mapping as Blind Posterior Inference via Latent Luminance SupervisionPapers · 11 Nov 2026 · Hanwool Sul, Chang-Hoon Jeong, Kisung Shin, Bomseok Park, Donghoon Cha, Hansl vo…
- From Video Frames to Robot Meta-Frames: A Unified Latent Interface for World Action ModelsPapers · 10 Nov 2026 · Guoqiang Liang, Yiqi Lin, Yanzhe Chen, Kevin Yuchen Ma, Mike Zheng Shou
- Plant Orbiter: 3D Plant Reconstruction and Generation with Video Diffusion Orbit Cameras and 3D Gaussian SplattingPapers · 9 Nov 2026 · Zane K. J. Hartley, Yong En Kok, Lewis A. G. Stuart, Andrew P. French, Michael P…
- TransArt3D: From Two States to Articulated 3D Reconstruction with Video Transition PriorsPapers · 8 Nov 2026 · Chenhao Guan, Liying Yang, Xinxing Yu, Hao Mo, Tianshun Han, Renjun Gao, Yanyan…
- Show HN: We compressed a 31B video+audio diffusion model to 14B, 6 steps, INT8Discussion · 7 Nov 2026 · jiant · 84 points
- ESTRA: Enabling Extreme Attention Sparsity for Training-Free Video Diffusion AccelerationPapers · 7 Nov 2026 · Enhuai Liu, Yunke Wang, Yutong Wang, Changming Sun
- UniRGBA: Unifying RGB and Alpha in Pretrained Video Diffusion ModelsPapers · 6 Nov 2026 · Lei Xu, Zhuo Li, Yongyi Jin, Aoyu Wang
- MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body DynamicsPapers · 6 Nov 2026 · Zheng Wang, Zhengwei Gong, Yuanzhi Liang, Haibin Huang, Chi Zhang