AI video generation refers to the automatic creation of animated sequences from text, images, or audio inputs. Sora (OpenAI) is a notable example of a model that produces realistic clips from a plain text description.
NVIDIA releases Cosmos 3, a collection of omnimodal world models (Nano 16B, Super 64B) capable of generating dynamic video, image, audio, and action commands from text, image, video, and action trajectory inputs. Available on Hugging Face for Physical AI applications.
GEM is a concept erasure framework for Rectified Flow Transformers. It bridges trajectory-based unlearning (Generative Flow Networks) and teacher-guided erasure, using geometric guidance signals to suppress unwanted concepts while preserving benign generation and preventing harmful content synthesis.
NVIDIA announces Cosmos 3 (video model), Nemotron 3 Ultra (optimized LLM), and RTX Spark. Jensen Huang claims a major win for the company.
Ethan He, Grok Imagine lead at xAI, discusses building the video generation model in 3 months, compares video generation to world models approach, and argues why video agent models represent the next frontier.
Nvidia launches three physical AI models at GTC Taipei: Cosmos 3 (world model), Alpamayo 2 Super (scaled-up autonomous driving model), and an open reference platform for humanoid robots.
Google fixes bugs in Gemini usage limits where a single Omni video consumed entire quotas. Ultra members now get twice as many video generations, failed requests are no longer charged, and Google plans increased transparency on usage.
Amazon MGM Studios and AWS launch a creators' fund and in-house AI platform called 'Project Nara'. Three animated series are in production with five-week timelines for pilots. Amazon claims the only end-to-end AI content ecosystem in the industry.
Diffusion models applied to basketball trajectory simulation conditioned on partial sketches of player movements. The model jointly refines all player trajectories, producing more natural simulations than autoregressive generation. Code and model fully open-sourced.
YouTube deploys automatic detection system to flag AI-generated or heavily AI-altered content starting May 2026. Labels will display more prominently: below player for long videos and as overlay on Shorts. Recommendations and monetization unaffected.
YouTube enforces visible labels to identify AI-generated videos. This measure aims to improve transparency and help users distinguish authentic content from synthetic content.
MoneyPrinterTurbo: open-source tool generating high-definition short videos with one click using AI LLMs. Automates video content creation.
MoneyPrinterTurbo: open-source tool generating HD short videos with one click using AI LLMs. Automates video content creation.
Autoregressive video diffusion models use quantized KV caches to reduce memory, but quantization creates an attention bias (Jensen bias) that degrades quality. Authors propose a per-attention-score correction computed from quantization step sizes, recovering quality lost with INT2 quantization while using 50% less memory than INT4.
Tail-Aware HiFloat4 applies W4A4 post-training quantization to the Wan2.2 text-to-video generation model. The method adapts ViDiT-Q using HiFloat4 format, quantizes transformer linear layers, preserves numerically sensitive modules in high precision, and introduces activation-tail-aware percentile calibration to reduce impact of rare outliers.
Creators produced a cinematic heist movie trailer by combining 4 AI models for $60. Demonstrates feasibility of low-cost AI video production.
A short film presented at Cannes cost $500k to produce, with $400k spent on AI compute. The ratio reveals the growing share of infrastructure costs in video generation and creative content production.
Meituan releases LongCat-Video-Avatar 1.5, an open-source framework for audio-driven human avatar video generation. Upgrades audio encoder from Wav2Vec2 to Whisper-Large, supports Audio-Text-to-Video and Video Continuation with 8-step inference. Human evaluation on 508 image-audio pairs across 6 scenarios and 2 languages.
xAI releases Grok Imagine Video 1.5, which animates still images into short clips with synchronized audio in a single pass. Guide on how to maximize output quality.
PRISM is a 10,372 instruction-code pair benchmark for evaluating programmatic video generation by LLMs. It proposes 4 metrics: code reliability, spatial coherence, visual complexity, and temporal density. Evaluation of 7 LLMs reveals a 41% execution-spatial gap: executable code does not guarantee spatially coherent output.
Google unveils Gemini Omni at its I/O 2026 conference, a video AI capable of mastering physics and maintaining character consistency in video generation.
ByteDance releases Lance, an open-source multimodal model with 3B active parameters. Supports image/video generation and editing in a single framework. Trained from scratch on 128 A100-GPU budget.
Hyperframes is a framework enabling AI agents to generate video content through HTML. Tool designed to automate video creation in agent workflows.
ViMax is an agentic video generation system integrating director, screenwriter, producer, and video generator roles. The GitHub project presents a multi-agent architecture for end-to-end video creation orchestration.
Focused Forcing optimizes KV caches in autoregressive video diffusion generation by selecting relevant historical frames per-frame and per-head. The method combines attention scores with diversity scores, achieving 1.48× end-to-end acceleration without training while improving visual quality and text alignment.
ANVIL is a multimodal generative system automating production of analogy-based instructional animations for computer science. Given a concept definition, it generates textual analogies, compiles them into structured visual screenplays, and produces executable manim code. Evaluation includes teacher studies and user adoption assessment.
TinySAM 2 compresses SAM 2 for efficient video segmentation. Memory quality management mechanism + joint spatial-temporal token compression. Achieves 90% of SAM 2.1 performance with 7% memory tokens and 3% training data. Reduces parameters, computational load, and deployment costs.
TAPE, a training-free pruning method for diffusion-based video generation, reduces computational overhead by intelligently removing tokens while maintaining temporal coherence across frames. It applies temporal smoothing between frames, performs token reselection per layer, and uses timestep-level budget scheduling to prune aggressively at early steps and relax during refinement.
Lance is a lightweight unified multimodal model supporting understanding, generation, and editing of images and videos. Built on dual-stream mixture-of-experts architecture with modality-aware rotary positional encoding, it combines collaborative multi-task training and adaptive data scheduling to outperform existing open-source unified models in visual generation.
Video inference enhancement method using a fuzzy controller (FC-r) to dynamically adapt model sizes based on available device resources. Leverages spatiotemporal correlation across adjacent frames. Balances inference performance and resource efficiency without scaling up model complexity.
Genflow is a Compound AI System for brand-aligned video generation. It combines a retrieval-based 'Brand DNA' extraction module with an Adversarial Multi-Agent Quality Control loop. The system iterates between generator and evaluator agents until deterministic consensus, improving brand-compliant yield from 42% to 89%.
AdaptiveLoad optimizes video diffusion Transformer training (DiT, MMDiT) by addressing load imbalance from quadratic attention complexity. Two components: dual-constraint adaptive load balancing and fused LayerNorm-Modulate CUDA kernel. On Wan 2.1: computational imbalance reduced from 39% to 18.9%, peak VRAM utilization +22.7%, training throughput +27.2%.
4D video generation model for robot manipulation enforcing multi-view 3D consistency through cross-view pointmap alignment supervision. Generates spatio-temporally aligned video sequences from single RGB-D image per view without camera poses as input. Demonstrates superior visual stability and robot end-effector trajectory recovery on simulated and real-world datasets.
Fre-Res introduces adaptive video-token compression for video MLLMs. The framework separates spatial details (high-fidelity anchors) from temporal evolution (residual-frequency tokens via 1D-DCT). A Spatial-Guided Absorber aligns frequency dynamics with visual embeddings. Results: near full-token performance with substantial reduction in token length across short and long-video benchmarks.
UniversalRAG is a multi-modal RAG framework that retrieves and integrates knowledge from heterogeneous sources (text, images, videos) at variable granularities. It introduces modality-aware routing to avoid intra-modal bias and organizes each modality into granularity levels. Validated on 10 benchmarks, it outperforms single-modality and unified baselines.
SIPO stabilizes diffusion model alignment to human preferences by addressing training instability and off-policy bias. The method introduces DPO-C&M to clip uninformative timesteps and applies timestep-aware importance reweighting. Experiments on SD1.5, SDXL, CogVideoX-2B/5B, and Wan2.1-1.3B demonstrate improvements over Diffusion-DPO.
MAVEN is a multi-agent prompt refinement framework improving cultural fidelity in text-to-video generation. It decomposes prompts into person, action, and location dimensions handled by specialized agents. Benchmark of 243 culturally grounded prompts and 972 videos (Chinese, American, Romanian) with CLIP and VLM-as-judge evaluation.
Hugging Face releases a guide for fine-tuning NVIDIA Cosmos Predict 2.5, a robot video generation model, using LoRA/DoRA. The method reduces GPU resource requirements while maintaining generation quality for specialized robotics use cases.
Google DeepMind expands access to Google AI Ultra subscribers globally and introduces a new capability powered by Street View to simulate real-world places.
Google DeepMind releases Gemma 4, a frontier multimodal model handling text, images, and video. Optimized for on-device inference, it delivers advanced reasoning capabilities and outperforms competing models on key benchmarks.
OpenAI launches Sora 2 and its app with built-in safety protections to address risks from an advanced video model and social creation platform. The approach relies on concrete moderation and control mechanisms.