Abstract
APEX extends a streaming video generation method by replacing a separate fake-score network with condition shifting to estimate the generated distribution’s velocity field, improving instruction following and visual aesthetics while reducing memory and iteration time relative to DMD.
Few-step sampling reduces the cost of streaming video generation. Distribution Matching Distillation (DMD) supervises few-step generators with a separate fake-score network, which adds training memory and computation and must track the evolving generator. We extend APEX to streaming video by using condition shifting to estimate the velocity field of the generated distribution within the generator. The original text condition selects generation, while a shifted condition selects fake estimation using the same parameters. This removes the independent fake network while retaining S2-Avatar's frozen reference teacher, Self-Replay Forcing, and perceptual regularization. We evaluate APEX on 180-second videos using three backbone evaluations per block and a one-step spatial Refiner, with a 70-case human study and a 320-case StreamAV-Bench comparison. Compared with S2-Avatar, APEX achieves higher video instruction fulfillment on the Progressive track (3.856 versus 3.831) and higher visual aesthetics across both tracks (0.641898 versus 0.632606). Human raters favor APEX most strongly on instruction following, with +30.0% net preference, followed by consistency and video quality at +4.3% each. Motion quality favors S2-Avatar, audiovisual synchronization is predominantly tied, and usability is unchanged. Separate measurements under matched training settings show 4.4% lower peak allocated GPU memory per GPU and 9.2% shorter mean iteration time than DMD.
Community
Hi everyone! We’re sharing our latest work extending APEX from image generation to few-step streaming video generation.
Condition Shifting lets the generator and fake estimator share one network, removing the separate fake-score network and reducing training overhead.
On 180-second videos, APEX achieves +30.0% net human preference for instruction following over S2-Avatar. Under matched training settings, it reduces peak GPU memory by 4.4% and average iteration time by 9.2% compared with DMD.
We welcome feedback and HF upvotes! 🤗
📑 arXiv
🎬 Project Page
💻 Code
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Intrinsic Distribution Matching (2026)
- Rollout-Marginal Distillation for Long-Horizon Autoregressive Video Generation (2026)
- TaoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation (2026)
- VidDub: Replacement-Aware Distillation for Two-Step Video Dubbing (2026)
- Parametric Trajectory Distillation for Few-Step Video Generation (2026)
- Rethinking Streaming Video Diffusion Model: Context, Execution, and Training (2026)
- Where and When to Force: Routed Forcing for Streaming Avatars (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.14033 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper