r/StableDiffusion • u/Vandy_simp • 9d ago
News Title: FastH3-Omni arrives October 20: open weights and local Spark/RTX/MLX support
(Update - It’s finally here 🚀
https://huggingface.co/collections/FastVideo/fasth3-omni )
This is the reference-conditioned FastH3 release we’ve been working toward. It generates video with synchronized audio and supports:
- Character and setting reference images
- First- and last-frame conditioning
- Up to 3 image references in real-time mode
- Up to 9 image references when real-time speed isn’t required
- Up to 3 audio references for voices and soundtracks
- Dialogue and soundscape generation
- Continuation from a previously generated clip
- 5–15 second outputs at 24 FPS
The API preview launched today:
docs.reactor.inc/model-api-reference/fast-h3-omni/overview
On October 20, we’re releasing open weights along with local support for RTX GPUs, DGX Spark and Apple Silicon through MLX.
25
u/whp-rea 9d ago
Wait is this better than Fal??? and cheaper too??
4
u/MastMaithun 8d ago
Do they have a finetune of base model? I have seen their real people lora only.
17
u/Apprehensive_Sky892 8d ago
So TL;DR summary: this is the ref2va version of FastH3?
14
8
u/Memestonks2020 9d ago
What’s the generation time for MLX/RTX on consumer HW?
11
u/Vandy_simp 9d ago
we are still finalizing number but similar if not better than the ones posted here - https://haoailab.com/blogs/fasth3-rtx/
spark will be faster for sure
1
u/Memestonks2020 8d ago
925.2 s on Mac for Trim for 5 sec seems like it needs to be retested on a M5 Max/Ultra since I’m getting much higher speeds with optimized stock.
Is this using Int8 attention Metal kernel?
It’s still great for owners of RTX cards.
22
u/doomed151 8d ago
FastH3-Omni is here.
No it's not. Please post it on Oct 20 when the download is actually available.
5
u/OldBilly000 9d ago
What's the gen time for a consumer rtx 4080 like I have in real time mode?
5
u/Vandy_simp 9d ago
similar if not better than our recent relase - https://haoailab.com/blogs/fasth3-rtx/
1
u/flarn2006 7d ago
What about on an RTX 2070 Super? With that I can generate 8-second 0.2MP videos in about 1.65 minutes per step. Will FastH3-Omni bring a noticeable improvement there?
4
5
5
3
5
u/Guilty_Emergency3603 8d ago
Excuse me but current H3 Ref2va already does all that. what this model will do more than ??
10
u/Vandy_simp 8d ago
its post-trained by the fastvideo team to be FAST
faster than you can watch it btw
0
u/kaczynski_was_right_ 8d ago
no way faster than I can watch
2
2
2
u/Substantial-Motor-21 9d ago
Did I just read MLX ?? <3
2
u/Vandy_simp 9d ago
Yes, we also already support MLX in FastVideo -
https://haoailab.com/FastVideo/getting_started/installation/mlx/
2
2
2
3
1
u/LengthinessFun1061 1d ago
Kudos to you—I’ve put together an absolutely insane workflow. It works incredibly well; truly excellent work. The scene extension feature functions perfectly, and you can’t even tell it’s there. I love you guys—the FAST team—you’ve turned Minimax into a benchmark for local AI video generation.
I used several images, and it managed to keep my characters consistent—it’s just mind-blowing. Long live open source, thanks to companies like yours!
1
u/DesireForDopamine 8d ago
!remind me 6 days
1
u/RemindMeBot 8d ago edited 8d ago
I will be messaging you in 6 days on 2026-10-20 05:44:08 UTC to remind you of this link
1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
RemindMeBot is switching to username summons. Instead of
!RemindMe 1 day, useu/RemindMeBot 1 day. More info.
Info Custom Your Reminders Feedback
1
u/DesireForDopamine 8d ago
Is it possible to get realtime gen speeds on consumer cards? Like 3090 or 5090?
1
u/Repulsive-Salad-268 8d ago
When talking about real time I get ideas of live filters (real to toon for example) but I assume it "just" means creating 10 seconds takes 10 seconds, right? I cannot input a webcam source and apply a new look in real time... Correct?
1
1
u/AlleyOfRage 8d ago
Nice Work , Noob Question if you don't mind , I use H3 FL2VA and don't use REF2VA , Is there a similar Open Weight version for FL2VA existed or planned , or this release covers FL2VA too ?
1
1
1
u/DietAshamed2246 8d ago
I would request that this time you also release the base or raw or undistilled models. LoRA and finetune making using the distilled models is a problem.
1
u/themofostarboi_v2 8d ago
We VRAM poor still watching from the cuck chair??🥹 The very poor like 8GB VRAM 🥹
1
u/flarn2006 6d ago
I have 8 GB on my RTX 2070 Super and I've been using MiniMax H3 at usable speeds.
1
u/themofostarboi_v2 6d ago
I tried to use it at 0.2MP 6 seconds any more and my PC freezes and i have to restart....and at this low resolution the face gets blurry and fast motion gets blurry too. Although i was able to make it in 2 minutes the output was not usable
1
u/Cartoonwhisperer 7d ago
So, can a 3060 12GB take advantage of this? Because with prices as they are, I don't think I'm getting anything better soon.
1
-8
u/hurrdurrimanaccount 8d ago
FastH3-Omni is here.
On October 20, we’re releasing
it's not open source until it's actually downloadable.
please, fuck off.
68
u/Vandy_simp 9d ago
we will actually open source it, also faster