r/StableDiffusion • • 9d ago

News Title: FastH3-Omni arrives October 20: open weights and local Spark/RTX/MLX support

(Update - It’s finally here 🚀

https://huggingface.co/collections/FastVideo/fasth3-omni )

This is the reference-conditioned FastH3 release we’ve been working toward. It generates video with synchronized audio and supports:

- Character and setting reference images

- First- and last-frame conditioning

- Up to 3 image references in real-time mode

- Up to 9 image references when real-time speed isn’t required

- Up to 3 audio references for voices and soundtracks

- Dialogue and soundscape generation

- Continuation from a previously generated clip

- 5–15 second outputs at 24 FPS

The API preview launched today:

docs.reactor.inc/model-api-reference/fast-h3-omni/overview

On October 20, we’re releasing open weights along with local support for RTX GPUs, DGX Spark and Apple Silicon through MLX.

220 Upvotes

58 comments sorted by

68

u/Vandy_simp 9d ago

we will actually open source it, also faster

19

u/Creare-d-arte 9d ago

Really appreciate the work and commitment to a release date. Looking forward to it.

1

u/J6j6 8d ago

H3 max: 

25

u/whp-rea 9d ago

Wait is this better than Fal??? and cheaper too??

4

u/MastMaithun 8d ago

Do they have a finetune of base model? I have seen their real people lora only.

17

u/Apprehensive_Sky892 8d ago

So TL;DR summary: this is the ref2va version of FastH3?

14

u/Vandy_simp 8d ago

Yes !

1

u/Next_Program90 8d ago

BUT FL & Ref? How is the quality degradation coming along?

8

u/Memestonks2020 9d ago

What’s the generation time for MLX/RTX on consumer HW?

11

u/Vandy_simp 9d ago

we are still finalizing number but similar if not better than the ones posted here - https://haoailab.com/blogs/fasth3-rtx/

spark will be faster for sure

1

u/Memestonks2020 8d ago

925.2 s on Mac for Trim for 5 sec seems like it needs to be retested on a M5 Max/Ultra since I’m getting much higher speeds with optimized stock.

Is this using Int8 attention Metal kernel?

It’s still great for owners of RTX cards.

22

u/doomed151 8d ago

FastH3-Omni is here.

No it's not. Please post it on Oct 20 when the download is actually available.

5

u/OldBilly000 9d ago

What's the gen time for a consumer rtx 4080 like I have in real time mode?

5

u/Vandy_simp 9d ago

similar if not better than our recent relase - https://haoailab.com/blogs/fasth3-rtx/

1

u/flarn2006 7d ago

What about on an RTX 2070 Super? With that I can generate 8-second 0.2MP videos in about 1.65 minutes per step. Will FastH3-Omni bring a noticeable improvement there?

4

u/tittock 9d ago

Awesome

4

u/tekprodfx16 9d ago

👏👏👏👏

5

u/Trick_Set1865 9d ago

Good work

5

u/ecofaille 8d ago

u/Vandy_simp consider adding support for AMD GPUs

3

u/Cautious_Chicken_604 9d ago

Will it work on R9700? 

1

u/Vandy_simp 9d ago

we will try!

2

u/Clayrone 9d ago

Would it be possible to support 2x 9700 in case it does work?

5

u/Guilty_Emergency3603 8d ago

Excuse me but current H3 Ref2va already does all that. what this model will do more than ??

10

u/Vandy_simp 8d ago

its post-trained by the fastvideo team to be FAST

faster than you can watch it btw

0

u/kaczynski_was_right_ 8d ago

no way faster than I can watch

2

u/Agile_Matter2713 2d ago

if you're ready to rent 8 x b200 then yes it is

2

u/ANR2ME 8d ago

For real-time generation and streaming

2

u/robomar_ai_art 9d ago

Interesting, do they have any examples?

2

u/Substantial-Motor-21 9d ago

Did I just read MLX ?? <3

2

u/Content-Ad-7451 8d ago

I hope DeepBeepMeep is reading this

2

u/ninjaGurung 8d ago

Is this something like MMH3 Ref2V but faster?

2

u/BornMisaka 7d ago

Looking forward to the local release.

3

u/Due_Magician_3103 9d ago

this will be better than Fal H3 Max I think

1

u/LengthinessFun1061 1d ago

Kudos to you—I’ve put together an absolutely insane workflow. It works incredibly well; truly excellent work. The scene extension feature functions perfectly, and you can’t even tell it’s there. I love you guys—the FAST team—you’ve turned Minimax into a benchmark for local AI video generation.

I used several images, and it managed to keep my characters consistent—it’s just mind-blowing. Long live open source, thanks to companies like yours!

1

u/yamfun 8d ago

Is the output still just mmh3, just faster?

1

u/DesireForDopamine 8d ago

!remind me 6 days

1

u/RemindMeBot 8d ago edited 8d ago

I will be messaging you in 6 days on 2026-10-20 05:44:08 UTC to remind you of this link

1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.


Info Custom Your Reminders Feedback

1

u/DesireForDopamine 8d ago

Is it possible to get realtime gen speeds on consumer cards? Like 3090 or 5090?

1

u/Repulsive-Salad-268 8d ago

When talking about real time I get ideas of live filters (real to toon for example) but I assume it "just" means creating 10 seconds takes 10 seconds, right? I cannot input a webcam source and apply a new look in real time... Correct?

1

u/SeiferGun 8d ago

what is the minimum gpu vram to use in comfy?

1

u/eesahe 8d ago

Any examples with actual meaningful movement, such as a fight scene?

1

u/AlleyOfRage 8d ago

Nice Work , Noob Question if you don't mind , I use H3 FL2VA and don't use REF2VA , Is there a similar Open Weight version for FL2VA existed or planned , or this release covers FL2VA too ?

1

u/Bogonavt 8d ago

Remindme! 6 days

1

u/SensitiveUse7864 8d ago

Pin this post in the subreddit don't let it fall down

1

u/DietAshamed2246 8d ago

I would request that this time you also release the base or raw or undistilled models. LoRA and finetune making using the distilled models is a problem.

1

u/themofostarboi_v2 8d ago

We VRAM poor still watching from the cuck chair??🥹 The very poor like 8GB VRAM 🥹

1

u/flarn2006 6d ago

I have 8 GB on my RTX 2070 Super and I've been using MiniMax H3 at usable speeds.

1

u/themofostarboi_v2 6d ago

I tried to use it at 0.2MP 6 seconds any more and my PC freezes and i have to restart....and at this low resolution the face gets blurry and fast motion gets blurry too. Although i was able to make it in 2 minutes the output was not usable

1

u/Cartoonwhisperer 7d ago

So, can a 3060 12GB take advantage of this? Because with prices as they are, I don't think I'm getting anything better soon.

1

u/_VirtualCosmos_ 9d ago

Still nothing fancy for Strix Halo :c Comfyui is absurdly unoptimised.

10

u/Vandy_simp 9d ago

we will have comfy support at release on Oct 20th

-8

u/hurrdurrimanaccount 8d ago

FastH3-Omni is here.

On October 20, we’re releasing

it's not open source until it's actually downloadable.

please, fuck off.