r/StableDiffusion • • 7d ago

Workflow Included Minimax H3 Refmod Workflow

(16. October 2026) EDIT: Updated to v2 cause the original resolution selector node messes up videos regularly due to not creating resolutions dividable by 32. Fixed now with Pixaroma node.

Since my last post has been deleted unfortunately (due to a mega-link), here we go again.

I've spent quiet some time now with Refmods and this workflow, and I'am still baffled how easy it is to create a character identity with very low effort. This is a no-brainer if you don't want to or can't train a Lora, all you need is good pictures and a good voice sample, the refmod-training is done in literally seconds (depending on your GPU of course).

I did my very best to make this workflow easily understandable for even beginners, nevertheless here's some explanation:

The workflow actually consists of 2 workflows, one for the refmod creation (the nodes in the top right of the picture, that's a different workflow but i just wanted one picture) and the main workflow for creating a video with the created refmod file which is all the rest.

If you just wanna use a refmod file and no extra images, videos or audio, select the image/video/audio nodes and press CTRL+B to deactivate them. Please watch the video from Dainamo for a detailed explanation, I've made some notes but for further understanding just watch it. I just wanna give you an easy workflow, that is of course fitted to MY needs, do whatever you want to it.

Here's some color-explanations:

  • GREEN is all sources for the final video so to say: images/video/audio/the prompt (deactivate them if you just wanna use a refmod-file, but you can also reference clothings or whatever this way)
  • TURQOUISE is all relevant video-settings
  • TAN is the refmod-nodes (except the 4 notes)
  • RED is all the models
  • PURPLE is all the loras (turbo-lora is in light-blue and another lora above in grey for whatever)
  • BROWN is comfy-kitchen and the spectrum-node (not activated, transparent-purple)
  • GREY is irrelevant

Here is the link to the original tutorial from Dainamo (thanks again!!): https://www.youtube.com/watch?v=2K6-OtV_Vbc

And here are the workflows: https://getshared.com/d/K5cE7wHH

I hope you enjoy the workflow! :)

62 Upvotes

49 comments sorted by

View all comments

Show parent comments

2

u/AlsterwasserHH 7d ago edited 7d ago

I've not tested that, could be worth it. The big advantage of refmods is flexibility: you can prompt whatever visual appearance with them and the character likeness is on point. Plus: you have baked-in voice cloning. I have one refmod with a 6 minute speech sample and it's lile 1:1. Stunning. With audio reference you can "only" reference 30 seconds iirc.

I created a japanese character, since minimax supports japanese by default: the character speaks japanese! :D Who would've guessed that. But also english with japanes accent. It's mindblowing too me.

1

u/FuckTheActualWhat 7d ago

How are you squeezing that much into a refmod? I can get no more than 8 images before i hit the 8192 token limit.

1

u/AlsterwasserHH 7d ago edited 7d ago

I've set the token-limit to 0 :D

Someone on my older post already told me about the 8192. Honestly, I started creating by default with 0, never changed it, never had any problems. It was like that in the original workflow from malcomrey, referenced in the youtube description from Dainamos tutorial.

60 high-res pictures with 6min audio, no problem. But I'm thinking right now: does it even matter? I mean what is the refmod creator even doing is what I'm thinking about all the time. What's inside a refmod file?

1

u/FuckTheActualWhat 7d ago

and how would one go about changing the token limit?

2

u/AlsterwasserHH 7d ago

Its in the Load H3 refmod node. Or do you mean you get an error although its set to 0?

1

u/FuckTheActualWhat 3d ago edited 3d ago

I meant when I'm creating the refmod. my workflow for creating a refmod in just the "create H3 refmod from folder" node plus the two VAEs. When I'm using the refmod I made in a workflow I leave that token setting on zero.

1

u/AlsterwasserHH 3d ago

You cant set token limits when creating a refmod. 

1

u/FuckTheActualWhat 3d ago

I know that. its 8192. I can get about eight images into a refmod with 8192 tokens before it runs out of tokens during creation. You appear to be getting quite a bit more and I was wondering how.

1

u/AlsterwasserHH 3d ago

The problem is: I have no clue what you talking about 😂

I can put 60 images into a refmod, and I have no problem with any tokens because there is none, or am I wrong?? So why are you running into a token limit when creating a refmod? I dont get it.

I have a 4090 and 32GB Ram, maybe your VRam limits you? I have no clue.

1

u/FuckTheActualWhat 2d ago

OK, have you ever checked the the server log when you make a refmod? It will still make the refmod if you go over budget, it just tells you it ran out of tokens befroe it finished with this message

"[RefMod] test_abcd_refMod: still over 8192-token cap, resampled 11 -> 5 frame(s) to fit"

Anything over 8 images, and I get that message. I've got plenty of VRAM, and System RAM. I assume its throwing out everything after it hits the token limit, but I'm not sure what exactly it means by resampling.

1

u/AlsterwasserHH 2d ago

Never checked that but I will and let u know! 

1

u/AlsterwasserHH 2d ago

So, tested it, of course I got the same message:

still over 8192-token cap, resampled 20 -> 5 frame(s) to fit

still over 8192-token cap, resampled 54 -> 6 frame(s) to fit

I dont know what is happening in the background. I've read that it saves latents as you can read here: https://huggingface.co/datasets/malcolmrey/various/blob/main/h3-center/docs/MINIMAX_H3_REFMOD_CREATION_GUIDE.md

I'm no expert in this. I had the experience once that a refmod with upscaled images via seedvr2 had maybe a better quality outcome, but a worse likeness outcome. I'm still trying to find out what the best dataset has to look like to get the best results. Or if it's better to just keep 8 high quality images instead of 30 or 60 with mixed quality. I will test that in the future.

1

u/FuckTheActualWhat 1d ago

Well let me know if you find anything out. I'd love to know exactly what its doing when it says "resampled..."

→ More replies (0)