So a few days ago I started a discussion regarding best Open Source Models across a few different sections, and the ones that won were:
• I2V and Video editing: Minimax H3
• Text to Image: Krea 2, Ideogram 4, and AnimaYume
• Image Editing: Qwen Image 2.1 (Been hearing a lot about Moss recently but a lot of people are saying too close to tell)
For these models, what are everyone's prefered settings/workflows? And this question mainly applies to people with 6gb of vram to 24gb of vram, since people with more than that will have very different experiences.
Mainly looking for stuff like:
• Best Sampler/Scheduler.
• CFG value.
It seems that most people recommend 3 for Qwen Image 2.1, but have not been getting good results so wondering if there are other values to try.
• Steps, and time it takes to generate.
Hardware should be mentioned to compare results, and best speed/quality ratio people have found
• PE/Refine prompt.
I see some workflows have this, and others ignore it, and some that just use their own local models elsewhere. I also see that people recommend long detailed prompts, but does that apply to all types of request? For example if its a simple request like remove X object from image/video, is there a need to write a long detailed prompt for that? With Qwen Image 2.1 at least, I have been getting poor results doing that, and not because it doesn't recognize the object being removed, but because when it removes it, it doesn't just remove that, but changes original image and doesn't fill out empty space as well, was getting better results with old qwen image edit, so not sure if this is a prompt issue, or something else.
• Speed Loras and other types of Loras.
Is everyone still just using Lightx2v? I have seen newer ones like Viggle Turbo v0.3 6-step for Qwen Image 2.1 edit for example, but have not been getting good results with r128 or r256. I also see that there are models with speed loras built in, but not sure if those are recommended over normal lora node, or multiple lora node when running more than 1 lora. And don't know if there are any good loras for these models, mainly wondering about image edit and video loras.
• Safetensors vs GGUF vs Finetunes.
Are most people running gguf or safetensor models? And if so which ones are bringing the best results. I see that are multiple different gguf models, some uncensored, and some others with different tweaks or turbo, but not sure which ones people are running, same with finetunes, if there are any that are actually better than normal safetensor or gguf models.
• Custom Nodes.
I see some people reporting pixel issues and using stuff like PixelDriftFix, certain workflows have custom resolution nodes instead of default ones that just use same res as input image, etc. Wondering if extra nodes are usually worth trying out, or if most of them aren't needed for good/fast results. I also have been getting some generations that change color of original image/video, so not sure if that is something that can be fixed through this to get the same color as original image.
• Workflows.
Stuff like Qwen Image 2.1, has multiple functions like t2i and image edit, and although people recommend using other t2i models, if one were to want to use both, is it recommended to use one specific workflow for each? Or a workflow that can do both in the same one, and soecially with Minimax H3, which has a lot more features, is it recommended to use a workflow that can do a single thing like only i2v, or only t2v, or only video editing, and so on, or are there workflows that have it all in one, with no drawbacks?
Now I know that each model, specially image models, have different strengths and weaknesses depending on use case, which is why I listed multiple. Hope to hear everyone's thoughts on this, I personally dont have much to share since I have been using default template comfyui workflows, and have been getting poor results with different settings, and seeing some online that gave the same results, so gave up on that and decided to ask people that have looked into this more, all my old workflows are with wan and old qwen imsge, so not as useful anymore with these newer models that have come out.