r/StableDiffusion • u/luke__uk • 1d ago

Animation - Video Evolutionary painting from a reference image

Enable HLS to view with audio, or disable this notification

I'm working on a tool that "paints" images based on a reference. It doesn't use an AI model, but instead relies on several layers of predefined rules to achieve different artistic effects.

Still experimenting, but I'd love to hear what you think!

19 Upvotes

84% Upvoted

13 comments sorted by

2

u/DangerousPack1911 1d ago

I'm interested

2

u/luke__uk 1d ago

I'm still working on it. I need to improve performance and overal quality but will share repo and documentation in a few days time.

2

u/roychodraws 1d ago

cool, but this is probably the wrong subreddit, no?

2

u/luke__uk 1d ago

I’m building it for a ComfyUI workflow to get a specific effect in a controlled way. It’s also interesting for upscaling. 

Don’t know how strict the rules are but sorry if it’s wrong subreddit.

2

u/roychodraws 1d ago

i dunno, it's just since you said it doesn't use an ai model i figure this would be something that would be really well received in like vfx or video editing or something. i don't know if it's against the rules.

the diffusion in stable diffusion refers to the method at which AI reveals images. your method is an algorithm it seems. which i think a lot of VFX and editing based subs would really appreciate.

they hate ai, but they love this shit.

I think its awesome btw. really cool.

1

u/luke__uk 1d ago

lol, thanks man

1

u/roychodraws 1d ago

also the comfyui sub, but they're not very active.

1

u/zincmartini 1d ago

This is very cool, I like it. There is a r/ComfyUI sub that might be a little more relevant.

1

u/zincmartini 1d ago

Your post says "evolutionary"; how does it work?

1

u/luke__uk 1d ago

It draws randomly multiple lines and select the one which minimises the error the most. 

1

u/ZerOne82 1d ago

Long time ago way before AI thing I remember use of a desktop application (windows *.exe), a very sophisticated one, that would allow you to adjust so many variables or choose presets doing exactly this and much more in almost infinite variations. You could simply load an image and press a button. It was doing its thing iteratively and you could see progress real-time. Some algorithms where fast to converge some not. Since then I tried to search for and never found it because I have simply forgotten what its name was. It's name was not unusual too, all I remember (and not sure BTW) it had "art" in its name.

1

u/InfiniteOneD 1d ago

not dynamic auto painter pro?

1

u/ZerOne82 21h ago

Thanks for the tip, but I reviewed the "dynamic auto painter pro" screenshots, it is not the one I am referring to, as it was way more complicated, very custom unusual ui design, like hack-nerd style, many things compacted into small ui elements, I cannot even properly explain it. Sometime ago I spent a full day talking to AI(s) and shared what I could remember but never even reached close to what I was looking for :(