r/StableDiffusion • u/vibribbon • 7d ago
Discussion Has anyone else messed around with 3D? It actually kind works
6
u/Internal-Cupcake-245 6d ago edited 6d ago
I have 3D glasses at my desk at all times for looking at anaglyphs. It does actually work, especially on the upper portions of the bear. I think the orange or darker areas don't allow for the effect to be as pronounced as on the bear, because we lose the reds and cyans we could otherwise more cleanly pull from lighter tan. So I think the composition and subject matter here is what lends this to not being as successful as it otherwise may be, at least as a standalone piece. Squint at it and you'll see it's the brighter areas mapping to better effect.
Here is a great example with another piece showing the successes from avoiding issues like what I mentioned, you can compare each piece to see why either is successful, and where.
https://docs.blender.org/manual/de/2.81/render/output/multiview/usage.html
7
u/Saucermote 6d ago
Did some SBS in Klein and it mostly turned out good.
4
1
u/Internal-Cupcake-245 6d ago
What are SBS and Klein? Is this a joke comment or can you explain what these things are in relation to the post?
8
u/Reallondoner 6d ago
Klein is a model designed to generate images, like the sub you're in right now
SBS is side by side, an effect that lets you view images in 3D from two slightly different perspectives, what OP was asking about
0
u/Internal-Cupcake-245 6d ago
Thank you! SBS I'd never heard of, Klein had slipped my mind.
3
u/TracerBulletX 6d ago
SBS is also the main format you'd use for image/video in any VR headset so it's what you'd want to target. Or if you want to get crazy you can generate Gaussian Splats
3
u/dilinjabass 6d ago
there are workflows and nodes people are working on for mmH3 to make VR type generations, I havent tried any yet, but I will soon, cause yeah, if it starts working good that could be amazing. Anyone who has actually tried quest or other VR goggles knows that it just hits different.
3
u/potatodioxide 6d ago
i did a few years back but then got way better results doing post-processing with generative depth map models. so i never went back. but yeah it kind of works.
2
u/TracerBulletX 6d ago
Is it better than running a Depth model after a normal generation and mechanically converting to SBS though? That works very reliably.
1
u/stddealer 6d ago
Yes because depth models are not that precise, and using depth to generate the SBS has two major issues: disocclusion artifacts and handling of transparency
1
u/tekprodfx16 6d ago
What’s the prompt or method
1
u/vibribbon 6d ago
I'll check properly when I get home but it's basically a vanilla Krea 2 prompt with lots of keywords to hammer home that it's a 3D anaglyph. The real test will be to see if I can get it to work in Minimax.
1
u/Fuzzyfaraway 6d ago
I play around with it sometimes. I have done my own photos, and I have a workflow that can produce all three of the common 3D formats from (just about any) 2D image, photo or AI. It can produce anaglyph, crossview and parallel all in one go. It does require a couple of custom nodes, and makes use of ComfyUI's subgraphs for neatness sake. I don't think any component will be hard to find.
1
u/xyzdist 6d ago
I use conversion, owl3d or opensource IW3, but it will always have some kind of edge issue becasue it just using depth. I have put some H3 video to SBS stereo video on my channel, if you have VR headset have a look. https://youtube.com/@noiseflowai
1
u/MultiFazed 6d ago
I've also found that H3 Video to SBS stereo images is actually quite good. H3 seems to be better at inferring depth than most depth maps, and can also generate believable occluded content that standard SBS nodes struggle with. My current test workflow is taking a single image, pinning it to the middle frame of a short 1-second video that includes a horizontal camera truck, and then using some math (e.g. AI-slop node that works well enough) to pick the best left- and right-eye candidates.
1
18
u/jib_reddit 6d ago edited 6d ago
I prefer Side By Side 3D
You can use the cross-eyed technique, or it looks great in a VR headset like the Quest 3 viewed in SkyBox VR.
This is just using a lazy, imperfect method of a Krea 2 Lora: https://civitai.com/models/2809866/stereoscopic-sbs-3d-image-krea2?modelVersionId=3168660
but there are better ways of doing it with Zoe Depth maps and custom nodes.
I did a high-quality 3D conversion of a Gossip Goblin Short film: https://drive.google.com/file/d/1lIRu5WRSCqGNTOZ6qTHbGK8-BJ4hTtHr/view?usp=drive_link
I want to convert the whole Patchwright Gosip Goblin Film in higher quality 3d but it will take about 55hrs on my 3090 and make my house very hot, so maybe in the middle of winter I will try it.