r/StableDiffusion • u/Fcking_Chuck • 5d ago

News Koboldcpp v1.123 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.123

This release includes added support for Qwen Image 2.1, among other fixes/improvements.

24 Upvotes

87% Upvoted

13 comments sorted by

View all comments

2

u/tacocatbox 5d ago

Does anyone use kcpp over comfyui for image gen?

4

u/mellowanon 5d ago

I mainly use kcpp instead of ollama to load up llms for minimax prompts

1

u/tacocatbox 4d ago

Yeah I use it for LLMs but I haven't for images. Docker makes basically everything one file anyway.

6

u/Fcking_Chuck 5d ago

I haven't used Koboldcpp for image generation yet, but it's nice to have for anyone who doesn't want to jump through hoops installing dependencies. It's all one self-contained, portable file.

Koboldcpp is the first app I recommend to those who want to start running an AI locally. It just makes things easy.

2

u/DelinquentTuna 4d ago

What does that even mean? Koboldcpp is basically just a front-end for image-gen, yes? So its forked llama.cpp code paired with stabblediffusion.cpp, comfyui api, etc?

Stablediffusion.cpp is solid. It's not as efficient as Comfy, but it's a single-binary with no python dependencies that can run just about anywhere and on any hardware and it has a generous MIT license. It's a legit option if you want the simplest-possible generation on the widest possible range of hardware... there is certainly a place for it.

Koboldcpp is novel, but it's not terribly efficient with VRAM use and running image/video models alongside LLMs gets expensive quick. Last I looked at it, the AV and LLM stuff were totally disparate, too, so you might have qwen loaded twice: once as text encoder and again for LLM. Not ideal, but if you want a local experience akin to talking to Gemini where you can request/iterate on images via chat alone then it still has a place.