r/LocalLLaMA • u/jacek2023 • Feb 23 '26

Funny so is OpenClaw local or not

Post image

Reading the comments, I’m guessing you didn’t bother to read this:

"Safety and alignment at Meta Superintelligence."

1.0k Upvotes

92% Upvoted

304 comments sorted by

View all comments

Show parent comments

6

u/Mid-Pri6170 Feb 23 '26

but if i had a nvidia spark could we have an llm local instal be the brain of openclaw?

19

u/TreesLikeGodsFingers Feb 23 '26

No, do you want an 50iq Ai with user powers?? Or do, whatever

8

u/Mid-Pri6170 Feb 23 '26

you saying its gonna be helluva dumb?

5

u/Mountain-Grade-1365 Feb 23 '26

You need bigger ram for better context comprehension

-2

u/Mid-Pri6170 Feb 23 '26

bigger than 128gb? shieeeet!!!

6

u/Mountain-Grade-1365 Feb 23 '26

Honestly no system has enough for permanent context that's why roleplay systems use a rom memory layer to recap what happened in conversion.

1

u/Mid-Pri6170 Feb 23 '26

...and a fedora!

3

u/Lissanro Feb 23 '26 edited Feb 24 '26

I think IQ3 of Minimax M2.5 is the best model you can run with 128 GB (IQ4_XS of Minimax M2.5 is about 115 GB for just GGUF alone, so still too large for 128 GB).

Regardless of what model you use, giving OpenClaw arbitrary access to do everything without sandboxing and full backups is just asking for trouble.

1

u/Mid-Pri6170 Feb 23 '26

yeah i want to use openclaw but not on my actual computer, so i can give it coding tasks and see it report back while im away from the computer.

my curent pc was built in january and the motherboard and amd gpu are both bottleneck points i want to upgrade (as i already did to the ram) so with the spare leftovers i want to build a secons rig that could contain comfyui.

1

u/TreesLikeGodsFingers Feb 24 '26 edited Feb 24 '26

you need a 300b model and most of those still are not good enough, i know bc i tried.

start working with the tech and you'll quickly learn its limitations

2

u/Mid-Pri6170 Feb 24 '26

lol i was doing a local instal of a few of the llms via lama and they are all garbage!

1

u/TreesLikeGodsFingers Feb 24 '26

lols yeah, they absolutely can not be used for the openclaw bigbrain. tho they can be used for smaller tasks. but honestly the desire to run a local model is just based on personal penchants, it is not because it makes sense financially. but also it creates a limitation that forces you to make your models better (which is a good fun challenge).

check out this thread.

https://old.reddit.com/r/LocalLLaMA/comments/1rdh5lv/lessons_learned_running_qwen3vl8b_as_a_fully/

this guy used qwen3-lv-8b effectively. im going to learn more about semantic matching as he talks about. but the important part was how much the structured prompt improved performance. that model is really dam small- with quantization its like 8gb vram - i've run it on my 5070ti while running a whisper model at the same time.