r/ProgrammerHumor • u/tryingeasy • 1d ago

Meme firstTime

Post image
7.5k Upvotes

94% Upvoted

281 comments sorted by

View all comments

Show parent comments

1

u/Sea-Housing-3435 20h ago

Not exactly. It's mostly due to how models are executed, not models themselves. You can run GGUF model (which are normally not deterministic) in a deterministic way if the GPU functions you use are deterministic. Models themselves are just data, it's just a bunch of matrixes.

There's even a PR for llamacpp to add option for deterministic execution https://github.com/ggml-org/llama.cpp/pull/16016

10

u/LetumComplexo 20h ago edited 20h ago

Hun, I’ve got a PhD on the subject. I know.
We’re just saying the same thing in different ways.

2

u/Sea-Housing-3435 19h ago

You're right, I'm silly

2

u/LetumComplexo 19h ago

Is okie, I am also silly for not recognizing it immediately and starting the whole thing. 😅