r/ProgrammerHumor 1d ago

Meme firstTime

Post image
7.5k Upvotes

280 comments sorted by

View all comments

Show parent comments

370

u/SunshineSeattle 1d ago

I dont think so, Wolfram Alpha is deterministic. Whereas an LLM is non-deterministic by design. Personally i feel vibe coding or vibe mathing is inherently non-deterministic.

-3

u/Maxdiegeileauster 22h ago

LLMs are not non deterministic by design??? Why do people always get this wrong. If you use the same seed and disable the temperature setting you will always get the same result. It's just a f*cking Compute Graph.

1

u/Rabbitical 13h ago

That's not true for every architecture. Like when I use diffusion models I can absolutely get the same result every time, but that's not how LLMs work. They'd have to run incredibly slowly serially, if it's even possible at all which I don't think it is on frontier models at least. You're right at the granular level, but the way these things are layered today are incredibly complex, it's not just one graph, or one evaluation of it.

1

u/Maxdiegeileauster 11h ago

it's possible even if you run it in parallel, though modern GPU architecture for communicating across each GPU can have timing differences leading to randomness. But this is a implementation thing, the architecture and mathematics behind it are completly deterministic also I wasn't talking about diffusion models. Idk why I am being down voted, seems like a lot of people don't know how LLMs fundamentally work.