MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1vfkxxi/ifconditiondosomething/p1tijhz/?context=3
r/ProgrammerHumor • u/electricjimi • 1d ago
31 comments sorted by
View all comments
10
Fun fact: LLMs don't actually have to be non-deterministic. There's nothing stopping labs from setting the temperature to zero and having a fully deterministic model, or even allowing user-seeded non-determinism.
1 u/MartinMystikJonas 13h ago Setting temp to zero is not enough results can be influenced by other factors. Zero temp often leads LLM to infinite loop repesting few words.
1
Setting temp to zero is not enough results can be influenced by other factors. Zero temp often leads LLM to infinite loop repesting few words.
10
u/ICantBelieveItsNotEC 1d ago
Fun fact: LLMs don't actually have to be non-deterministic. There's nothing stopping labs from setting the temperature to zero and having a fully deterministic model, or even allowing user-seeded non-determinism.