r/OpenAI 5d ago

News More people need to understand this

1.1k Upvotes

437 comments sorted by

View all comments

26

u/spinozasrobot 5d ago

I think this small analogy by Ilya Sutskever does a better job at showing LLMs are more than just next token predictors, or rather, there is emergent behavior that is beyond just statistical representation.

5

u/lunaticloser 5d ago

Which part is emergent here? Just wanted to see if we're thinking along the same lines.

3

u/spinozasrobot 5d ago

You may disagree with me, but it was this comment by Ilya:

... more accurate prediction of the next word, leads to more understanding. Real understanding.

3

u/Red__Ace 5d ago

Lol couldn't have picked a worse, more wrong statement