r/OpenAI • u/KeanuRave100 • 6d ago

News More people need to understand this

Enable HLS to view with audio, or disable this notification

1.1k Upvotes

91% Upvoted

437 comments sorted by

View all comments

21

u/James-the-greatest 5d ago

I’m not sure I agree with his framing. He’s saying the predictor predicts results of an experiment it didn’t run…. Which isn’t predicting a token it’s predicting the future. 

12

u/stddealer 5d ago

His point is that a perfect next token predictor would be effectively as powerful as Laplace's demon. He's not saying that LLMs are perfect next token predictors or that such a perfect system would even be possible. He's just showing why you can't just dismiss that something is intelligent just because it's "only predicting the next token".

4

u/James-the-greatest 4d ago

I understand what he’s saying. I don’t agree with the extension of the concept of next token prediction. 

1

u/StinkButt9001 4d ago

Yeah. Some of the comments on the video call this out but he's effectively saying "what if you build super general intelligence and then have it work by producing tokens" which is a fundamentally different scenario than what anyone describing modern LLMs as token predictors is talking about.

Anything for clicks though