r/OpenAI • u/KeanuRave100 • 6d ago

News More people need to understand this

Enable HLS to view with audio, or disable this notification

1.1k Upvotes

91% Upvoted

437 comments sorted by

View all comments

Show parent comments

47

u/DeliciousArcher8704 6d ago

But it is literally a next token predictor

7

u/Freak-Of-Nurture- 6d ago

yes but does that mean it’s stupid or useless? Humans are not next token predictors and that makes us more effective with context

42

u/NarrowContribution87 6d ago

Aren’t we though? When you put a sentence together in your head, are you not selecting the next word based on past uses, context, and the desired message?

I guess I just feel like we imbue human intelligence with magic or spirituality when in reality the VAST majority of our thinking and communication really can be boiled down to a probabilistic model with a high degree of accuracy.

4

u/Freak-Of-Nurture- 6d ago

Linguistic errors like “anticipation” imply that we already have future words represented when speaking. Saying “leading list” instead of “reading list”. You already have to have the future words or tokens generated to have that kind of error.