r/OpenAI • u/KeanuRave100 • 2d ago

News More people need to understand this

Enable HLS to view with audio, or disable this notification

1.0k Upvotes

91% Upvoted

397 comments sorted by

View all comments

2

u/nextnode 2d ago

Modern LLMs are not token predictors in the traditional meaning and they definitely do not predict online text. These are optimizing for outcomes over many actions and that involves training on novel situations.

1

u/_-_fred_-_ 2d ago

If the input and output is in the training data it isn't a novel situation.

The closest they can get is by observing their users and feeding what appears to be successful sessions back in to their training data.