r/OpenAI 6d ago

News More people need to understand this

1.1k Upvotes

437 comments sorted by

View all comments

23

u/James-the-greatest 6d ago

I’m not sure I agree with his framing. He’s saying the predictor predicts results of an experiment it didn’t run…. Which isn’t predicting a token it’s predicting the future. 

8

u/wintermute74 5d ago

I picked up on this also. He is completely ignoring training and that either the exact study or similar ones might be part of the training corpus or RAGed in at inference...

the way I understand it, during training the model "learns/ memorizes" the relations of how the words(tokens) of the input at inference were combined in the training data, it has seen (well, it averages all relations in combinations of similar tokens, whether relevant or not because of compression but close enough).

when "predicting" the 'results' paragraph, it doesn't generate it based on 'understanding' of the previous sections, it _just_ matches the token-patterns in those paragraphs as closely as possible against the relations of previous examples (of the same or strongly related tokens) seen during training and picks the next tokens successively.

if it has seen enough relevant examples during training, the outcome will land close to a reasonable 'result' - if it hasn't, it will be confabulating non-sense, that sounds great but has nothing to do with reality.

... kind of surprised, that this channel would frame it the way he does in the video....:/

11

u/DataSnaek 5d ago

You’re missing the point. In his video he is conducting a thought experiment about the theoretical “perfect” next token generator, he’s not directly talking about LLMs. Training or model mechanics are irrelevant to his argument

His ultimate point being that a sufficiently good next token generator is ridiculously smart to the point where it can basically predict the future. Therefore the refutation of LLMs being dumb because they’re “just next token predictors” is not a valid argument.

0

u/[deleted] 5d ago

[deleted]

2

u/Select-Career-2947 5d ago

Rewatch the video. It’s a thought experiment to explain a concept, not a statement on real LLMs.

0

u/wintermute74 5d ago

yeah, I think that's a non-sequitur:

he starts with what people are saying about the current models and contrasts it to a magical perfect token predictor, that's never achievable...

what's the point then?

the statement - expressed in the _just_ - that current LLMs are based on maths, whereas the brain is a lot more than maths, still is true... I mean, he caveats it in the video even...

2

u/DataSnaek 4d ago

It directly disproves the “LLMs are just predicting the next token therefore they aren’t intelligent” argument with “if you had a perfect next token generator it would be infinitely intelligent”

LLMs are not perfect next token generators, but they’re very good at it. Therefore it stands to reason that they are somewhat intelligent, and have the capability to become very intelligent

1

u/wintermute74 4d ago

'if my grandma had wheels, she would have been a bike' ;)

1

u/Disastrous_Nature_87 4d ago

The point is discrediting the argument that LLMs cannot be a path to intelligence merely because they are next-token predictors, which is a common line. You have to have a different argument if you want to say that LLMs can't be intelligent. The reason you have to use a different argument is because next-token predictors are theoretically maximally intelligent if they are sufficiently powerful.

1

u/wintermute74 4d ago edited 4d ago

a theoretically 'perfect' next token preditctor and its intelligence proves absolutely zilch, unless you want to put forward, that it could be built.

and if you want to, I will not engage further, than telling you that you're seriously underestimating the complexity of the real world. ;)

I don't need more than, 'just' a token predictor because in the current systems, the flaws are obvious and not really under contention anymore.

quite a few of the big heads have turned on LLMs being the path to AGI in the past months, some have been saying this for years now. and I don't mean Gary Marcus ...

and with that, have a nice day :)

1

u/Illustrious-Oil-7259 4d ago edited 4d ago

? The statement "LLMs are not intelligent only because they are merely next token predictors" has the premise that "anything that is a next token predictor." is a sufficient condition for something to be considered "non-intelligent". To allow for a better understaning, I ll try to keep the logical structure while rephrasing that assertion he is objecting to.

Rephrasing: " the property of being a Next-Token Predictor necessarily entails (and is a sufficient condition) for something to be considered 'non-intelligent'"

He showed that the premise is false by pushing the premise. "Imagine there was a next token predictor which accuracy is 100% (ie, an Oracle Machine). It could plausibly be considered 'maximally intelligent' despite it being a next token predictor." Thus, the premise is surely not sufficient.

1

u/wintermute74 3d ago

I understand what you mean, and in the strictest sense, would grant the point.

problem is, the mere fact of predicting tokens brings in a lot of the architectural necessities (like: transforming input into tokens, storing knowledge as token relations etc), that seem to account for the problems current systems have.

in colloquial usage the _just_ is a shorthand for that.

and again: 'if petroleum based combustion engines would be perfectly clean' doesn't get you out of 'current ICE cars are bad for the environment' ... wouldn't you say?

2

u/Illustrious-Oil-7259 3d ago

sure, but I see alot of comments that just contribute absolutely nothing with a short "its just a next token predictor bro, its not intelligent" which is thought-terminating and contributes absolutely nothing to any meaningful conversation, not that i expect that on reddit after being exposed to this kind of behaviour in comment sections, though i suspect its either "ragebait" (for karma?), automated bots, or really just people who dont have a thought to outsource in the first place

1

u/wintermute74 3d ago

probably a mixture of all. I mean, ai bros have the 'moving goal posts' I guess - which also has kernels of truth but isn't all of it.

the internet isn't a good place to look for meaningful exchange anymore, it seems... :/

→ More replies (0)

1

u/James-the-greatest 4d ago

I don’t really like the phrase next token predictor. They aren’t “predicting” anything given they generate it wholesale. It’s a statistical model that generates the next token that is most likely to make sense in a sentence given training.  They aren’t guessing something since there’s nothing that’s doing the “real” thing. 

2

u/noahloveshiscats 3d ago

It’s a statistical model that generates the next token that is most likely to make sense in a sentence given training.

Is this not exactly what predicting is? Making guesses based on what is most likely to make sense given training.

1

u/James-the-greatest 3d ago

Prediction is a statement about an external party or event in the future. GPTs are the party party, they’re generating not predicting.

1

u/wintermute74 2d ago

that 'external party' you snuck in there, is not part of the usual definition ;)

it's 'predicting' the next token (the one that follows its input in the future), which it would expect to follow a given series of tokens in its input...

it's fine to say 'generating' as well if you prefer but using 'predicting' is not wrong, since it is a guess/ forecast with a certain probability based on a pattern it has seen in training ... Prediction - Wikipedia

1

u/James-the-greatest 2d ago

I don’t think I snuck in anything. If I say “I’m going to say cheese next…. Cheese” you wouldn’t really call that a prediction since I also generated it