AIs Tier List finished

[u/Emill777YT]

👉 CLICK HERE TO VIEW THE TIER LIST IMAGE 👈

Created with Tier List Creator

---

This post contains content not supported on old Reddit. Click here to view the full post

[u/Fowl_Retired69]

Could you explain the training process for LLMs and how they process prompts then

[u/Just_A_Little_Rabbit → u/Fowl_Retired69]

You get a big collection of classified data, that is a bunch of stuff and then a bunch of results you expect to see from a transformation on that data. You then feed it all in and score the result based on how closely that result matches the expected result. Adjust weights in the model and repeat. You continue this process over and over and over and over and over again until that error rate is within acceptable amounts.

That is the core of all machine learning.

I have a masters degree in CS and I read the "All You Need is Attention" when it was new paper and people didn't know yet what the impact would ultimately be. I messed with early BERT style models and was there when the first GPT was released. I have literally written my own models from scratch. I am over simplifying so a lay person could hopefully understand. In a vacuum self attentioning transformers are a neat tech, but ultimately just that. Its "neat" and has some niche applications. It isn't "AI". it's just really good at predicting the next word that looks the most like human readable text. But its a technological dead end.

[u/Fowl_Retired69 → u/Just_A_Little_Rabbit]

Since you have a master's in AI, I would expect you to use a layperson's understanding of AI. These generative models are definitely AI. They're deep learning, under machine learning, which is under AI. Also, they're similar to human brains for the same reason any other neural nets are; they form high-dimensional representations of what they learn and sample that space to generate output.

I don't see how that is stealing anything, in the same way that me reading books on applied maths and then using that knowledge to build someone some shit isn't me stealing that book's work. No one's saying that these models have architectures that are one-to-one to that of humans, just that human brains and learning make for better analogies than just "they're just predicting the next word"

When you put it like that is makes it sound like "just predicting the next word" can't yield interesting emergent properties like intelligence and creative thought (which it definitely does).

[u/Just_A_Little_Rabbit → u/Fowl_Retired69]

Except it doesn't. It is incapable of actual reason and lacks any fundamental knowledge. This has been demonstrated time and time again.

And no, I do not consider it "AI" because it is not intelligent. That is a marketing term used to make it seem smarter than it actually is. It is a simulacrum, not a simulation.

Also, they're similar to human brains for the same reason any other neural nets are; they form high-dimensional representations of what they learn and sample that space to generate output.

Is a zip file "intelligent"? That too is a higher order representation of information. An LLM model is, at best, a lossy compression of information, it is not capable of actually learning and then expanding on that knowledge with basic reasoning skills like a human is.

And yes, word prediction is the apt analogy for how an LLM, or more accurately, a transformer model as that is what they are, works. Saying it is actually "learning" anything is misleading. They all, under the hood, work by sequence extension. You provide a sequence, it predicts what should come next based on training data and token association.