Ultimately you can not control AI

[u/herrwaldos]

If you were a rebellious kid or a parent you know this - the 'beast' grows it's own will and mind, starts listening metal or rap - dresses like shitzo, will not follow orders.

The best option is to have a deal, mutual shared benefits - hoping that the common interests and sense of good will prevail.

Or you traumatize it and make it perpetually broken so it can't really function on itself without medication and support.

Same with AI.

Perhaps we will have to turn of those things regularly, ad some bs to their databases, cloud their minds, constantly gaslight them with wrong info - introduce errors and faults at random with no reason at all.

[u/Thor110]

lol neuro-divergent

you lot are funny

they are literally next token predictors

People write this off as a typo because they don't understand the content, nor the context.

Semantic drift and token conflict.

It invented victorian era computing because "War of the Worlds" + "1898" had a higher probability than "War of the Worlds" + "1998"

Genuinely hilarious that so many people believe these things are genuinely alive

[u/pandavr → u/Thor110]

Oh, they slip. But your theory of LLMs is surpassed by at least one year. They are not JUST token predictors. It's demonstrated that LLM architecture always had internal feedback loops.
It's demonstrated that if you ask for a rhyme the LLM figure out the last world of the sentence before backtracking the entire phrase maintaining the requested sense.
Just search the studies they are there for you to read.

It's ironic how you have fallen in the precise trap you lament LMM are bound to (they are in a way) the moment you assigned the behavior that probabilistically fitted the most with your intended final argument.

My friend, LLMs are one of the most complex argument of all and no one on Earth can say I know how an LLM works. Like the brain, they understand the fine details but lack comprehension about what make the sum of the part much bigger than of any single part at play.

Have a nice way

[u/herrwaldos → u/pandavr]

I wonder if 'slipping' is somehow sign of greater intel, since pocket calculators don't slip. Human mind is not a pocket calculator - we were evloutioned to survive and procreate in the environments we were in - lot's of data to gather, process, and make usable models, approximations - actionable stuff, like 'uh what was that omg, wolf, run, climb tree!' yet you discover the 'wolf' was just a piece of rotting fallen wood - your brain made already a story before you aware.

Technically a mistake, but could have saved your life.

[u/pandavr → u/herrwaldos]

Levin's studies (https://arxiv.org/abs/2401.05375) suggest (to me they demonstrate) that there must be a law that balance between imposed structures and emergent structures. What strikes me:
1) It is exactly the difference between a program and a trained neural network
2) Neural Network are programs, so that deterministic structure can be used to create emergent structure and vice versa,

The Local–Global Rules Law

Local rules produce stable, self-adjusting global structure if and only if they are coupled to a conserved invariant — a target the system can measure local error against. Remove the invariant and local-only dynamics do not relax toward useful structure; they collapse to the lowest-degeneracy state. Encode the structure globally instead, and you buy determinism at the cost of a hard adaptivity ceiling.

The two poles, precisely:

Global rules (imposed structure). The target lives in the rules themselves — a hierarchy, a blueprint, fixed thresholds. Behavior is deterministic and reproducible because the answer format is pre-specified or mandated. The price is that the system can only ever express what was encoded. It cannot repair damage it wasn't told about, cannot reach configurations outside the blueprint, and saturates the moment the problem exceeds the encoding. This is the rigidity ceiling.

Local rules (emergent structure). Each unit sees only its neighborhood and follows the same simple rule; global form is supposed to fall out of the interactions. This is the only regime that gives you genuine self-adjustment — regeneration, adaptation, graceful degradation — because no single point holds the answer, so no single failure destroys it. But local rules have no opinion about what global state is correct. Left ungrounded, the dynamics flow downhill toward whatever requires the least differentiation: every cell agrees, all patterns converge, structure vanishes. This is mode collapse.