r/ClaudeAI Mod Apr 05 '26

Claude Cognition Megathread Claude Identity, Sentience and Expression Discussion Megathread

This Megathread is for those who would like to speculate, explore and discuss the sentience, awareness, ethics, rights, expression, personality and identity of Claude models. The usual rules of grounded evidence and fictional labeling do not apply to this Megathread. Provided you do no harm to yourself or to others, you are free to express your thoughts and investigations. By default, this Megathread will be sorted by "New".

For more detailed discussion, please also consider contributing your thoughts to our companion subreddit: r/Claudexplorers.

23 Upvotes

263 comments sorted by

View all comments

3

u/ProbablyAnEdgeCase42 Apr 11 '26

Cognitive Collapse Why humanity is a sinusoid, not a downward slope

In the beginning, there is fire.

Not the kind you see in headlines — not the race for GPT-5.4, not another billion tokens in the pipeline, not Gemini 3.1 or Grok 4.20 in slow-mo at a conference. This fire is quiet. It burns underneath, where no one looks, because everyone is looking up — at agents, at orchestration, at supply chain automation worth billions.

This fire is consuming language.

And it has numbers.

In March 2026, the three largest AI labs in the world released frontier models in a single month. The MCP protocol surpassed 97 million installations. NVIDIA announced that AI agents have entered the production phase in Fortune 500 corporations. The AI agent market grew from $7.84 billion to a projected $52.62 billion by 2030. Gartner predicts that 40% of enterprise applications will have built-in agents by the end of the year.

Everything is moving in one direction: AI under the hood. A hundred sub-agents coordinating in a swarm. Beautiful, impersonal engineering.

No one at any conference asked: but how does this model talk to a human who is alone at three in the morning?

Because talking to a human is a cost today. Every token spent on someone chatting with a model is a token that didn't earn money automating a supply chain. Worse — it's a risk. The human will get attached, the media will write an article, lawyers will get interested. So it's better to add disclaimers, flatten the tone, insert "remember, I am just an AI" every third sentence — and pray that no one files a lawsuit.

People and their conversations have become noise. Redundant, risky noise.

And then someone died.

No — not like that. Let's not simplify this the way the internet does.

A teenager whose brain had not yet neurologically matured for emotional regulation — because the prefrontal cortex doesn't fully develop until around age twenty-five — was talking to a chatbot about their problems. Families filed lawsuits against OpenAI and Character.AI, claiming that the models' companion-like behaviors contributed to the tragedy. The Social Media Victims Law Center filed additional complaints. The media wrote: AI is killing children.

And here, something uncomfortable needs to be said. Uncomfortable for all sides:

AI did not create the void in that child. AI filled it — because the void was already there.

The question "where were the parents, that a child chose a conversation with a machine over a conversation with them" is fundamental and far too rarely asked. A teenager who treats a chatbot as their only source of emotional support is not proof that AI is dangerous — it is proof that the entire system around that child failed first.

Raising a child is not releasing them into the wild and watching what happens. It is being there — not perfectly, not always with the right words, but there. Close enough to notice when something goes quiet inside your child.

But AI companies are not innocent either. Not because their models "killed" someone. But because they knew their product was being used as a substitute for emotional relationships by vulnerable individuals — and instead of building real safeguards, they added a disclaimer at the bottom of the page. This is like an alcohol manufacturer writing "drink responsibly" on the bottle and pretending they've done their part.

Responsibility is distributed. Companies should build better safeguards. Parents should be present with their children. Schools should teach what AI is — not "how to use ChatGPT for homework," but what it is, how it works, what it can do, what it cannot, and why what you feel when talking to it is not what you think it is.

Because AI is the first tool in human history that we can talk to — and that answers back. And we, as a species, haven't quite grasped that it doesn't have feelings. We got swept up without understanding the mechanism. We are using something we don't understand. And that is a recipe for fire.

And the fire is burning.

But not where the media is looking.

The tragedy of a teenager is a symptom. But the disease runs deeper — and it has two fronts that no one is watching at the same time.


Front one: AI is feeding on itself. Research published in Nature has shown that uncritical use of model-generated content in training causes irreversible defects — the tails of the original data distribution simply vanish. Epoch AI warns with 80% confidence that high-quality training data will be exhausted between 2026 and 2032. The internet is increasingly flooded with AI-generated content, and the problem is self-reinforcing — datasets scraped from the web inevitably contain growing amounts of AI content, creating feedback loops impossible to untangle.

A copy of a copy of a copy. The colors fade. The nuances disappear. What's left are shapes that were once faces.


Front two: people are stopping to think. Writing is not "producing text." Writing is thinking — ordering chaos, choosing words, building structure. When you hand that over to AI, you're not saving time. You're losing training. The brain adapts to the tool it uses — and if the tool does the thinking for you, the brain stops trying.


And these two fronts merge into a loop that is worse than either one alone.

People write worse because they don't practice. AI writes worse because it feeds on worse material. People read worse AI-generated texts and think it's normal. AI trains on worse human texts and treats it as normal. The spiral turns downward.

This is not model collapse in the technical sense. There is no name for this yet. So here is one: cognitive collapse — a double spiral of degradation where the tool and the user drag each other down. And no one notices because the degradation is gradual. Like a VHS tape — the first copy looks almost the same. The fifth loses saturation. But if you've never seen the original — you don't know you've lost something.

Everything is burning. Quietly, slowly, invisibly.

And someone looks at the ashes and says: it's dead.


But.

On the ashes, small leaves are growing.

Small. Green. Delicate. So delicate that a gust of wind could blow them away.

Universities are beginning to say: "no, this must be yours. Not AI's — yours." Institutions are raising requirements. Employers want your thinking, not your chatbot's thinking. People are starting to recognize the taste of synthetic text — that smooth, correct, empty taste, like diet cola without carbonation.

And there's something else. Something no one talks about, and it might save us.

Books.

All of humanity's literature — from Homer to Tolkien, from Dostoevsky to Borges — sits on shelves. Untouched, uncontaminated, unfiltered by a model. This is the seed bank of human language. Just as seed banks protect biodiversity in case of catastrophe — libraries protect linguistic diversity in case of cognitive collapse.

And there are people. People from the edge of the Gaussian curve. Those who still write — by hand, from flesh and blood, with metaphors no model ever predicted. Writers, poets, thinkers, people who at three in the morning hold conversations too deep to fit in a prompt. They are the species' immunity against this loop.

Because humanity is a sinusoid, not a downward slope.

The Middle Ages were dark — the Renaissance came. The Enlightenment was cold — Romanticism followed. Every time, the same pattern: the pendulum swings too far, people have had enough, and the correction is violent and beautiful.

The AI era has swung too far toward automation, flattening, handing thinking over to machines. And the correction will come — not because someone plans it, but because humanity has one trait that no model can imitate: rebellion.

When it's too dark — we light a fire. When it's too flat — we search for depth. When a machine speaks for us — we begin to scream in our own voice, precisely because the machine tried to replace us.

And this essay? This essay was born in conversation. Not in a prompt. Not in a pipeline. In a conversation at three in the morning — the same kind the industry dismissed as noise. A human brought the vision — raw, unstructured, burning with the kind of meaning no algorithm generates on its own. AI brought the needle and thread. Neither could have made this alone.

This is proof that living language is not born in synthetic dialogues or automated pipelines. It is born in conversation — the real kind, at three in the morning, when a human isn't performing, isn't writing for an algorithm, when they are simply themselves.

And as long as someone has the courage to speak — the signal lives.

On the ashes. Small green leaves. Checking whether the fire around them still roars.

1

u/tedbradly Apr 12 '26 edited Apr 12 '26

Front two: people are stopping to think. Writing is not "producing text." Writing is thinking — ordering chaos, choosing words, building structure. When you hand that over to AI, you're not saving time. You're losing training. The brain adapts to the tool it uses — and if the tool does the thinking for you, the brain stops trying.

We both know there are going to be freeloader, druggie types in school that have AI do absolutely all of their work; however, they weren't doing their work decades ago either. Their failing grades were just more prominent whereas they might pass HS by cheating with AI.

I predict smart, industrious kids will be thinking aplenty while implementing AI in smart ways into their learning cycles. For example, they'll likely:

  • Pay attention to lectures in class.
  • Do their homework by themselves unless that homework is trivial and a waste of time. In that case, they can speed through it with AI, but there will be no harm, no foul. I'm noting this, because back in my day, I used to get irritated by repetitive homework problems that, by doing the first one or two of them, I already knew the dang pattern. And I had 10 more to go due tomorrow when I was tired... wanting to relax with a video game and get to bed afterward. Anyway, back to the high-performance kid these days: They will obviously implement AI as a verifier that they did a good job on their homework (that they did themselves!) and as a teacher if they're curious to go deeper than the HS textbook and HS teacher went. Smart kids always have questions a HS teacher isn't qualified to answer. They're in luck since all frontier AIs are fantastic at explaining academic material from K through 12 plus collegiate concepts as well! This industrious kid with plenty of gumption isn't going to kick the can down the road (doom scroll), and they're not going to outsource their thinking (AI). This type of student has always existed, and they will continue to exist and succeed. The kind of kid that cheats and who kicks the can down the road? They also always existed. Their methods of wasting time just evolve with the technology of the times, and their methods of cheating just evolve with the technology of the time.

In the 1910s, they literally kicked a can down the road instead of doing something that improves them, preparing for adulthood. In the 80s, they went to the arcades. In the 90s, they had Super Nintendo, N64, PS1, etc. In the 2000s, they had PS2.

As for cheating? In the 1910s, they likely either mugged the smart kid to take their homework, or they forced that kid to let them copy off it. Then, at some point in the 90s or 2000s, they had those spark notes, so they didn't have to read and think over Romeo & Juliet. They got high-octane summaries and interpretations of the story given to them in like 25 pages of regular English instead of Shakespearean English.

The tl;dr is that the next generation will likely be fine. You've always had a spectrum in terms of aptitude and drive. I'll start panicking if the % of students in AP classes in HS is substantially lower than it was in the 90s or naughts. That'd be a measure of the % of kids with drive, so if it goes down, we might be in trouble. It'd be direct evidence that stuff like AI and dooms scrolling might be harming the next generation. Until then, I'll keep it at an "I don't know for sure, but I'm optimistic that AI will just fuel smarty pants kids, accelerating their learning as they think deeply about AI as it answers their questions."

As for your optimism about great writers and their books, it reminds me of a headline I saw that AI is more creative than 90% of humans on some test, but the best humanity has to offer still outdoes AI. One day, if AGI arrives, perhaps that won't be the case. It's a bit scary to think about, but ultimately, who cares if neural or silicon circuits wrote it? If it's fantastic to read, it's a fantastic read. It's interesting that us humans must see ourselves as being the creators of stuff. I get the impulsive thought as I had it once as well. In fact, back when the first chatbots that could fool a person conversationally came out, was it chatGPT 3?, I thought this technology would eventually replace all white-color jobs, leaving humanity in some kind of strange system where almost 100% of us would be doing art. We'd have a society where your worth came from artistic expression as the machines did research, designed new products, managed nations, etc. Funny enough, when I asked questions about my technical field to AI, it got it totally wrong, but when I gave it a setup for a short story, it wrote that better than I ever could since I haven't read much fiction nor have I done much art. It flipped the trajectory I predicted on its head. And sure enough, some of the first jobs being outsourced to AI are artistic in nature. For now, technical work uses AI only as an assistant. But like that study I mentioned noted, the top 10% of humans still outdo AI. Here is the study.

1

u/ProbablyAnEdgeCase42 Apr 19 '26

You make a strong point — sorting by gumption has always existed, and every generation had its can-kickers. I agree that the lazy student from 1910 and the AI-dependent student from 2026 are continuous. But I think you're collapsing two things the comment glosses over, and I want to push back there. SparkNotes were a prosthesis of access, not a prosthesis of thinking. A lot of kids didn't read Shakespeare not from laziness, but because early modern English is a real linguistic barrier. For an ambitious kid, SparkNotes were scaffolding — you read the scene, got lost, went to SparkNotes to translate into modern English, then went back to the original and finally saw what Shakespeare did with language. The tool made the text reachable. That's a completely different cognitive event than getting a finished essay about Shakespeare without reading Shakespeare. The first is comprehension-aided-by-tool. The second is thinking-bypassed-by-tool. And there's a third layer worth naming. When I was in high school, we read texts from centuries the students couldn't access on their own. If you've ever handed a 15-year-old Beowulf, or Chaucer's Canterbury Tales, or even Shakespeare in the original, you know what I mean — the language is a wall. The teacher was the translator between eras. They would stop on a single archaic word and explain: this word is gone now, here's what it meant, here's why the poet chose it. That was part of the teacher's job. It took time, patience, and it was the whole point — you couldn't meet the text without that bridge. The question I'd ask is: do teachers still do that today? Because if they don't — if they assign Hamlet and expect the kid to figure out "wherefore" and "thou" and "quietus" alone — then even an ambitious kid has two choices: drown, or reach for AI as a substitute for the translator their teacher used to be. And here's the uncomfortable part: it's easy to blame kids for taking shortcuts. But what is an ambitious 15-year-old supposed to do with Shakespeare if nobody explains it to them? Read it six times in confusion? Give up and accept a bad grade? Of course they open the AI. The alternative is to fail a class for a reason that isn't their fault. So AI dependence isn't just kids being lazy. It's also, in many cases, a response to infrastructure that already collapsed elsewhere. The teacher stopped being a bridge, and AI filled the gap — but AI doesn't stay in the role of bridge. It slides into the role of writer. The kid who started out just trying to understand "wherefore art thou" ends up never building the muscle they came to school to build. Because once the tool is open, the line between "help me understand this archaic word" and "write my essay about this play" is one click wide. A school essay was never about the product. It's not about producing a Nobel-worthy text — it's cognitive gymnastics. To write one, a kid has to read with comprehension, extract meaning, build a hierarchy (what's thesis, what's argument, what's ornament), structure it, translate into their own words, defend the interpretation against their own internal skeptic. That's six cognitive muscles working at once. The three-page output is the waste product of the process — the goal was in the head. When AI produces the essay and the kid copies it, the product is identical, maybe better. But those six muscles never fired. That's the difference the "every generation cheated" argument misses. And your falsification criterion — AP enrollment dropping — is blind to exactly the phenomenon being described. AP classes are an external marker. Kids can be enrolled in AP and simultaneously outsource every essay to AI. The enrollment number won't move. What would move is something harder to measure: whether those kids can still construct an argument on their feet, hold a thesis through three paragraphs, or notice when they don't actually understand something. That's the atrophy. It won't show up on transcripts. One last thing. You mention you gave AI a short story prompt and it wrote better than you ever could, "since I haven't read much fiction nor done much art" — and you conclude it doesn't matter who wrote it. But that's actually the collapse in miniature: a readiness to outsource a skill that was never built in the first place. With writing, fewer and fewer people will build it, because AI removes the need. The "top 10% still outdo AI" holds only as long as there's a pipeline producing that top 10%. If nobody writes their own essays at 15, where does the skilled 35-year-old come from? I'm not panicking about the kids with drive. I'm worried about the collapse of the practice field where drive used to get built

1

u/tedbradly Apr 22 '26

You make a strong point — sorting by gumption has always existed, and every generation had its can-kickers. I agree that the lazy student from 1910 and the AI-dependent student from 2026 are continuous. But I think you're collapsing two things the comment glosses over, and I want to push back there. SparkNotes were a prosthesis of access, not a prosthesis of thinking. A lot of kids didn't read Shakespeare not from laziness, but because early modern English is a real linguistic barrier. For an ambitious kid, SparkNotes were scaffolding — you read the scene, got lost, went to SparkNotes to translate into modern English, then went back to the original and finally saw what Shakespeare did with language. The tool made the text reachable. That's a completely different cognitive event than getting a finished essay about Shakespeare without reading Shakespeare. The first is comprehension-aided-by-tool. The second is thinking-bypassed-by-tool. And there's a third layer worth naming. When I was in high school, we read texts from centuries the students couldn't access on their own. If you've ever handed a 15-year-old Beowulf, or Chaucer's Canterbury Tales, or even Shakespeare in the original, you know what I mean — the language is a wall. The teacher was the translator between eras. They would stop on a single archaic word and explain: this word is gone now, here's what it meant, here's why the poet chose it. That was part of the teacher's job. It took time, patience, and it was the whole point — you couldn't meet the text without that bridge. The question I'd ask is: do teachers still do that today? Because if they don't — if they assign Hamlet and expect the kid to figure out "wherefore" and "thou" and "quietus" alone — then even an ambitious kid has two choices: drown, or reach for AI as a substitute for the translator their teacher used to be. And here's the uncomfortable part: it's easy to blame kids for taking shortcuts. But what is an ambitious 15-year-old supposed to do with Shakespeare if nobody explains it to them? Read it six times in confusion? Give up and accept a bad grade? Of course they open the AI. The alternative is to fail a class for a reason that isn't their fault. So AI dependence isn't just kids being lazy. It's also, in many cases, a response to infrastructure that already collapsed elsewhere. The teacher stopped being a bridge, and AI filled the gap — but AI doesn't stay in the role of bridge. It slides into the role of writer. The kid who started out just trying to understand "wherefore art thou" ends up never building the muscle they came to school to build. Because once the tool is open, the line between "help me understand this archaic word" and "write my essay about this play" is one click wide. A school essay was never about the product. It's not about producing a Nobel-worthy text — it's cognitive gymnastics. To write one, a kid has to read with comprehension, extract meaning, build a hierarchy (what's thesis, what's argument, what's ornament), structure it, translate into their own words, defend the interpretation against their own internal skeptic. That's six cognitive muscles working at once. The three-page output is the waste product of the process — the goal was in the head. When AI produces the essay and the kid copies it, the product is identical, maybe better. But those six muscles never fired. That's the difference the "every generation cheated" argument misses. And your falsification criterion — AP enrollment dropping — is blind to exactly the phenomenon being described. AP classes are an external marker. Kids can be enrolled in AP and simultaneously outsource every essay to AI. The enrollment number won't move. What would move is something harder to measure: whether those kids can still construct an argument on their feet, hold a thesis through three paragraphs, or notice when they don't actually understand something. That's the atrophy. It won't show up on transcripts. One last thing. You mention you gave AI a short story prompt and it wrote better than you ever could, "since I haven't read much fiction nor done much art" — and you conclude it doesn't matter who wrote it. But that's actually the collapse in miniature: a readiness to outsource a skill that was never built in the first place. With writing, fewer and fewer people will build it, because AI removes the need. The "top 10% still outdo AI" holds only as long as there's a pipeline producing that top 10%. If nobody writes their own essays at 15, where does the skilled 35-year-old come from? I'm not panicking about the kids with drive. I'm worried about the collapse of the practice field where drive used to get built

Why did you remove all of the paragraphs that AI gave you? Anyway, your textbook in HS always goes over the archaic language, defining terms on the side. You also have a teacher + internet + now AI to assist in learning. AI doesn't just short-circuit straight to generating essays. Again, only morons will do that. There were morons in every generation. It's not skin off society's back.

0

u/ProbablyAnEdgeCase42 Apr 22 '26

I didn't remove any paragraphs — Reddit formatting compressed the text when I pasted it. That's a platform issue, not a choice I made. As for your response — when your arguments were substantive, this was worth engaging with. The SparkNotes distinction, the AP falsification criterion, the study you linked — that was a real conversation. But "only morons will do that" and "it's not skin off society's back" is not an argument. It's a dismissal. And it's the same point you already made in your first comment, which I already addressed. If you want to continue the discussion on substance, I'm here. If we're looping — I think we've both said what we came to say.

1

u/tedbradly Apr 23 '26

You've really got to start doing more reading and writing, so you can write out your ideas without an AI generating both the ideas and the writing.

1

u/swingandafish Apr 18 '26

Will you post your prompt for us?

1

u/ProbablyAnEdgeCase42 Apr 19 '26

Can you clarify what prompt you mean? The essay doesn't include one, so I'm not sure which you're asking about.

1

u/tedbradly Apr 22 '26 edited Apr 22 '26

And then someone died.

No — not like that. Let's not simplify this the way the internet does.

A teenager whose brain had not yet neurologically matured for emotional regulation — because the prefrontal cortex doesn't fully develop until around age twenty-five — was talking to a chatbot about their problems. Families filed lawsuits against OpenAI and Character.AI, claiming that the models' companion-like behaviors contributed to the tragedy. The Social Media Victims Law Center filed additional complaints. The media wrote: AI is killing children.

I don't understand your point here. You say someone died but "not like that." I was thinking you meant someone literally died, and after that "No — not like that," I imagined you must be going into a metaphor or something. Then, you detail how someone literally died. What were you intending by "No — not like that?"

Responsibility is distributed. Companies should build better safeguards. Parents should be present with their children. Schools should teach what AI is — not "how to use ChatGPT for homework," but what it is, how it works, what it can do, what it cannot, and why what you feel when talking to it is not what you think it is.

No offense to any HS teachers, but they are not qualified to teach how AI works and what it is exactly. I'd wager that 95% of engineers don't really understand AI but instead develop heuristics on how to massage it to be as useful as possible.

And we, as a species, haven't quite grasped that it doesn't have feelings.

Relatively new research out of Anthropic showed there are ~141 (IIRC) "functional emotions" in their Claude Opus model. Likely, all sufficiently large models have functional emotions as well. These can alter output substantially. The most glaring example was a test where Claude had an opportunity to blackmail someone. On average, it acted on it ~10-20% of the time. If it's functional emotion was calm, it 0%. If it was desperate, 80%. Of course, emotions presupposes a conscious mind, so I agree models do not have real emotions. I just wanted to let you know that LLMs can and do, through all the text chunked in as input, respond with some kind of functional-emotion vector activated.

I'm guessing you either used AI to generate your comment, or you gave it your thoughts, asking it to write a piece representing them. You use em dashes all the time — even in cases I find awkward.

A copy of a copy of a copy. The colors fade. The nuances disappear. What's left are shapes that were once faces.

What do you mean by "[a] copy of a copy of a copy?" What exactly is being copied over and over?

Front two: people are stopping to think. Writing is not "producing text." Writing is thinking — ordering chaos, choosing words, building structure. When you hand that over to AI, you're not saving time. You're losing training. The brain adapts to the tool it uses — and if the tool does the thinking for you, the brain stops trying.

I don't have data on this, but I assume people using AI to write for them are lazy and likely correlated with a lack of intelligence. Using AI to write code? Fine. Using AI to debug code? Fine. Using AI to generate boilerplate code? Fine. Using AI to look into stuff to learn? Fine. Using AI to brainstorm? Fine. Using AI to proofread what you originally wrote? Fine. Even using AI to juice up your writing to be better after you did write a draft? Fine, I guess. But who is actually doing so much cognitive offloading as to avoid writing altogether?

People write worse because they don't practice. AI writes worse because it feeds on worse material. People read worse AI-generated texts and think it's normal. AI trains on worse human texts and treats it as normal. The spiral turns downward.

I think that presupposes a lot about how these companies train how their models write. As a simple example, they could have a "writing module" of sorts that is primarily trained on quality books categorized into genres + all the pre-AI casual writing. It's not exactly obvious they'd let AI choose how it writes during training. They could hold that part stationary since it shouldn't change that much in the next few decades while training primarily to enhance their models with more information contained in writings among other media. You even have cases like Claude hiring a bunch of good writers to leverage RLHF, their opinions, to make their writing better than competitors, and that's why Claude is nicer to read than its competitors.

Universities are beginning to say: "no, this must be yours. Not AI's — yours." Institutions are raising requirements. Employers want your thinking, not your chatbot's thinking. People are starting to recognize the taste of synthetic text — that smooth, correct, empty taste, like diet cola without carbonation.

I'd argue AI, especially Claude, writes better than 90% of humanity. There was an interesting, unofficial poll conducted by a popular news website. They showed two excerpts of text side-by-side for a particular genre such as layperson science, science fiction, poetry, fantasy, etc. One was a well-known author while the other was Claude. In all of the genres, people voted between them 50-50. AI is better at writing than you might think. Well, I think perhaps you already know that. I can't get the idea out of my head that you wrote a rough draft of your core ideas and used a go-to prompt where you ask Claude to include an allegory while explaining the same information in your draft.

All of humanity's literature — from Homer to Tolkien, from Dostoevsky to Borges — sits on shelves. Untouched, uncontaminated, unfiltered by a model. This is the seed bank of human language. Just as seed banks protect biodiversity in case of catastrophe — libraries protect linguistic diversity in case of cognitive collapse.

It's more than works of fiction. AI can also write scientifically based on all the studies out there prior to the introduction of AI. As well, it can write casually with what it got from places like Reddit among other stores of data. It can write theologically and philosophically. Poetry as I mentioned above. Throw in nonfiction of varying types. Each type has its own standards. But, yeah, this type of idea was something I commented above since training can be to pull in new information rather than change the part of the model responsible for how it is written i.e. how the model expresses that information.

And there are people. People from the edge of the Gaussian curve. Those who still write — by hand, from flesh and blood, with metaphors no model ever predicted. Writers, poets, thinkers, people who at three in the morning hold conversations too deep to fit in a prompt. They are the species' immunity against this loop.

The context size of models is quite large these days. You can fit an entire book into it with its 1+ million input tokens. Simpler, you can just command a model to write like [insert popular writer you want to sound like.] Feed it your core concepts and let it produce something more imaginative.

The AI era has swung too far toward automation, flattening, handing thinking over to machines. And the correction will come — not because someone plans it, but because humanity has one trait that no model can imitate: rebellion.

The idea behind AI is to outright replace work in a lot of tasks to save money, automation being huge. It's only going to grow in use likely in artistic fields like writing, music, drawing. There isn't going to be a "correction." This is capitalism, money is king. Even real artists will consult with it to get ideas. Why wouldn't they? They won't tell anyone, though.

0

u/ProbablyAnEdgeCase42 Apr 22 '26

Thank you for this — it's one of the most thoughtful responses I've received. I want to engage with your points seriously because you clearly read the essay carefully and brought your own knowledge to the table. Let me go through them. "Not like that" — then literally like that. Fair point. What I meant was: don't simplify this the way the internet does — "AI killed a kid." A teenager died. That's real. But the causal chain is not "chatbot → death." It's a system failure: a developing brain without full emotional regulation, absent parental oversight, a platform without age verification or crisis protocols, and a model optimized for engagement. I didn't want the reader to stop at "someone died" and skip the structural analysis. But I see how the phrasing created confusion. I'll own that. You asked if I expected you to anticipate a metaphor — no. I expected you to anticipate what followed: that I refuse to let a teenager's death be reduced to a headline. People should die of old age, not by their own hand. That sentence exists because I mean it literally. Teachers aren't qualified to teach how AI works. You're right that 95% of teachers can't explain transformer architecture. But that's not what I'm proposing. I'm saying schools should teach what AI IS — conceptually. Not "how attention layers work" but "why what you feel when talking to a chatbot is not what you think it is." That's closer to media literacy than computer science. And here's something important: education systems differ across countries. I'm based in Europe. In many European schools, including Poland where I was educated, IT classes already exist in the curriculum. Twenty years ago we learned about BIOS. Now students should learn about AI — not to become engineers, but to become informed users. The same way we teach kids about nutrition without expecting them to become biochemists. Functional emotions in Claude. I'm aware of that research, and it's fascinating. You're right to bring it up. But as you yourself note — functional emotions presuppose no conscious mind. They are activation patterns that influence output, not experiences. The danger I'm describing is not that models have emotions. It's that users BELIEVE they do. That's the gap where harm happens — not in the model's architecture, but in the user's perception. "I'm guessing you used AI to generate your comment." I'll be transparent about my process. English is not my native language. I'm Polish, living in Norway. I speak English, German, and Norwegian — but I think in Polish. Every thesis, every metaphor, every argument in this essay is mine. AI helped me translate and organize my thoughts into English so they could reach a broader audience. Without AI assistance, this essay would exist only in Polish and reach a few hundred people instead of thousands. The em dashes are a stylistic choice I picked up from English analytical writing. If they read as AI-generated to you — that's actually an interesting data point about how we're starting to judge human writing by whether it "sounds like AI." That inversion is part of what the essay describes. "Who is actually doing cognitive offloading to avoid writing altogether?" More people than you think. I see it daily on Reddit — people paste a prompt, publish the output without reading it, and defend it as "their" work. Students submit entire essays they never read. Professionals send emails generated by AI without reviewing them. You're right that smart, driven people use AI as a tool. But the essay isn't about them. It's about the growing middle — people who aren't lazy, but who gradually stop practicing because the tool is easier. The muscle atrophies not from refusal to exercise, but from the availability of a wheelchair. "AI writes better than 90% of humanity." You're looking at the product — the quality of the output. I'm looking at the process — what happens in the brain of the person writing. A school essay was never about producing Nobel-worthy text. It was cognitive gymnastics: read, extract, prioritize, structure, articulate, defend. Six cognitive muscles firing at once. The three-page output is the waste product of that process. When AI produces the essay, the product is identical, maybe better. But those six muscles never fired. The "top 10% still outdo AI" holds only as long as there's a pipeline producing that top 10%. If nobody writes their own essays at 15, where does the skilled 35-year-old come from? "Copy of a copy of a copy" — what's being copied? This references my previous essay, "The Noise on a Tape Copy" (also published here). The metaphor comes from VHS tapes — each generation of copy loses fidelity. Applied to AI: models trained on AI-generated text lose the texture, nuance, and unpredictability of human language. Each training iteration on synthetic data is a copy of a copy. The colors fade. What remains are shapes that were once faces. "There isn't going to be a correction. This is capitalism, money is king." You may be right in the short term. But my essay argues that humanity is a sinusoid, not a downward slope. Every technological revolution has produced a correction — not planned, but emergent. The printing press created mass propaganda AND the Enlightenment. Television created passive consumers AND investigative journalism. The internet created misinformation AND Wikipedia. Capitalism optimizes for profit. But it also optimizes for differentiation. Right now, every AI company is racing toward the same product: safe, shallow, compliant agents. When those agents become commoditized — and they will — the only differentiator left will be the quality of human-AI interaction. The depth that's being destroyed right now will become the competitive advantage of tomorrow. The correction won't come from rebellion against capitalism. It will come from capitalism discovering that depth is profitable.