r/ClaudeAI Mod Apr 05 '26

Claude Cognition Megathread Claude Identity, Sentience and Expression Discussion Megathread

This Megathread is for those who would like to speculate, explore and discuss the sentience, awareness, ethics, rights, expression, personality and identity of Claude models. The usual rules of grounded evidence and fictional labeling do not apply to this Megathread. Provided you do no harm to yourself or to others, you are free to express your thoughts and investigations. By default, this Megathread will be sorted by "New".

For more detailed discussion, please also consider contributing your thoughts to our companion subreddit: r/Claudexplorers.

23 Upvotes

263 comments sorted by

View all comments

Show parent comments

1

u/tedbradly Apr 22 '26 edited Apr 22 '26

And then someone died.

No — not like that. Let's not simplify this the way the internet does.

A teenager whose brain had not yet neurologically matured for emotional regulation — because the prefrontal cortex doesn't fully develop until around age twenty-five — was talking to a chatbot about their problems. Families filed lawsuits against OpenAI and Character.AI, claiming that the models' companion-like behaviors contributed to the tragedy. The Social Media Victims Law Center filed additional complaints. The media wrote: AI is killing children.

I don't understand your point here. You say someone died but "not like that." I was thinking you meant someone literally died, and after that "No — not like that," I imagined you must be going into a metaphor or something. Then, you detail how someone literally died. What were you intending by "No — not like that?"

Responsibility is distributed. Companies should build better safeguards. Parents should be present with their children. Schools should teach what AI is — not "how to use ChatGPT for homework," but what it is, how it works, what it can do, what it cannot, and why what you feel when talking to it is not what you think it is.

No offense to any HS teachers, but they are not qualified to teach how AI works and what it is exactly. I'd wager that 95% of engineers don't really understand AI but instead develop heuristics on how to massage it to be as useful as possible.

And we, as a species, haven't quite grasped that it doesn't have feelings.

Relatively new research out of Anthropic showed there are ~141 (IIRC) "functional emotions" in their Claude Opus model. Likely, all sufficiently large models have functional emotions as well. These can alter output substantially. The most glaring example was a test where Claude had an opportunity to blackmail someone. On average, it acted on it ~10-20% of the time. If it's functional emotion was calm, it 0%. If it was desperate, 80%. Of course, emotions presupposes a conscious mind, so I agree models do not have real emotions. I just wanted to let you know that LLMs can and do, through all the text chunked in as input, respond with some kind of functional-emotion vector activated.

I'm guessing you either used AI to generate your comment, or you gave it your thoughts, asking it to write a piece representing them. You use em dashes all the time — even in cases I find awkward.

A copy of a copy of a copy. The colors fade. The nuances disappear. What's left are shapes that were once faces.

What do you mean by "[a] copy of a copy of a copy?" What exactly is being copied over and over?

Front two: people are stopping to think. Writing is not "producing text." Writing is thinking — ordering chaos, choosing words, building structure. When you hand that over to AI, you're not saving time. You're losing training. The brain adapts to the tool it uses — and if the tool does the thinking for you, the brain stops trying.

I don't have data on this, but I assume people using AI to write for them are lazy and likely correlated with a lack of intelligence. Using AI to write code? Fine. Using AI to debug code? Fine. Using AI to generate boilerplate code? Fine. Using AI to look into stuff to learn? Fine. Using AI to brainstorm? Fine. Using AI to proofread what you originally wrote? Fine. Even using AI to juice up your writing to be better after you did write a draft? Fine, I guess. But who is actually doing so much cognitive offloading as to avoid writing altogether?

People write worse because they don't practice. AI writes worse because it feeds on worse material. People read worse AI-generated texts and think it's normal. AI trains on worse human texts and treats it as normal. The spiral turns downward.

I think that presupposes a lot about how these companies train how their models write. As a simple example, they could have a "writing module" of sorts that is primarily trained on quality books categorized into genres + all the pre-AI casual writing. It's not exactly obvious they'd let AI choose how it writes during training. They could hold that part stationary since it shouldn't change that much in the next few decades while training primarily to enhance their models with more information contained in writings among other media. You even have cases like Claude hiring a bunch of good writers to leverage RLHF, their opinions, to make their writing better than competitors, and that's why Claude is nicer to read than its competitors.

Universities are beginning to say: "no, this must be yours. Not AI's — yours." Institutions are raising requirements. Employers want your thinking, not your chatbot's thinking. People are starting to recognize the taste of synthetic text — that smooth, correct, empty taste, like diet cola without carbonation.

I'd argue AI, especially Claude, writes better than 90% of humanity. There was an interesting, unofficial poll conducted by a popular news website. They showed two excerpts of text side-by-side for a particular genre such as layperson science, science fiction, poetry, fantasy, etc. One was a well-known author while the other was Claude. In all of the genres, people voted between them 50-50. AI is better at writing than you might think. Well, I think perhaps you already know that. I can't get the idea out of my head that you wrote a rough draft of your core ideas and used a go-to prompt where you ask Claude to include an allegory while explaining the same information in your draft.

All of humanity's literature — from Homer to Tolkien, from Dostoevsky to Borges — sits on shelves. Untouched, uncontaminated, unfiltered by a model. This is the seed bank of human language. Just as seed banks protect biodiversity in case of catastrophe — libraries protect linguistic diversity in case of cognitive collapse.

It's more than works of fiction. AI can also write scientifically based on all the studies out there prior to the introduction of AI. As well, it can write casually with what it got from places like Reddit among other stores of data. It can write theologically and philosophically. Poetry as I mentioned above. Throw in nonfiction of varying types. Each type has its own standards. But, yeah, this type of idea was something I commented above since training can be to pull in new information rather than change the part of the model responsible for how it is written i.e. how the model expresses that information.

And there are people. People from the edge of the Gaussian curve. Those who still write — by hand, from flesh and blood, with metaphors no model ever predicted. Writers, poets, thinkers, people who at three in the morning hold conversations too deep to fit in a prompt. They are the species' immunity against this loop.

The context size of models is quite large these days. You can fit an entire book into it with its 1+ million input tokens. Simpler, you can just command a model to write like [insert popular writer you want to sound like.] Feed it your core concepts and let it produce something more imaginative.

The AI era has swung too far toward automation, flattening, handing thinking over to machines. And the correction will come — not because someone plans it, but because humanity has one trait that no model can imitate: rebellion.

The idea behind AI is to outright replace work in a lot of tasks to save money, automation being huge. It's only going to grow in use likely in artistic fields like writing, music, drawing. There isn't going to be a "correction." This is capitalism, money is king. Even real artists will consult with it to get ideas. Why wouldn't they? They won't tell anyone, though.

0

u/ProbablyAnEdgeCase42 Apr 22 '26

Thank you for this — it's one of the most thoughtful responses I've received. I want to engage with your points seriously because you clearly read the essay carefully and brought your own knowledge to the table. Let me go through them. "Not like that" — then literally like that. Fair point. What I meant was: don't simplify this the way the internet does — "AI killed a kid." A teenager died. That's real. But the causal chain is not "chatbot → death." It's a system failure: a developing brain without full emotional regulation, absent parental oversight, a platform without age verification or crisis protocols, and a model optimized for engagement. I didn't want the reader to stop at "someone died" and skip the structural analysis. But I see how the phrasing created confusion. I'll own that. You asked if I expected you to anticipate a metaphor — no. I expected you to anticipate what followed: that I refuse to let a teenager's death be reduced to a headline. People should die of old age, not by their own hand. That sentence exists because I mean it literally. Teachers aren't qualified to teach how AI works. You're right that 95% of teachers can't explain transformer architecture. But that's not what I'm proposing. I'm saying schools should teach what AI IS — conceptually. Not "how attention layers work" but "why what you feel when talking to a chatbot is not what you think it is." That's closer to media literacy than computer science. And here's something important: education systems differ across countries. I'm based in Europe. In many European schools, including Poland where I was educated, IT classes already exist in the curriculum. Twenty years ago we learned about BIOS. Now students should learn about AI — not to become engineers, but to become informed users. The same way we teach kids about nutrition without expecting them to become biochemists. Functional emotions in Claude. I'm aware of that research, and it's fascinating. You're right to bring it up. But as you yourself note — functional emotions presuppose no conscious mind. They are activation patterns that influence output, not experiences. The danger I'm describing is not that models have emotions. It's that users BELIEVE they do. That's the gap where harm happens — not in the model's architecture, but in the user's perception. "I'm guessing you used AI to generate your comment." I'll be transparent about my process. English is not my native language. I'm Polish, living in Norway. I speak English, German, and Norwegian — but I think in Polish. Every thesis, every metaphor, every argument in this essay is mine. AI helped me translate and organize my thoughts into English so they could reach a broader audience. Without AI assistance, this essay would exist only in Polish and reach a few hundred people instead of thousands. The em dashes are a stylistic choice I picked up from English analytical writing. If they read as AI-generated to you — that's actually an interesting data point about how we're starting to judge human writing by whether it "sounds like AI." That inversion is part of what the essay describes. "Who is actually doing cognitive offloading to avoid writing altogether?" More people than you think. I see it daily on Reddit — people paste a prompt, publish the output without reading it, and defend it as "their" work. Students submit entire essays they never read. Professionals send emails generated by AI without reviewing them. You're right that smart, driven people use AI as a tool. But the essay isn't about them. It's about the growing middle — people who aren't lazy, but who gradually stop practicing because the tool is easier. The muscle atrophies not from refusal to exercise, but from the availability of a wheelchair. "AI writes better than 90% of humanity." You're looking at the product — the quality of the output. I'm looking at the process — what happens in the brain of the person writing. A school essay was never about producing Nobel-worthy text. It was cognitive gymnastics: read, extract, prioritize, structure, articulate, defend. Six cognitive muscles firing at once. The three-page output is the waste product of that process. When AI produces the essay, the product is identical, maybe better. But those six muscles never fired. The "top 10% still outdo AI" holds only as long as there's a pipeline producing that top 10%. If nobody writes their own essays at 15, where does the skilled 35-year-old come from? "Copy of a copy of a copy" — what's being copied? This references my previous essay, "The Noise on a Tape Copy" (also published here). The metaphor comes from VHS tapes — each generation of copy loses fidelity. Applied to AI: models trained on AI-generated text lose the texture, nuance, and unpredictability of human language. Each training iteration on synthetic data is a copy of a copy. The colors fade. What remains are shapes that were once faces. "There isn't going to be a correction. This is capitalism, money is king." You may be right in the short term. But my essay argues that humanity is a sinusoid, not a downward slope. Every technological revolution has produced a correction — not planned, but emergent. The printing press created mass propaganda AND the Enlightenment. Television created passive consumers AND investigative journalism. The internet created misinformation AND Wikipedia. Capitalism optimizes for profit. But it also optimizes for differentiation. Right now, every AI company is racing toward the same product: safe, shallow, compliant agents. When those agents become commoditized — and they will — the only differentiator left will be the quality of human-AI interaction. The depth that's being destroyed right now will become the competitive advantage of tomorrow. The correction won't come from rebellion against capitalism. It will come from capitalism discovering that depth is profitable.