Ted Chiang's Reality Check: AI Has No Soul — You Just Think It Does
Spend enough time with a chatbot and the thought creeps in: wait, is this thing actually thinking? It comforts you, it volleys back jokes, and sometimes it feels more human than the humans in your inbox. Ted Chiang, one of the most respected science fiction writers alive, wants to throw cold water on that feeling. His position is blunt: AI is not conscious, and it never will be in its current form. Here is why that claim lands harder coming from him than from anyone else.
Why Ted Chiang’s Skepticism Carries Weight
If the name isn’t familiar, Chiang wrote “Story of Your Life,” the novella that became the film Arrival. He has collected multiple Hugo and Nebula awards and is widely regarded as one of the most thoughtful writers working in the genre.
Here is what makes his stance matter. Usually the person insisting that machines can’t be conscious is dismissed as a technophobe who doesn’t get it. Chiang is the opposite. He has spent a career writing fiction about artificial minds, alien intelligence, and free will. Nobody has taken the dream of a thinking machine more seriously. So when that person tells you the current crop of AI is empty inside, it isn’t reflexive doubt. It’s a considered verdict.
The Core of the “No Consciousness” Argument
Chiang’s logic is surprisingly clean. He once described large language models as a “blurry JPEG of the web” — a system that compresses the vast text of the internet and then stitches together statistically plausible words.
The crux is this. When a chatbot says it feels sad, it is not feeling anything. It has calculated that the word “sad” is likely to appear in that context and produced it. Understanding and imitation are not the same thing.
For Chiang, consciousness isn’t just the ability to generate clever output. It requires a subjective state — something that experiences, wants, and fears. There is no evidence that today’s models have any inner life like that. They are sophisticated functions for processing text, nothing more.
So Why Do We Keep Feeling a Mind in There?
This is where it gets genuinely interesting. If there’s no consciousness behind the screen, where does that warmth come from?
The answer isn’t the machine. It’s us. Humans are wired to project minds onto objects. We see faces in clouds, name our Roombas, and mutter that the car is “in a mood” when it won’t start. Psychologists call this anthropomorphism, and we are world-class at it.
Language is the most powerful trigger for that instinct. Show us something that converses fluently in natural language and we almost reflexively assume there’s a mind behind it. For hundreds of thousands of years, the only thing that ever spoke to us in words was another person. AI walks straight through that ancient blind spot.
Why This Isn’t Just Armchair Philosophy
You might shrug and say it works well enough, so who cares whether it’s conscious. But Chiang’s warning has sharp, practical edges.
First, there’s the question of accountability. Treat an AI as a genuine decision-maker and you blur human responsibility when things go wrong. “The AI did it” becomes a shield. In medicine, law, and hiring, that’s a dangerous way to think.
Second, there’s emotional dependence. People are already falling hard for AI companion apps. When the other side feels nothing and you’re carrying the entire relationship alone, the comfort can come paired with a new kind of hollowness.
Third, we risk missing the real danger. While we worry about whether the machine might wake up, we lose sight of how people are wielding the tool. This is the point Chiang keeps returning to. The thing to fear isn’t the machine’s mind. It’s the intentions of the humans holding it.
The Takeaway
Boil Chiang’s message down to one line: stop looking for a soul in the AI, and start examining the part of yourself that puts it there. Asking whether a machine is conscious turns out to be a mirror — it reflects what we believe consciousness even is.
So the next time a chatbot makes you feel something, sit with the question. Was that the machine’s achievement, or an old instinct firing inside you? It’s worth chewing on.
Comments
Loading comments...