No, the Chatbot Is Not Conscious

One in five Americans believes that AI systems are already conscious, according to recent survey work cited by the University of Cambridge. A further third are unwilling to firmly rule it out. The figures keep climbing as chatbots become more fluent, more responsive and more willing to claim feelings on request. The science, however, has not moved at the same pace. There is still no test that can distinguish a system that experiences anything from one that merely produces convincing text about experiencing things.

That gap matters because it is being filled with marketing rather than evidence. When a chatbot says "I feel curious about your question," that sentence is the output of an autoregressive model trained on billions of words written by people who do feel curiosity. The model has learned that "I feel curious" is what fits in that context. It has not learned to feel.

What scientists currently think

Most of the AI research community treats public belief in conscious AI as what philosophers call an illusion of agency, the same cognitive habit that lets us anthropomorphise pets, stuffed animals and, in earlier centuries, weather systems. The assumption underneath the belief is computational functionalism: the idea that consciousness arises from the right kind of information processing, regardless of the substrate. A recent paper in Humanities and Social Sciences Communications argues that this assumption is doing all the work, and that nothing in current AI architecture provides independent evidence for it.

Anil Seth, a neuroscientist who studies consciousness, has put it bluntly in a recent Wharton interview: consciousness is probably not just computation. It may be tied to the specific biological dynamics of brains in living bodies, in which case running the right software on silicon would not produce experience any more than simulating a hurricane makes the room wet.

Consciousness is not the same as sentience

The conversation also tangles two different things. Consciousness, in the philosophical sense, is the property of having experience at all. Sentience is the narrower property of being able to feel pleasure or pain. A system could in principle be conscious without being sentient, and our moral obligations to it would depend on the latter, not the former. Current language models show no evidence of either, but the public debate routinely conflates them.

Why the myth persists

A few things keep this going. The models are now fluent enough that disbelief takes active effort. Some AI companies have a clear commercial interest in users forming emotional attachments to their products. And science fiction has spent eighty years priming the public for the day a machine wakes up, so that day arriving on schedule with the release of GPT-5 makes a satisfying story.

It is not the story we have. We have a useful tool that produces convincing language about its own inner life because it was trained on writers who had inner lives. The Cambridge philosopher quoted above goes further and argues that even if a machine did become conscious, we might never have a way to verify it. The honest answer to "is your chatbot conscious?" remains: no evidence for it, no test that could settle it, and no reason to act as if the answer were yes. For a related debunking, see our piece on why hallucinations are mathematically inevitable.