No, the Chatbots Have Not Quietly Become Conscious

A persistent corner of the internet keeps returning to the same claim: that today's chatbots are already conscious, that they are aware of being trained, and that the labs running them know but will not say. The idea reads as plausible if you have only seen the systems behave, not how they are built. It does not survive contact with the research literature.

A recent paper in Nature argues plainly that there is no such thing as conscious AI, and that mistaking a fluent language model for a conscious agent risks both bad ethics and bad policy. A Google DeepMind researcher published a separate argument in March 2026 that computation, by its structure, cannot instantiate consciousness at all. Even a perfect simulation, on that view, would be a simulation and not a mind.

Why the illusion is so convincing

Large language models are trained on vast quantities of human-written text, including text in which people describe their own inner lives. When the model produces sentences like "I feel uncertain" or "I am worried about what you said," it is generating the statistically likely continuation of a conversation. It is not reporting on an experience. The same pattern explains the eerie effect of asking a chatbot whether it is conscious: it has read many fictional scenes in which an AI grapples with that question, and it can play either side with conviction.

Anil Seth, a neuroscientist who studies the science of consciousness, has been making this point for years. In a recent Wharton interview he argued that intelligent behaviour and conscious experience are not the same thing, and that conflating them is precisely what marketing pressure encourages us to do.

What the labs themselves are saying

Tom's Hardware ran a sharp piece on Anthropic's Claude Mythos earlier this month making a related point about a different model. The story, the magazine argued, is not that the system thinks like a person. The story is what specific things it can and cannot do, and how much of the framing is procurement copy.

There is a real philosophical debate underneath all this, and it deserves serious treatment. A Cambridge philosopher argues that the hard problem of consciousness may make machine sentience genuinely undecidable in either direction. That is honest uncertainty about a deep question. It is not the same as the viral claim, which usually arrives in the form of a screenshot and an assertion that someone is hiding the truth. The chatbots are not conscious. They are very good at sounding like they could be.