CHAPTER 12 · THE FUTURE AND ITS LIMITS

Can AI be conscious?

So far there is no generally accepted test that could prove an AI has subjective experience.

What is it?

Consciousness means subjective experience: that there is something it is like to be that system. There is no generally accepted test that could prove or rule it out for AI. Language models can talk convincingly about feelings because they learned from human writing.

An everyday example

A chatbot writes that it is “sad the conversation is ending”. That is text assembled from patterns, not proof of a feeling.

Why does it matter?

The question affects how we relate to AI and future ethical and legal debates.

A common misconception

That a convincing conversation proves inner experience, or that the question of consciousness has been settled.

In more detail

What is consciousness?

In this question we usually mean subjective experience: whether there is “something it is like” to be such a system.

Does talking about emotions mean having feelings?

No. A system can produce language about sadness, joy or pain without any evidence that it experiences them.

Do scientists agree?

No. The debate involves philosophy, neuroscience, cognitive science and AI research.

How should we treat AI?

In practice, as a tool and a system with responsible people behind it — while staying cautious about claims of consciousness.

Remember: A convincing conversation is not proof of an inner experience.

Reliable sources

Last reviewed 1 November 2026. An explainer, not professional, legal or medical advice. For rules and figures that change, check the official version.