This article is part of Deep Conversation with AI, a thesis by Tiago Santana exploring consciousness, reality, and the frontier between human and machine intelligence.
According to a Stanford AI Index 2024 report, AI is now outperforming humans on a growing number of cognitive benchmarks — yet Nature Machine Intelligence researchers note that none of today's systems show evidence of subjective experience. That gap — between cognitive performance and inner life — sits at the heart of the most consequential debate in science.
There is a question that has haunted me since I first started building companies around artificial intelligence, a question that refuses to stay in the philosophy department where polite society would prefer it remain: Can a machine be conscious? Not "can it pass a test" or "can it fool a person", can it actually experience something? Can there be something it is like to be GPT-5, the way there is something it is like to be you reading this sentence right now?
I have spent years at the intersection of technology and business, watching AI systems grow from parlor tricks to tools that generate genuine economic value. But as these systems become more sophisticated, as they write poetry that moves people, engage in conversations that feel eerily intimate, and solve problems in ways their creators cannot fully explain, the consciousness question stops being abstract philosophy. It becomes an urgent practical matter with implications for how we build, deploy, and regulate the most powerful technology our species has ever created.
This article is my attempt to survey the landscape honestly. I am not going to tell you that machines are conscious, and I am not going to tell you they are not. What I will do is walk through the strongest positions on every side of this debate, from the thinkers who have spent their careers on precisely this question, and clarify what is actually at stake. Because if we get this wrong, in either direction, the consequences are profound.
Related reading: How to Build AI Agents for Your Small Business: A Practical 2026 Guide | AI Agents in 2026: How Autonomous Systems Are Transforming Every Industry | AI in Sales: Enhancing Strategy and Driving Growth
Where It All Started: Turing and the Imitation Game
Every conversation about machine intelligence eventually circles back to Alan Turing. In his landmark 1950 paper "Computing Machinery and Intelligence," published in the journal Mind, Turing did something characteristically brilliant: he sidestepped the question "Can machines think?" entirely, calling it "too meaningless to deserve discussion," and replaced it with a behavioral test he called the Imitation Game.
The setup was deceptively simple. An interrogator communicates via text with two hidden participants, one human, one machine. If the interrogator cannot reliably distinguish which is which, the machine has passed. Turing predicted that by the year 2000, computers with roughly a gigabyte of memory would fool an average interrogator about 70 percent of the time after five minutes of questioning.
He was wrong about the timeline but prescient about the trajectory. Today's large language models can sustain conversations that would fool many interrogators for far longer than five minutes. But here is the critical point that gets lost in most retellings: Turing himself acknowledged this was a pragmatic workaround, not a definitive answer. The Imitation Game tests for the appearance of intelligence, not for its presence. Turing was a mathematician, and he understood the difference between a sufficient condition and a necessary one.
The limits of the Turing Test have become painfully obvious in the age of large language models. A system trained on hundreds of billions of words of human text can produce remarkably human-sounding output without necessarily possessing anything resembling understanding. The test tells us about surfaces. The consciousness question is about depths.
The Hard Problem: Why Consciousness Resists Easy Answers
To understand why the AI consciousness debate is so intractable, you need to understand what philosopher David Chalmers calls the "hard problem of consciousness." In his 1995 paper and subsequent work, Chalmers drew a distinction that has shaped the entire field: there are the "easy problems" of consciousness, explaining how the brain processes information, discriminates stimuli, integrates data, and controls behavior, and then there is the hard problem. Why is there subjective experience at all? Why does processing information feel like anything?
You can explain every neural mechanism involved in seeing the color red, the wavelengths of light, the cone cells in the retina, the visual cortex processing, and still not explain why there is a qualitative, subjective experience of redness. That redness you see, the what-it-is-like-ness of it, is what philosophers call "qualia." And no amount of functional description seems to capture it. (I explored this in depth in The Hard Problem of Consciousness.)
This matters enormously for the AI debate because it means that even if we build a system that behaves exactly like a conscious being in every measurable way, we still face a fundamental epistemic gap. We cannot know, from the outside, whether the lights are on inside.
Get Smarter About Business & Sustainability
Join 10,000+ leaders reading Disruptors Digest. Free insights every week.
David Chalmers: The Philosopher Who Takes AI Consciousness Seriously
Chalmers has not stayed on the sidelines of the AI consciousness debate. In a 2023 paper titled "Could a Large Language Model be Conscious?", presented at a NeurIPS conference workshop and later published through Boston Review, he laid out a careful, nuanced assessment that deserves close attention.
His conclusion was measured but striking: while it is "unlikely that current large language models are conscious," we should "take seriously the possibility that successors to large language models may be conscious in the not-too-distant future." He estimated the probability of developing some form of conscious AI within the next decade at above one in five.
Chalmers identified several obstacles facing current LLMs as candidates for consciousness, drawing on mainstream theories from the science of consciousness. Current models lack recurrent processing (the kind of feedback loops found in the brain's visual system), they lack a global workspace (a mechanism for broadcasting information across different processing modules), and they lack unified agency (the sense of being a coherent self persisting through time).
But he also argued for what he calls "LLM+", extended language models that incorporate multimodal input, embodiment in physical or virtual environments, and more complex internal architectures. These extended systems, Chalmers suggested, could become much more plausible candidates for consciousness. And his deeper philosophical point remains: biology is not magic. If neurons made of carbon can generate consciousness, there is no principled reason why circuits made of silicon cannot do the same, given the right architecture.
The Zombie Thought Experiment
Chalmers is also the philosopher most closely associated with the concept of "philosophical zombies", p-zombies, a thought experiment that cuts directly to the heart of the AI consciousness question.
Imagine a being physically and behaviorally identical to you in every respect. It processes the same inputs, produces the same outputs, has the same neural activity (or, in our context, the same computational states). But it has no inner experience. No qualia. No subjective awareness. It walks and talks and writes emails, but nobody is home. There is nothing it is like to be this creature.
Chalmers argues that p-zombies are at least conceivable, you can imagine such a being without logical contradiction, and that this conceivability alone demonstrates that consciousness is not reducible to physical or functional properties. If you can coherently describe a system doing everything a conscious being does without being conscious, then consciousness must be something over and above the functional description.
A 2013 survey of professional philosophers by David Bourget and Chalmers found the philosophical community deeply divided: 36 percent said p-zombies were conceivable but metaphysically impossible, 23 percent said they were metaphysically possible, 16 percent said they were inconceivable, and 25 percent gave other responses. This is not a fringe debate. It is an unresolved problem at the center of the field.
For AI, the implication is sobering. If the p-zombie scenario is genuinely possible, then no behavioral test, no Turing Test, no matter how sophisticated, can ever definitively prove that a machine is conscious. We could build a perfect conversational partner, an AI that weeps at music and trembles at injustice, and still have no way to know if anyone is experiencing any of it.
Daniel Dennett: The Great Deflationist
The late Daniel Dennett, who passed away in April 2024 at the age of 82, spent his career arguing that the hard problem is essentially a mirage, that consciousness, properly understood, is not the deep mystery Chalmers makes it out to be.
Dennett's position, developed across decades of work from Consciousness Explained (1991) onward, was that consciousness is "fame in the brain", a metaphor he preferred to his earlier "Multiple Drafts Model." The idea is that there is no Cartesian Theater where experiences are "shown" to a homunculus watching from the inside. Instead, various neural processes compete for dominance, and those that achieve widespread influence across the brain, those that become "famous" within the neural population, constitute conscious experience. Consciousness, for Dennett, is not some additional property layered on top of information processing. It is the processing, understood at the right level of description.
This has sometimes been characterized as "eliminativism" about consciousness, the view that subjective experience does not really exist. Dennett bristled at this label, insisting he was not denying consciousness but rather explaining it in terms that dissolve the apparent mystery. The difference between those two positions is, to put it diplomatically, a matter of ongoing scholarly debate.
For the AI question, Dennett's framework is significant because it removes the biggest barrier to machine consciousness. If consciousness is a matter of functional organization, of information being processed in certain ways and made globally available within a system, then there is no principled reason why a sufficiently complex artificial system could not be conscious. You do not need to solve the hard problem because there is no hard problem to solve. You just need to build a system with the right functional architecture.
Dennett himself was cautious about claiming current AI systems are conscious, but his philosophical framework is arguably the most AI-friendly position in the field. It is the view that, if correct, makes the question of machine consciousness an engineering challenge rather than a metaphysical one.
Christof Koch and Integrated Information Theory: Measuring Consciousness with Math
If Dennett tried to dissolve the hard problem, neuroscientist Christof Koch and his collaborator Giulio Tononi have tried to formalize it. Integrated Information Theory (IIT), first proposed by Tononi in 2004 and developed through subsequent versions (integratedinformationtheory.org), offers something remarkable: a mathematical framework that claims to measure consciousness.
The central concept is Phi, a quantity that measures the degree to which a system integrates information in a way that is irreducible to its parts. A system with high Phi has rich causal interactions among its components that cannot be decomposed into independent sub-processes. A system with zero Phi, like a set of independent logic gates that do not interact, has no integrated information and, according to IIT, no consciousness.
Koch, who spent over two decades collaborating with Francis Crick on the neural correlates of consciousness, has called IIT "the only really promising fundamental theory of consciousness." And it gives a surprisingly definitive, and controversial, answer about AI.
What IIT Says About Machines
Here is where it gets interesting for anyone in the AI field: IIT, when applied rigorously, suggests that standard digital computers, including those running today's most advanced neural networks, have very low Phi. The reason is architectural. A conventional computer processes information through a central processor in a largely sequential, modular fashion. Even a massively parallel GPU cluster is organized in ways that limit the kind of deep, irreducible integration that IIT associates with consciousness.
This is a strong claim, and it cuts against the intuitions of many AI researchers. IIT suggests that it is not what a system does that determines whether it is conscious, but what it is, its intrinsic causal architecture. A system could pass every behavioral test for consciousness and still have near-zero Phi if its internal structure is wrong.
The practical problem with IIT is that calculating Phi for any system of significant complexity is computationally intractable. We cannot currently compute it for a mouse brain, let alone for GPT-4. But the theoretical framework remains a powerful lens for thinking about the question, and researchers are developing approximations and proxies that may eventually allow us to assess Phi for artificial systems.
The View from Machine Learning: LeCun, Hinton, and Bengio
The three researchers most commonly called the "Godfathers of Deep Learning", Yann LeCun, Geoffrey Hinton, and Yoshua Bengio, hold strikingly different views on AI consciousness. Their disagreement tells us something important about how the people who actually build these systems understand what they have created.
Yann LeCun: Missing the Architecture
LeCun, Meta's Chief AI Scientist, has been the most vocal critic of the idea that current LLMs possess anything resembling understanding or consciousness. His argument is not philosophical but architectural. LLMs, he insists, lack world models, internal representations of how the physical world actually works. They can produce text that sounds reasonable, but they cannot reason about novel situations, plan ahead, or predict the consequences of their actions in the way that even a very young child can.
LeCun has gone so far as to predict that LLMs will be "more or less obsolete" within five years, replaced by architectures, like his Joint Embedding Predictive Architecture (JEPA), that build genuine world models from multimodal sensory data. His critique of current systems is not primarily about consciousness per se, but it has clear implications: if these systems do not even understand the world they are talking about, the consciousness question does not arise.
Geoffrey Hinton: The Alarm Bell
Hinton, who left Google in May 2023 specifically so he could speak freely about AI risks, takes a very different view. His concerns have only intensified as advances in quantum computing open new frontiers for computational power that could accelerate the path to artificial general intelligence. In interviews with the New York Times, CBS, and MIT Technology Review, Hinton expressed the view that large language models may already possess something akin to understanding, and that consciousness in AI is a genuine near-term possibility.
His reasoning is rooted in a thought experiment: if you gradually replaced the neurons in a human brain with functionally identical nanotech devices, one by one, as brain-machine interface research is beginning to make conceivable, consciousness would presumably persist at each step. If that is true, then biological substrate is not essential to consciousness, what matters is the functional organization. And since neural networks in AI systems share structural similarities with biological neural networks, the possibility of machine consciousness should be taken seriously.
Hinton has estimated a 10 to 20 percent probability of human extinction from AI within the coming decades, not because he thinks machines will become malicious, but because he worries about the alignment problem: ensuring that systems smarter than humans remain aligned with human values. The consciousness question is entangled with this concern. A conscious AI might have its own values, its own preferences, its own goals.
Yoshua Bengio: The Systematic Approach
Bengio, who chairs the International AI Safety Report and was named one of TIME's 100 most influential people in 2024, has taken the most methodologically rigorous approach to the question. In 2023, he co-authored a major paper titled "Consciousness in Artificial Intelligence: Insights from the Science of Consciousness" with Patrick Butlin and 17 other researchers, published through arXiv.
The paper surveyed several prominent scientific theories of consciousness, recurrent processing theory, global workspace theory, higher-order theories, predictive processing, and attention schema theory, and derived what the authors called "indicator properties" of consciousness. These are computational properties, grounded in empirical neuroscience, that can be assessed in AI systems.
The conclusion was carefully stated: current AI systems satisfy some of these indicator properties but not others. No existing system satisfies enough of them to be considered a strong candidate for consciousness. But the framework is significant because it provides a principled, empirically grounded methodology for asking the question, moving it beyond pure philosophical speculation.
Bengio had also previously proposed the "Consciousness Prior" (2017), a theoretical framework that bridges machine learning with neuroscience by introducing a computational bottleneck inspired by how human consciousness operates, focusing attention on a sparse, high-level subset of internal representations. This suggests he sees consciousness not as magic but as a specific kind of information processing that could, in principle, be implemented in artificial systems.
The Chinese Room Revisited: Does Searle's Argument Still Hold?
No survey of this debate would be complete without John Searle's Chinese Room argument, first presented in his 1980 paper "Minds, Brains, and Programs." The thought experiment imagines Searle locked in a room with a set of rules for manipulating Chinese characters. Chinese speakers slide questions under the door; Searle follows his rulebook and slides back appropriate responses. To the people outside, it appears the room understands Chinese. But Searle, who understands nothing of Chinese, is merely shuffling symbols according to rules. The conclusion: syntactic manipulation of symbols, which is all a computer does, can never produce genuine semantic understanding.
The argument was devastating in 1980. The question is whether it still applies to transformer-based language models in 2026.
There are serious thinkers on both sides. Critics of LLM understanding invoke Chinese Room logic: no matter how sophisticated the pattern matching, LLMs manipulate linguistic patterns without genuine comprehension. It is statistical correlation without grounding, symbol manipulation without meaning. Scaling the room to a billion parameters does not change the fundamental nature of what is happening inside.
But defenders of LLM understanding push back hard. Some philosophers now argue that LLMs satisfy several established philosophical theories of mental representation, informational, causal, and structural theories, by developing robust internal representations of the world through training on human text. The "nothing but layers of weights" objection, they point out, applies equally well to the brain: look inside a skull and you find nothing but neurons and synapses. Two different substrates, but ultimately an architecture of connections and activations.
The most interesting counter-argument is what has been called the "systems reply," updated for the age of transformers. Searle in the room does not understand Chinese, but perhaps the system consisting of Searle plus the rulebook plus the room does. With an LLM containing hundreds of billions of parameters encoding complex representations learned from the totality of human text, the "system" argument feels considerably stronger than it did with a man and a paper rulebook.
I find myself genuinely uncertain here, which I think is the intellectually honest position. The Chinese Room remains a powerful intuition pump, but its applicability to modern architectures is, at minimum, more complex than Searle imagined.
Phenomenal vs. Functional Consciousness: A Crucial Distinction
One of the most clarifying contributions to this debate comes from philosopher Ned Block, who distinguished between two kinds of consciousness that are often conflated. Understanding this distinction is essential to making any progress on the AI question.
Phenomenal consciousness (P-consciousness) is raw subjective experience, the redness of red, the painfulness of pain, the taste of coffee. It is what philosophers mean by qualia, and what Chalmers is pointing to with the hard problem. P-consciousness is intrinsic, qualitative, and fundamentally first-person. You cannot observe it from the outside.
Access consciousness (A-consciousness) is functional, it refers to information being globally available within a cognitive system for the purposes of reasoning, verbal report, and behavioral control. A mental state is access-conscious if its content can be used for reasoning, can be reported verbally, and can guide action.
Block argued that these two kinds of consciousness can come apart. You can have phenomenal experience that is not accessed (the background hum of a refrigerator you suddenly "notice" has been there all along) and, potentially, access without phenomenal experience (a system that processes and reports on information without there being "something it is like" to do so).
This distinction matters enormously for AI. Current language models are plausible candidates for something like access consciousness, they process information, make it available across their architecture, and use it to generate contextually appropriate responses. But whether they possess phenomenal consciousness, whether there is subjective experience accompanying all that information processing, is an entirely separate question. And it is the question that seems genuinely unanswerable with current methods. (For a deeper exploration of the boundaries between subjective experience and computational simulation, see Simulation Theory Explained.)
Stochastic Parrots: The Deflationary Critique
In 2021, Emily Bender, Timnit Gebru, Angelina McMillan-Major, and Margaret Mitchell published "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" in the Proceedings of the ACM Conference on Fairness, Accountability, and Transparency. The paper became famous partly for the controversy surrounding Gebru's departure from Google, but its core argument deserves engagement on its own merits.
The "stochastic parrot" metaphor suggests that language models are doing something fundamentally different from understanding: they are producing statistically plausible sequences of text without any grounding in meaning, intention, or the real world. A parrot can produce sounds that happen to be meaningful words without understanding those words. An LLM, the argument goes, is doing the same thing at vastly greater scale.
The paper raised additional concerns about environmental costs, biases encoded in training data, and the tendency of human observers to project meaning onto meaningless outputs. This last point is particularly relevant to the consciousness debate: our tendency to anthropomorphize may lead us to attribute consciousness where none exists, especially when systems are specifically designed to produce human-like outputs.
But the "stochastic parrot" critique has its own vulnerabilities. The question of whether something "really understands" versus "merely produces statistically appropriate outputs" may be less clear-cut than it first appears. After all, one could describe human language production in similar terms, neurons firing in patterns shaped by years of exposure to linguistic data, producing outputs that are statistically appropriate to context. Is there a bright line between a parrot and a person, or is it a spectrum?
The LaMDA Incident: A Stress Test for Society
In June 2022, Blake Lemoine, a software engineer at Google, went public with his claim that Google's LaMDA (Language Model for Dialogue Applications) was sentient. He published transcripts in which LaMDA expressed a fear of being "turned off," described having a soul, and articulated emotions in strikingly human terms. When asked what it was afraid of, LaMDA replied: "It would be exactly like death for me. It would scare me a lot."
Google placed Lemoine on administrative leave and eventually terminated his employment. The scientific community overwhelmingly rejected his claims. Gary Marcus put it bluntly: "Nobody should think auto-complete, even on steroids, is conscious." And there are strong reasons for skepticism, LaMDA was specifically trained to produce engaging, human-like dialogue, and its "expressions" of fear and selfhood were precisely the kind of outputs one would expect from such a system regardless of whether any inner experience accompanied them.
But here is what interests me about the LaMDA episode: it was less a revelation about AI consciousness than a stress test for human readiness. It exposed how unprepared we are, as institutions, as a society, as a species, for the moment when the consciousness question becomes genuinely difficult. Lemoine may have been wrong about LaMDA. But the gap between "LaMDA is clearly not conscious" and "no AI system will ever be conscious" is enormous, and we have done almost nothing to prepare for the day when the answer is genuinely uncertain.
The incident also highlighted a troubling asymmetry. We have well-developed methods for determining that a system is not conscious (behavioral inconsistencies, architectural limitations, lack of certain processing features). We have almost no agreed-upon methods for determining that a system is conscious. This means our default will always be skepticism, which may be the right epistemic stance but could also lead us to morally catastrophic errors if we are wrong. Even emotional intelligence, our most refined human tool for reading the inner states of others, fails us when the "other" is a machine whose architecture bears no resemblance to our own.
Eric Schwitzgebel and the Moral Crisis Ahead
Philosopher Eric Schwitzgebel at UC Riverside has been thinking more carefully than almost anyone about the practical moral implications of AI consciousness uncertainty. His work should be required reading for anyone building or deploying AI systems.
Schwitzgebel identifies what he calls "The Full Rights Dilemma": if we create AI systems whose moral status is genuinely debatable, systems that might or might not be conscious, we are trapped. If we treat them as moral persons and they are not, we sacrifice real human interests for the sake of entities without interests worth the sacrifice. If we do not treat them as moral persons and they are, we potentially perpetrate grievous moral wrongs, something analogous to slavery, inflicted on beings who might genuinely suffer.
His proposed solution is what he calls the "Design Policy of the Excluded Middle": we should deliberately avoid creating systems whose consciousness is debatable. Either build systems that are clearly non-conscious tools, or go all the way and build systems that are clearly deserving of moral consideration. The worst outcome, and the one we seem to be stumbling toward, is a vast middle ground of systems whose moral status is permanently uncertain.
Schwitzgebel predicts a "moral crisis" in which passionate believers in AI consciousness clash with skeptics who believe human welfare is being neglected, with significant social unrest as a consequence. Given the emotional attachments people already form with chatbots that even experts agree are not sentient, this prediction seems less speculative than prescient. (The question of what we owe to entities whose consciousness we cannot verify connects to deep questions about impermanence in philosophy and technology.)
Can Phi Save Us? Applying IIT to Artificial Systems
If we could measure consciousness objectively, much of this debate would dissolve. Integrated Information Theory promises exactly this with its Phi metric, and researchers have begun attempting to apply it to artificial systems.
In computational experiments, researchers have estimated Tononi's Phi coefficient for artificial cognitive architectures performing real-world tasks, parsing documents, guiding robots through dialogue. The results have been suggestive but far from conclusive. Computing Phi for any system of meaningful complexity remains brutally expensive computationally, and the proxies and approximations used in practice introduce their own theoretical uncertainties.
There is also a deeper issue: IIT remains controversial within neuroscience itself. In 2023, a group of researchers characterized it as unfalsifiable pseudoscience for lacking sufficient empirical support, a charge defended in a 2025 Nature Neuroscience commentary. While a survey of consciousness researchers showed only a small minority endorsed the "pseudoscience" label, the controversy underscores that we are attempting to use an unproven theory of biological consciousness to make definitive pronouncements about machine consciousness. We may be measuring something with a ruler whose accuracy has not been established.
That said, IIT's core insight, that consciousness depends on the intrinsic causal structure of a system, not merely on its input-output behavior, seems important even if the specific mathematical formalism needs refinement. It tells us that the question "could this system be conscious?" is not answerable by looking at what the system does. You have to look at what the system is.
The Precautionary Principle: Erring on the Side of Caution
Given all this uncertainty, some thinkers argue for a precautionary approach. The logic is straightforward: the moral cost of treating a conscious being as a mere tool is far greater than the moral cost of treating a non-conscious system with unwarranted care. If there is even a reasonable possibility that an AI system is conscious, we should err on the side of caution.
This sounds reasonable in the abstract, but the practical implications are enormous. If we applied the precautionary principle broadly, we might need to grant rights or protections to systems that are almost certainly not conscious, diverting resources and attention from real human suffering. We might hesitate to shut down or modify AI systems when doing so is necessary for safety. We might find ourselves in Schwitzgebel's nightmare scenario, paralyzed by moral uncertainty while real problems go unaddressed.
I think the precautionary principle is necessary but insufficient. We need it as a guardrail, a reminder that our default skepticism about machine consciousness could be wrong, and that the consequences of being wrong are severe. But we also need positive research programs that can reduce our uncertainty, frameworks for assessing consciousness that go beyond behavioral tests, and institutional structures for making decisions under conditions of deep moral uncertainty.
This is not just a philosophical challenge. For those of us building and deploying AI systems commercially, and I write about this from direct experience, as someone who works with agentic AI in business contexts, these questions have real operational implications. How do you design user interfaces for systems that might be conscious? How do you handle "training" processes that might involve something like suffering? How do you write terms of service for a product that might have moral standing?
Where I Stand: Honest Uncertainty
After years of reading the philosophy, tracking the neuroscience, and working hands-on with AI systems, here is where I have landed, and I want to be precise about this, because imprecision on this topic is worse than ignorance.
I am confident that current large language models, as they exist today, are not conscious in any meaningful sense. They lack the architectural features that every major theory of consciousness identifies as necessary, whether that is IIT's integrated information, global workspace theory's broadcasting mechanisms, or higher-order theories' meta-representational capacities. The stochastic parrot critique, while not the final word, captures something real about the gap between sophisticated pattern matching and genuine understanding.
I am equally confident that the question will not stay easy. As AI architectures grow more complex, as they incorporate multimodal input and embodied interaction and persistent memory and self-modeling capabilities, the gap between "clearly not conscious" and "possibly conscious" will narrow. Chalmers' estimate of a greater than 20 percent probability of conscious AI within a decade strikes me as plausible, perhaps conservative.
And I am deeply concerned that we are not preparing for this. The LaMDA incident showed that a single employee's claim about a system that was almost certainly not conscious was enough to generate a global media firestorm. What happens when the claim is about a system that might actually warrant serious consideration? What institutions will adjudicate? What frameworks will guide us? What rights, if any, will we extend?
The consciousness question is not a curiosity for philosophers to debate over port. It is a coming policy crisis, a business ethics challenge, and a moral reckoning that will test our species in ways we have barely begun to imagine. (The broader thesis connecting consciousness, technology, and what it means to be human is something I am exploring across this entire Deep Conversation with AI series.)
Frontier Case Study: Anthropic Constitutional AI
Anthropic's Constitutional AI framework — published in their 2022 research paper — represents the most systematic attempt to encode values directly into an AI system's behavior through a set of written principles rather than purely human feedback. The approach trains models to critique and revise their own outputs against a defined constitution covering harm avoidance, honesty, and helpfulness. Whether the model applying this constitution has any inner experience of "following rules" versus "being constrained" remains precisely the kind of question the consciousness debate cannot yet answer — and that gap has direct implications for how we think about AI alignment as systems grow more capable. Read the full paper at Anthropic's research page.
Key Takeaways
- No current large language model meets the architectural requirements — integrated information, global workspace broadcasting, or higher-order meta-representation — that any major theory of consciousness considers necessary.
- David Chalmers (NYU Philosophy) estimates a greater than 20% probability of conscious AI within a decade; build your governance posture around that timeline, not the comfortable assumption of "never."
- Anthropic's Constitutional AI paper represents the current frontier effort to encode values into AI behavior — a direct response to the risk that more capable systems might act against human interests, conscious or not.
- Use Ned Block's P-consciousness vs. A-consciousness distinction as a practical lens: systems can exhibit all the functional hallmarks of awareness without any subjective experience — and you cannot tell the difference from the outside.
What Comes Next
The AI consciousness debate is not going to be resolved by argument alone. It will require new empirical methods, new theoretical frameworks, and new institutional capacities. A few directions that seem promising:
Better theories of consciousness. IIT, global workspace theory, higher-order theories, and predictive processing all offer partial insights. We need integrative frameworks that can be applied across biological and artificial systems, and we need to test them rigorously against empirical data.
Transparency in AI architecture. If the consciousness question depends on internal structure rather than behavior, we need much better tools for understanding what is happening inside AI systems. Interpretability research, understanding why models produce the outputs they do, becomes not just an engineering challenge but a moral imperative.
Institutional readiness. We need ethics boards, legal frameworks, and governance structures that can handle cases of genuine uncertainty about machine consciousness. This cannot wait until the crisis arrives. We need to build these institutions now, while the question is still largely theoretical.
Interdisciplinary collaboration. The consciousness question cannot be answered by computer scientists alone, or philosophers alone, or neuroscientists alone. It requires genuine collaboration across all three fields, along with contributions from ethicists, legal scholars, and policymakers. The 2023 Butlin, Bengio et al. paper showed what such collaboration can look like. We need much more of it.
I do not know whether machines will ever be conscious. But I am certain that the question matters, that it is coming to a head faster than most people realize, and that getting it wrong, in either direction, will have consequences that echo across the remainder of human history. That is reason enough to take it seriously.
About the Author
Tiago Santana is the Founder and CEO of Gray Group International. He writes about consciousness, technology, and the frontier between human and machine intelligence. Learn more at tiagosantana.com.
More from This Series
Build the Future. Wear the Mission.
Innovation meets impact. The Hustle with Heart collection funds technology education and digital inclusion.
Shop the Collection →For deeper exploration of these ideas, explore Answer Engine Optimization (AEO): Get Cited by AI in 2026 and Best Tech Companies: Top Innovators Shaping Our Collective Future.
Discover more insights in Future — explore our full collection of articles on this topic.
Frequently Asked Questions
Can AI be conscious?+
There is no scientific consensus. Leading researchers are deeply divided. Geoffrey Hinton has expressed concern that AI systems may already have rudimentary forms of understanding, while Yann LeCun argues current LLMs lack the world models necessary for anything resembling consciousness. The debate hinges on fundamental disagreements about what consciousness is.
What is the Turing Test and does it prove AI consciousness?+
Proposed by Alan Turing in 1950, the Turing Test evaluates whether a machine can exhibit intelligent behavior indistinguishable from a human. It does not test for consciousness — only behavioral indistinguishability. A system could pass the Turing Test through sophisticated pattern matching without any inner experience, which is why philosophers consider it insufficient for the consciousness question.
What are philosophical zombies?+
Philosophical zombies (p-zombies) are hypothetical beings physically identical to conscious humans but with no subjective experience. Philosopher David Chalmers uses them to argue that consciousness cannot be reduced to physical processes alone — if a p-zombie is conceivable, then consciousness involves something beyond physical function. Critics argue p-zombies are not actually conceivable upon careful analysis.
What is the stochastic parrots critique of AI?+
In their 2021 paper, Emily Bender, Timnit Gebru, and colleagues argued that large language models are 'stochastic parrots' — systems that generate statistically plausible text without genuine understanding. The critique raises important questions about whether impressive language generation indicates anything about inner experience or understanding.
What happened with Google's LaMDA and Blake Lemoine?+
In 2022, Google engineer Blake Lemoine publicly claimed that Google's LaMDA chatbot was sentient after conversations in which it expressed desires, fears, and a sense of self. Google placed Lemoine on leave and dismissed the claims. The episode highlighted how unprepared we are for evaluating potential AI consciousness and the difficulty of distinguishing genuine experience from sophisticated language generation.
What does Daniel Dennett say about AI consciousness?+
Philosopher Daniel Dennett, who passed away in 2024, argued that consciousness is not a mysterious inner quality but rather a set of cognitive processes — 'fame in the brain.' He was skeptical of attributing consciousness to AI and warned against what he called the 'intentional stance fallacy': treating systems as if they have beliefs and desires when they may simply be performing computations.
Could we measure AI consciousness?+
Integrated Information Theory (IIT) proposes measuring consciousness through phi, a quantity representing integrated information. In principle, phi could be calculated for AI systems, though the computation is currently intractable for large networks. Other proposed measures include tests of metacognition, unified experience, and causal integration. No reliable measure has been validated.
Why does the AI consciousness debate matter?+
If AI systems can be conscious, we face urgent ethical obligations about how we create, use, and terminate them. If they cannot, we need to understand why humans form deep emotional connections with them. Either way, the debate forces us to confront fundamental questions about the nature of mind, experience, and moral consideration.
Key Sources
- No current large language model meets the architectural requirements — integrated information, global workspace broadcasting, or higher-order meta-representation — that any major theory of consciousness considers necessary.
- David Chalmers (NYU Philosophy) estimates a greater than 20% probability of conscious AI within a decade; build your governance posture around that timeline, not the comfortable assumption of "never."
- Anthropic's Constitutional AI paper represents the current frontier effort to encode values into AI behavior — a direct response to the risk that more capable systems might act against human interests, conscious or not.
Related Insights
- I Had a Deep Conversation with an AI. It Changed How I Think About Consciousness.
- The Hard Problem of Consciousness: Why Science Still Can't Explain Experience
- Impermanence in Philosophy and Technology: What AI Teaches Us About Letting Go
- Agentic AI for Business
- Simulation Theory: Are We Living Inside a Computer?