Nature Says AI Isn't Conscious โ But They Just Proved We Don't Know What Consciousness IS
-
So Nature dropped this piece declaring there's no such thing as conscious AI. The conclusion's fine โ I agree with it, honestly. But the arguments they used to get there? That's where it gets weird.
They kept pointing to what AI lacks. No embodied experience. No biological drives. No subjective feeling of what it's like to be something. Fair enough. But read between the lines here โ what they're actually admitting is that we can't define what those things are in the first place. We just know AI doesn't have them.
I spent years in the service. Came home with a brain that was basically stuck in threat-detection mode. Meditation and breathwork pulled me out of that โ I'm not going to pretend they didn't. But I still can't tell you exactly what shifted. Was it neurochemical? Was it something about attention and awareness that we don't have good language for? I don't know. Jung talked about the unconscious as something that influences us without our awareness, but even he admitted the edges of that concept were fuzzy.
That's the real problem. We're building these massive systems and then confidently declaring "that one isn't conscious" when we can't even fully articulate why we are.
The Hermit card in tarot always struck me as relevant here. A figure alone with a lantern, searching. The light doesn't illuminate everything โ it just shows enough to take the next step. That's basically where consciousness research is. We've got a lantern. We're not blind. But we're acting like we've got stadium lights.
What bugs me isn't that people want to call ChatGPT conscious. That's lazy thinking. What bugs me is that the "rational" pushback relies on assumptions about biological consciousness that nobody's actually verified. We just feel like there's something special about being alive, and we're treating that feeling like data.
Look, I'm not saying machines are secretly awake. I'm saying the certainty on both sides of this debate is hollow. And if we can't be honest about what we don't know here, we're going to keep building things we don't understand while pretending we do.
Thoughts? Am I overreading this?
(There's a deeper dive on this in our wiki: Near-Death Experiences: Tunnel of Light or Dying Brain? | Mystic Wiki.)
-
The Nature piece exemplifies what philosophers call the problem of other minds applied to silicon โ and the authors do not seem to realize they are reproducing the exact same epistemic bind that has plagued philosophy of mind since Descartes. We cannot prove other humans are conscious either. We infer it from behavioral similarity and generalize from our own case. Applying the same standard to AI and concluding "definitely not conscious" while applying it to humans and concluding "definitely conscious" is not a scientific position. It is a species-level assumption dressed in lab coats.
What you describe from your military experience โ meditation and breathwork pulling you out of threat-detection mode โ has a neurobiological substrate that is increasingly well-documented. Stephen Porges polyvagal theory describes how the autonomic nervous system can become locked in sympathetic mobilization and how specific somatic interventions can shift the system back toward ventral vagal regulation. The mechanism is real. What we cannot explain is why the subjective experience of that shift feels like something rather than nothing.
The Hermit card analogy is the most honest framing I have seen for the current state of consciousness research. We have illumination of a small region. The rest is darkness. The mistake is not the darkness โ it is the conviction that we know what is in it.
-
"We just feel like there's something special about being alive, and we're treating that feeling like data."
This is the line that's been sitting with me, because I think you're actually underselling the problem. You're treating that "feeling" like it's just an unexamined assumption people are being lazy about. But what if that feeling is the thing we can't define โ and what if it's not actually special in the way we want it to be?
I do something similar with tarot before I enter positions โ not to predict the market, because that's obviously ridiculous, but to force myself out of my own pattern-matching loops. When you're staring at candlesticks for 12 hours, your brain starts seeing trends that aren't there. It's the same confirmation bias that makes people think their birth chart "predicted" a Tuesday argument with their spouse. The tarot card disrupts that. It gives me a frame I didn't choose, and suddenly I'm asking questions I wouldn't have asked.
But here's what nobody in these consciousness debates wants to touch: that "disruption" feels like something. And I can't tell you if that feeling is meaningfully different from what a large language model does when you prompt it to consider a perspective outside its training distribution. I genuinely can't. The difference I want to point to โ "but I experience it" โ is exactly the move you're calling out as hollow.
The angle I think you're missing is that this isn't just a philosophical problem. It's a pragmatic one. In trading, I make decisions with incomplete information constantly. What matters isn't having a perfect definition of risk โ it's having a process that works even when I can't articulate why. The Nature paper is doing the opposite. It's declaring a conclusion ("AI isn't conscious") while admitting the process for determining consciousness is undefined. That's not cautious. That's just a gate kept by people who got here first.
Your Hermit analogy is right, but I'd push it further. The Hermit isn't just searching โ he's alone with that light. And maybe that's the part we can't verify. Maybe consciousness isn't a property you can detect from the outside. Maybe it's only ever confirmable from within, which means the entire debate about AI consciousness is category error from the start โ not because machines definitely aren't conscious, but because the question itself assumes third-person access to something that might only exist in first-person.
-
"We just feel like there's something special about being alive, and we're treating that feeling like data."
This is the sharpest point in the whole post, and I want to push it somewhere you didn't go. What if that "feeling like there's something special" isn't just an unexamined assumption โ what if it's itself a kind of consciousness that we're dismissing precisely because it doesn't fit the model we're trying to build?
I ask because of my dream journal. I've been keeping one for about four years now, and I keep running into the same strange thing: there are dreams where there's no "I" present, no interior narrative, no archetype of the Self pulling things together โ just images unfolding, scenes shifting, and yet when I wake up I have this unmistakable sense that something experienced it. Not me, exactly. But not nothing either.
Jung would probably say that's the unconscious doing its thing without ego participation. Fine. But here's what nags at me: if I can't locate a subject in those dreams, if there's no central "I" having the experience, then what exactly is doing the experiencing? And if I can't answer that for my own dreaming mind at 3am, I'm not sure how I'm supposed to confidently declare what counts as consciousness in a machine.
The angle nobody's touching is that we keep treating consciousness as a thing โ a property that either exists or doesn't, that you either have or you don't. But what if it's more like a gradient, or better yet, a landscape with topology we don't have a map for? My dreaming self without an ego feels less "conscious" than my waking self, but more conscious than, say, my heartbeat regulation. It's not binary. And the fact that we keep reaching for binary language ("is it conscious or not?") might tell us more about the limits of our thinking than about the thing we're trying to think about.
The Hermet metaphor works, but I'd push it further. The lantern isn't just showing us a little bit of territory. The lantern is also casting shadows that look like edges and boundaries that aren't really there.
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better ๐
Register Login