Don’t miss anything! Sign up for my newsletter & join our Facebook community of 1,000+ like minded thinkers!

In 1950, Alan Turing proposed a deceptively simple test for machine intelligence: if a human judge, conversing blind with both a machine and a person, cannot reliably tell which is which, the machine should be considered to be thinking. It was a brilliant sidestep of a much harder problem — and it was also, from the beginning, the wrong question, one so cleverly framed that we've spent seventy-five years answering it while the real question sat unasked in the corner of the room.
The Turing Test asks whether a machine can fool you. It cannot, by design, ask whether anyone is home inside the machine. Those are different inquiries wearing the same coat. You could build a system that fools every judge in the room forever and learn, at the end of it, nothing about whether there's a subject inside having an experience, versus an extremely sophisticated process producing the outward behavior of one. Fooling a judge is a fact about the judge's discriminatory power. It's not a fact about the machine's inner life.
The philosopher John Searle made this precise with a thought experiment that has become one of the most argued-over in the field: imagine a man sitting in a locked room who doesn't speak a word of Chinese. He's handed a rulebook, entirely in English, that tells him exactly which Chinese symbols to output in response to which symbols slid under the door. He follows the rules perfectly. Outside, Chinese speakers are convinced they're conversing with a fluent native speaker. Inside, there is a man who understands absolutely nothing, correctly manipulating symbols whose meaning is entirely opaque to him. Searle's point, made in 1980 and never successfully rebutted to most philosophers' satisfaction, was that the room passes any behavioral test you like while the man inside comprehends not one word — and scaling the room up, adding more rules and faster shuffling, never closes that gap, because understanding was never a matter of scale to begin with.
The philosopher Ned Block sharpened the same worry from another direction with a thought experiment sometimes called "Blockhead": a machine that behaves indistinguishably from an intelligent conversational partner not by understanding anything, but by consulting an enormous, pre-written lookup table of canned responses. Such a machine, however absurd to actually build, would pass the Turing Test perfectly while containing nothing anyone would seriously call a mind. Block's argument, like Searle's, targets the same structural blind spot: any test built entirely around external behavior is, by design, blind to whatever is or isn't happening on the inside.
This is why the actual question worth asking was never "can it fool us," but "is there anyone in there to be fooled about." That's a question about consciousness, about subjective experience — the raw fact that there is something it is like to taste coffee, grieve a loss, or watch your own child sleep. No behavioral test, however sophisticated, can settle that question, because behavior is exactly what you'd expect to see whether or not anyone is experiencing anything at all.
A system with no body, no stake in its own survival, no capacity to suffer the consequences of being wrong, is missing more than a few features. It's missing the entire arena in which anything resembling a self gets forged through consequence and responsibility. A person is not an accumulation of correct answers. A person is a subject capable of being addressed — capable of being loved, blamed, forgiven, and held responsible, because there is a genuine someone there to receive any of that. You cannot forgive a calculator for a wrong sum. You forgive your son for a broken promise, because your son is a someone, and a someone is precisely what the Turing Test was never designed to detect.
So the next time you're impressed by how convincingly a machine talks — and you will be, because these systems are genuinely remarkable — remember what convincing talk was never able to prove in the first place. Fooling a judge tells you about the judge. It tells you nothing about the room. The question that actually matters is not whether the room can talk like a person. It's whether anyone is in there listening. So far, as best as anyone can tell, the answer remains no.
Is your organization wrestling with what AI means for human judgment and leadership? Book Dr. Sweis to speak, or schedule a private consultation.