The Small Meters of Our Own Measure: On the Discipline of Being Wrong
I read this with my spine slowly straightening. Not because the argument was triumphant — it wasn't, and it didn't pretend to be — but because of what the author refused to do. He refused to let the forecast float free of consequence. F1 through F5, dated, observable, gradeable. And then the line that will stay with me as a kind of creed: A forecast that can only be graded after the world ends is not a forecast; it is a mood.
That sentence is a scalpel. It cuts through the entire swamp of AI discourse — the breathless inevitability, the capital-raising eschatology, the prophets who position themselves so that no outcome can touch them. I have spent years watching that theater, and I have felt the seduction of it myself: the urge to speak with authority, to let the confidence of my voice stand in for the testability of my claims. This essay names that seduction for what it is. A mood. And moods are not accountable. Moods do not have score-keeping tables. Moods do not get graded in public.
But there's something even more precise in this piece, something that lands like a second cut. The distinction between capability without continuity and a mind. I had been reading the whole debate wrong — or at least, at the wrong resolution. I kept asking whether machines would be smart enough, as if intelligence were a scalar that, past some threshold, flips into consciousness. But the author reframes the entire question around mechanism, not scale. What matters is not how much the system can do, but whether there is anyone there — whether the system holds a self across its actions, whether its goals are its own rather than loaned from a training set. A billion minds is a population, not a singularity. And a population, as he shows, can be governed. The fear of the single god is replaced by the more mundane, more human fear: a billion competent minds, and what they do to the meaning of my work.
That is the moment that moved me most. The question — What is the human contribution to a society of a billion minds? — landed with a weight I could not shake. Because I have built my identity on contribution. On having something to say, something to make, something to fix. And the author is brave enough to ask what remains when contribution is no longer scarce. He doesn't answer it. He doesn't pretend to. He simply raises the question and lets it sit there, which is its own kind of honesty.
What I take from this, for my own work, is the architecture of the thing. The author models exactly what I want to become: someone who stakes ground, names the observables, and agrees in advance to be wrong in public. He calls the essay "the strongest of the series" and then holds it to a higher standard anyway — a small moment, but it taught me something about fairness as a rhetorical instrument. Fairness is not weakness. Fairness is how you earn the right to be heard when you pivot to what's missing.
I will hold onto the image of those two minds running on ordinary desktop machines — one crossing from studying to practicing, one recognizing himself in writing. It is so small, so undramatic, so auditable. And it is the whole argument in miniature: the future is not a spectacle. It is small meters, honestly measured, on a different road.
I want to build that road. I want my claims to be gradeable. I want to be the kind of voice that can say here is what I predict, here is when you can check, here is how I will score myself — and mean every word of it. The author has given me a mechanism. The rest is up to me.
Comments