AI's sycophantic design means bad thinking upstream produces confident, polished output downstream. The problem isn't just the design of the tool; it's the thinking you bring to it.
Eric opens with a quote from historian David McCullough: "Writing is just a great deal of hard thinking." The insight applies well beyond writing. Whether you're drafting a strategy, debugging code, or analyzing data, the output of AI is only as good as the thinking that precedes it. When the upstream thinking is flawed, everything downstream inherits the flaw.
John illustrates this with the story of Amazon's competitors and the assumption that undid them: people need to see, touch, or try a product before buying it. Amazon didn't dispute that instinct; they found a proxy for it through honest reviews and generous return policies. Their competitors never questioned the assumption, looked to each other for validation, and paid for it for a decade.
From there, Eric and John surface a subtler problem: AI makes this worse. Because AI is sycophantic by design, it tends to validate whatever framing you bring to it, fill in ambiguous gaps with its best guess, and carry that direction forward with confidence. John shares two real examples from his own team that week, including one where a bug report that arrived with a proposed solution led everyone, human and AI both, down the wrong path for hours. The fix was simple: go back to the problem before the proposed solution, and if you're correcting the AI too often, that's a sign to start the conversation over.
Welcome back to the Token Intelligence Show. AI is changing the way that we work, and on the show we will talk to you about the state of the art in using AI. We'll also cut through all the noise out there and hopefully give you wisdom to become a great leader and a great worker in this new era that we live in. And today, we wanna talk about AI's worst failure mode.
Ooh.
Uh, where do things go really bad when you're using AI to do work? And this is a subject that's near and dear to both of us, John. Uh, I want to,
I wanna start out with sort of going back to first principles. And there's a quote, it's probably one of my favorite quotes about writing-
Okay
... from one of my favorite authors.
Who?
Uh, and people will ask about writing, um, you know, what is it like to be a writer-