Martinfowler iconMartinfowlerSep 8, 2026 ~1 min source read

Fragments: September 8

Too much of what makes work effective is subject to either slow feedback loops or assessments that require subtle judgment. Christian Catalini says we're in a situation where we are vastly reducing the cost of generating things, but not the cost of verifying them:.

Fragments: September 8

Share this story

Send the public story page.

Useful takeaways from this story.

Christian Catalini says we're in a situation where we are vastly reducing the cost of generating things, but not the cost of verifying them:.

This explains why the first major AI products appeared in chat, image generation, and code assistance.

Not because these were the hardest human problems, but because their outputs were relatively easy to inspect.

Building the complete brief

The page is ready to read now. The fuller skim-friendly version will appear here automatically.

The useful part

Christian Catalini says we're in a situation where we are vastly reducing the cost of generating things, but not the cost of verifying them:. This explains why the first major AI products appeared in chat, image generation, and code assistance. Not because these were the hardest human problems, but because their outputs were relatively easy to inspect.

How it works

  • A user can judge the tone of a message, look at an image, or run a test on a piece of code.
  • In our profession, we know there's a big difference between how many lines of code we write and how productive we are, and we've seen a regular failure to understand how to measure productivity.
  • Too much of what makes work effective is subject to either slow feedback loops or assessments that require subtle judgment.
  • […] The old automation boundary was routine versus non-routine work.
  • The new boundary is increasingly measurable versus non-measurable work.

What to take from it

The danger is that people use lots AI automation while using incomplete measurements of its effectiveness, leading to short-term dashboards going up, but disaster in longer time-scales. Another highlight in the article was his advice to "build a history of decisions, not a gallery of outputs". The point is that with AI we can all build really impressive things, but our value lies in the judgment that we've formed.

Details worth keeping

The issue is then over how well you can measure something. He refers to these illusory short-term gains as counterfeit utility. Scale this across companies and institutions and the result is a Hollow Economy: extraordinary measured activity sitting on top of weakening human capability, hidden technical debt, correlated errors, and outcomes that nobody can confidently stand behind.

Keep reading in the app

Open the app view to save this story, compare related coverage, and continue from the same source.

Open in app