Judgement isn’t a permanent hiding place
Taste, judgement and understanding trade-offs are often offered as protection from AI. I think that reassurance confuses today's limitations with permanent ones.
Making. Selecting. An unresolved next frontier.AI-generated conceptual setting.
The reassuring story goes like this: AI will do the execution, while people supply the taste and judgement.
I don’t think that’s a safe place to stop thinking. It may describe useful work today. It doesn’t explain why that division should last.
I expect better models, with relevant and current context, to take on much more judgement. That prediction needs evidence of its own: the absence of a permanent human advantage does not establish inevitable replacement.
What are we calling taste?
Taste can mean recognising what fits an audience, choosing an argument or rejecting something impressive that misses the point. Working alongside someone exposes the choices, corrections and exceptions behind it.
“Make this good.”
The audience, priorities and exceptions are missing.
- Audience
- Who is this for?
- Choices
- What was accepted or rejected?
- Corrections
- Why did the decision change?
- Today
- What is different now?
More information to reason from. Still capable of being wrong.
Conceptual comparison. Richer context could help; storing more messages does not establish good taste.
I think machines could learn more of those patterns. But anticipating a preference is different from helping someone choose well. A model could reproduce a choice that the person later regrets. People can also agree on consequences and disagree about what matters.
More messages do not automatically create good taste. The question is what the system can learn and use.
A trade-off isn’t a spell that stops automation
Imagine deciding whether a feature should ship on Friday. Keep the actual defect the same, and change only what the decision-maker knows.
Should this feature ship on Friday? In both briefs, the same defect breaks a promised customer workflow. Only what the decision-maker is told changes.
The thin brief
“We can ship now or spend another week fixing what the release note calls a small defect.”
- Apparent trade-off
- Speed versus polish, if that description is trusted.
- Missing
- Who uses the feature, what the defect breaks and what was promised.
The fuller brief
“The defect breaks the workflow promised to the customer relying on Friday’s release.”
- Visible trade-off
- A deadline versus a commitment that the release may not fulfil.
- Still needs checking
- Is the report current? Is there a safe workaround?
The fuller brief reveals a reason to reconsider. It does not settle whether to delay, narrow the release or use a safe workaround. Those options still need evaluating.
An illustrative comparison, not a model experiment. The claim concerns the information gap; it does not assume that closing it removes every capability gap.
The test is whether the AI can use the fuller brief, compare options and identify uncertain assumptions. Access to information doesn’t guarantee a correct inference. An information gap and a capability gap are different problems.
An experiment with 758 BCG consultants, published in 2026, shows why both possibilities matter. GPT-4 assistance improved selected creative and analytical tasks, but made correct answers less likely on a managerial problem beyond its capabilities. These were designed tasks using an older model, not an autonomous consultant.
Context changes the comparison
We often compare a person with years of context against a model handed a paragraph, then credit the whole difference to an irreducible human quality.
Research revised in June 2026 used interviews and surveys from 1,052 people. Agents with personal context predicted held-out survey responses more accurately than agents given demographics alone. That supports taking context seriously; it is not evidence of better life decisions.
Context can also be stale, contradictory or irrelevant. A 2023 comic-recommendation study found that fixed-preference assumptions failed even in that narrow setting. Yesterday’s preferences are not necessarily today’s goals.
What would make the prediction stronger?
Give people and models the same relevant information and unfamiliar decisions. Agree on success beforehand—including whose priorities count if the goal is disputed.
Count correct answers, confident mistakes, missed constraints and the full cost of checking. Gains that transfer to new situations would support handing over more work. Gains that require constant expert repair would count against it. The studies above do not establish that broad result.
The scarce thing can move again
Eero Alvar’s What Remains Valuable When Anyone Can Build Anything? expresses a premise I share: cheaper cognition moves scarcity. It doesn’t remove it.
-
01
Making gets easier.
We start looking for value in choosing what is worth making.
The proposed human refuge- MakingBecomes easier
- SelectingStill difficult ≠ permanently exclusive
- JudgingAn open question
- What comes next?An open question
As capability improves - Making
-
02
Then we point to judgement.
Taste, trade-offs and knowing what matters become the proposed refuge.
The proposed human refuge- MakingBecomes easier
- SelectingBecomes easier
- JudgingStill difficult ≠ permanently exclusive
- What comes next?An open question
As capability improves - Making
-
03
Difficulty is not a permanent boundary.
My prediction is that the boundary keeps moving. Calling a task judgement does not explain why AI could never learn it.
The proposed human refuge- MakingBecomes easier
- SelectingBecomes easier
- JudgingBecomes easier
- What comes next?Still difficult ≠ permanently exclusive
As capability improves - Making
Conceptual sequence, not a timetable or proof of universal autonomous judgement. Capability never grants authority over someone else’s life.
Good judgement could remain valuable while becoming cheaper. That would be a gain, and a challenge to people who sell it. But cheaper advice does not automatically mean fewer jobs or lower pay: demand, implementation costs and the desire for human responsibility still matter.
Capability also does not grant authority over someone else’s life. Consent and accountability remain separate questions from who reasons better.
I still want to develop taste and judgement. They help me do worthwhile work now. I don’t want to confuse developing an ability with securing a permanent monopoly on it.
“I understand the trade-offs” should begin an explanation of what you know. It shouldn’t end the conversation about what AI could learn.
Sources and further discussion
- Lee and colleagues: generative AI and critical thinking (CHI 2025). A survey of knowledge workers examines how AI changes reported thinking effort, including verification and steering. These are self-reports, not proof of cognitive decline or a permanent human advantage in judgement.
- Ethan Mollick on delegating unwanted tasks (X, September 2026). Mollick welcomes losing skills for tasks he does not want to do. That personal perspective helps separate attachment to an ability from the value of its outcome; it does not establish what AI can reliably take over.
Related Posts
A new kind of company just became possible
AI made implementation cheap before companies learned how to use it. For a brief window, a small technical team can sell the finished work. The hard part is proving the accepted result.
The check you didn’t know to ask for
Your agent can pass every test you wrote. Who notices the test you forgot? A working local example of keeping the check; discovery and human benefit are unmeasured.
The reel sold dinner. Your AI built homework.
Before you hand an idea to your agent, find the work its users won’t do. A social-media reply becomes a smaller product test.
