When the tool leaves the room

·

5 min read

When the tool leaves the room

A study of experienced doctors suggests that relying on AI can erode the very skill it was meant to support. The lesson reaches far beyond medicine.

man in gray suit jacket

Azm Index

Research

In brief

01

After routine AI use, doctors’ detection rate without AI fell from 28.4% to 22.4%.

02

Higher confidence in AI is linked to less critical thinking at work.

03

Protecting expertise means deliberately practising without the tool.

In 2025, The Lancet Gastroenterology & Hepatology published a study from four endoscopy centres in Poland. The centres had introduced an AI tool that helps doctors spot polyps during colonoscopy. Researchers then asked a simple question: how well did the same experienced doctors perform when the AI was switched off?

The finding

Before the AI arrived, the doctors’ adenoma detection rate in standard procedures was 28.4%. A few months after they began using AI routinely, their detection rate in procedures without AI had fallen to 22.4%. The study was observational, the authors call for randomised trials, and a later study in Norway did not find the same drop. But the signal is hard to ignore: a skill built over years appeared to weaken within months.

It is not only medicine

A 2025 study by Microsoft Research and Carnegie Mellon University surveyed 319 knowledge workers about how they use generative AI. Those who placed more confidence in AI reported doing less critical thinking. Those with more confidence in their own abilities reported more.

The pattern is familiar to anyone who has stopped memorising phone numbers. When a tool reliably does the work, we stop practising it. Over time the skill fades, often without anyone noticing until the tool is unavailable or wrong.

What to protect

Expertise is not just knowing the answer. It is the ability to notice when an answer is wrong, and that ability only survives if people keep using it.

Leaders can protect it in three ways: keep high-stakes judgement in the protect zone, test core skills without AI at regular intervals, and make sure every important decision has a named human owner who has genuinely reviewed it. That is why every Azm assessment includes a short real-work exercise completed without AI.

man in gray suit jacket

Written by

Azm Index

Research

Measuring how organisations balance AI and the human.

Start a conversation

Start with

a conversation.

A Balance Session is the simplest way to see where you stand.

Start a conversation

Start with

a conversation.

A Balance Session is the simplest way to see where you stand.