Advertisement
Medicine
WorldEurope

Artificial-intelligence cyberdoctor does better than human GPs on tests. But would you trust it with your health?

Babylon says its chatbot scores higher marks than real medics, but British doctors say nothing can replace humans as primary health carers

Reading Time:2 minutes
Why you can trust SCMP
An image from AI company Babylon promoting its health app and services. Graphic: Babylon
Agence France-Presse

A medical chatbot said to perform as well as or even better than human doctors has sparked a war of words in Britain, in a clash over how much the cash-strapped public health service should rely on artificial intelligence.

AI company Babylon, which is already working with the National Health Service (NHS) claimed its chatbot scored higher marks than real live doctors in “robust tests”.

The British firm said it quizzed the AI using sample questions for trainee exams set by Britain’s Royal College of General Practitioners (RCGP), the professional body for family doctors.

Advertisement
The programmed chatbot, a key feature of Babylon’s “GP at Hand” app, scored 81 per cent when sitting the test for the first time, while the average pass mark over the past five years for doctors was 72 per cent, according to the company.
Is the world ready for AI doctors? AI firm Babylon says its chatbot performs better than human GPs, on average, on trainee exams set by Britain’s Royal College of General Practitioners. Image is a file graphic rendering. Graphic: Alamy
Is the world ready for AI doctors? AI firm Babylon says its chatbot performs better than human GPs, on average, on trainee exams set by Britain’s Royal College of General Practitioners. Image is a file graphic rendering. Graphic: Alamy

Its founder Ali Parsa, who presented the findings in London earlier this week, hailed the results as “a landmark”.

No app or algorithm will be able to do what a GP does
Martin Marshall, Royal College of General Practitioners

“(They) take humanity a significant step closer to achieving a world where no one is denied safe and accurate health advice,” he said in a statement.

Advertisement
Select Voice
Choose your listening speed
Get through articles 2x faster
1.25x
250 WPM
Slow
Average
Fast
1.25x