A health worker measures the blood pressure of a woman at Penda Health Clinic Umoja II in Nairobi, Kenya, where researchers have tested an AI tool that can check out the notes taken by clinicians.
Patrick Meinhardt/AFP/via Getty Images
hide caption
toggle caption
Patrick Meinhardt/AFP/via Getty Images
A 4-month-old boy comes into the clinic with a fever and a stuffy nose. Vyonne Njeri thinks it’s just a cold. Then a yellow box pops up on her computer telling her to check his heart — because his heart rate is elevated. Njeri is a registered clinical officer in Nairobi, Kenya; she sees patients on her own like a nurse practitioner. When she listens with a stethoscope she hears a whoosh — a sign that the infant could have a congenital heart defect.
“That’s something I would have missed on any other day,” Njeri says of the visit a few months ago. “That child would have just gone home.” She credits an AI tool that double checks her work for helping her. Njeri referred him to a specialist who confirmed the diagnosis and started him on medications; the child may have to undergo surgery.
The tool, called AI Consult, was tested in a randomized trial of nearly 10,000 patient encounters across 16 Kenyan primary clinics operated by Penda Health, and the results were published this summer in Nature Medicine. Half the clinical officers typed their notes into a computer with OpenAI’s GPT-4o checking their electronic notes in the background.
GPT-4o is a large language model, or LLM — the kind of AI that powers chatbots like ChatGPT. They’ve been trained on much of the internet and can generate text in response to instructions.
The other half used a computer for note-taking without the AI tool.
Here’s how the AI program works. It provides three prompts — green, yellow and red, like a traffic light. The AI looks for possible problems in a patient’s care or gaps in the notes. Green means everything is OK. Yellow means “click me” — the AI found a small problem in the notes and offers some guidance. Red pops up if the AI finds a critical concern based on the notes and alerts the clinician, who may need to act promptly.
For Njeri, these interventions offered welcome feedback: “You need to check on that” or “you’re on the right track.”
An independent panel of six Kenyan family physicians graded the notes. They judged that clinicians for whom AI Consult served as what Njeri calls a “second pair of eyes” produced better diagnoses and treatment plans.
And it cost 4 cents per patient.
The study captures both the potential of AI to improve healthcare and also the challenge of proving it.
But although health workers found this AI checkup helpful, the question of patient benefit was left unanswered. The study did not find evidence of improved outcomes.
There was a 23% decrease in treatment failures such as death or unresolved symptoms, but the decrease was not statistically significant because the number of such cases was low to start with.
Treatment failures “are just too rare in primary care,” says Dr. Bilal Mateen, a co-author of the study and chief AI officer at PATH, the global health nonprofit that sponsored the trial. A trial would need about 139,000 people to detect a meaningful difference, he says.
The trial was funded by the Gates Foundation, which provides financial support to NPR for its global health team; NPR is solely responsible for all content.
Nonetheless, in the continuing exploration of the role that AI can play in medical care, particularly in lower-resource countries — there is praise for the study. Dr. Jonathan Chen, an associate professor of medicine and biomedical data science at Stanford University, who was not involved with the study, says, “this is an important study as it goes beyond just running simulated test[s] with AI systems.” The study is among the first trials to compare the role of this type of AI’s potential as an aid to primary care.
Mateen says that prompting healthcare providers with what he calls “information-as-an-intervention” will have an “important incremental effect.”
Njeri shares that sentiment: “It helps us remember protocols and new guidelines,” she says. In a country where health resources are not comparable to wealthier nations, she says her team may see five or six patients an hour with a wide range of conditions — often without specialists for backup. “Having this tool really adds value,” she says.
As for the AI recommendations, Njeri says she finds them helpful about half the time — the other half the recommendations aren’t as helpful but they are seldom wrong.
“But I still feel it’s nice to have it — to give you that second thumbs-up or thumbs-down, like having a superior who says, ‘you could do better there’ or ‘you’re doing okay,'” she says. Most of the AI’s recommendations were rated safe and appropriate by the expert panel.
Mateen says he is working toward implementing the tool globally.
The paper did not look into whether AI could increase access to care, but Chen is most excited about that possibility. As AI gets better, he says it could in fact create a draft for the healthcare worker’s notes for editing — which could enable them to save time so they could see more patients. Or the AI tool could even interact with patients themselves.
He says, “timely and consistent access to medical care” is where AI may have the biggest impact.
Mateen says he is working toward bringing this tool to healthcare systems around the globe. But there are still concerns about fledgling AI tools. Healthcare AI researcher Dr. Nicholas Okumu, an orthopedic surgeon with Kenyatta National Hospital who wasn’t involved with the study, worries new AI systems could make mistakes or give bad advice, leading to grave errors. He warns “even AI that’s approved can still cause harm, so oversight has to stay active.”
