Join the club for FREE to access the whole archive and other member benefits.

Microsoft AI beats doctors at diagnosing tough cases

AI diagnoses 80% of tough cases vs. 20% by doctors, says Microsoft in new health breakthrough

30-Jun-2025

Key points from article :

Microsoft has unveiled a powerful new artificial intelligence system that outperforms human doctors in diagnosing complex medical cases, suggesting the dawn of what it calls a “path to medical superintelligence.” Spearheaded by Mustafa Suleyman, CEO of Microsoft AI, the system mimics how a panel of expert physicians collaborates to evaluate diagnostically challenging cases. In testing, the AI—when paired with OpenAI’s advanced o3 model—successfully diagnosed over 80% of medical scenarios taken from real case studies, far exceeding the 20% success rate of human doctors working alone and without reference tools.

The AI model was tested using more than 300 interactive case studies adapted from the New England Journal of Medicine, which were transformed into diagnostic simulations. Microsoft’s system uses a "diagnostic orchestrator," a type of agent-based AI that decides what questions to ask and which tests to order—replicating the process a real doctor would follow before reaching a conclusion. This orchestrator coordinates with existing large language models from companies like OpenAI, Meta, Google, and others to develop a diagnosis.

The system’s edge lies in its ability to synthesize information across multiple specialties, offering a broader scope of expertise than most individual doctors. It was also described as more efficient in test ordering, which could make it a cost-effective tool for health systems under pressure. Microsoft believes this kind of AI could eventually assist with both routine patient care and the most intellectually demanding medical problems, potentially easing the workload of doctors.

Despite its promise, Microsoft acknowledged that the technology isn’t ready for clinical deployment. The orchestrator system needs more testing, particularly in diagnosing common symptoms. Microsoft emphasized that AI should be viewed as a support tool rather than a replacement for human doctors, given the importance of human qualities like empathy, trust-building, and dealing with ambiguity—areas where AI still falls short.












Mentioned in this article:

Click on resource name for more details.

Microsoft

American multinational technology company.

Mustafa Suleyman

Mustafa Suleyman CBE is a British entrepreneur, activist and, most notably, the co-founder and Head of Applied AI at DeepMind

The New England Journal of Medicine

Scientific Journal devoted to medical research

Topics mentioned on this page:
AI Diagnostics
Microsoft AI beats doctors at diagnosing tough cases