Microsoft Says Its New AI Is Better at Diagnosing Patients Than Real Doctors
futurism.com
Microsoft's MAI-DxO medical AI is more than twice at accurate at diagnosing patients than human doctors, according to its own study.

The tests were conducted in a controlled benchmark setting, meaning its usefulness in a true medical environment is up for debate. Still, Microsoft was eager to declare victory.

…

But the study could only imperfectly simulate the back and forth a doctor has with a patient by having DxO talk to a “gatekeeper agent” that “mediates all information requests drawing from the underlying case record.” Put another way, it’s an AI diagnosing a patient that’s played by an AI.

I wonder how many news outlets covered this breathless headline with the caveat that this was AI talking to AI being used to “prove” AI is better at diagnosing humans than humans…

  • CombatWombat@feddit.onlineEnglish
    20·
    2 days ago

    Waow that is so cool that LLMs are better at diagnosing LLMs pretending to be human than humans are. That’ll be so revolutionary for the large number of LLMs pretending to be humans seeking healthcare

    But the study could only imperfectly simulate the back and forth a doctor has with a patient by having DxO talk to a “gatekeeper agent” that “mediates all information requests drawing from the underlying case record.” Put another way, it’s an AI diagnosing a patient that’s played by an AI. And while there’s no doubt that AI models are powerful analyzers and synthesizers of information, human doctors already did the leg work of putting together these neat, highly detailed case files for the AI to pore over in the first place.