The tests were conducted in a controlled benchmark setting, meaning its usefulness in a true medical environment is up for debate. Still, Microsoft was eager to declare victory.

…

But the study could only imperfectly simulate the back and forth a doctor has with a patient by having DxO talk to a “gatekeeper agent” that “mediates all information requests drawing from the underlying case record.” Put another way, it’s an AI diagnosing a patient that’s played by an AI.

I wonder how many news outlets covered this breathless headline with the caveat that this was AI talking to AI being used to “prove” AI is better at diagnosing humans than humans…

  • CombatWombat@feddit.online
    link
    fedilink
    English
    arrow-up
    18
    ·
    19 hours ago

    Waow that is so cool that LLMs are better at diagnosing LLMs pretending to be human than humans are. That’ll be so revolutionary for the large number of LLMs pretending to be humans seeking healthcare

    But the study could only imperfectly simulate the back and forth a doctor has with a patient by having DxO talk to a “gatekeeper agent” that “mediates all information requests drawing from the underlying case record.” Put another way, it’s an AI diagnosing a patient that’s played by an AI. And while there’s no doubt that AI models are powerful analyzers and synthesizers of information, human doctors already did the leg work of putting together these neat, highly detailed case files for the AI to pore over in the first place.

  • jasoman@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    13 hours ago

    Robot beats robot in a human vs robot war where humans only know humans and robots only know robots. Tracks but media is already bought and paid for.

  • yesman@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    19 hours ago

    Isn’t it weird that a company with a groundbreaking new technology, sure to change the world, is laying people off?

    • samvines@awful.systems
      link
      fedilink
      English
      arrow-up
      1
      ·
      7 hours ago

      Of course not, they’re laying off 60k people because AI can totally do their job better than they can. I mean look at the roaring success of Copilot which is a superior product that sells like hot cakes pls ignore the shady bundling shenanigans that forced it into office packages people already purchased their CEO is a visionary who definitely doesn’t have terminal AI psychosis (hopefully unnecessary /s)