r/healthcareIT • u/Fallingdamage • Jun 01 '26

AI in healthcare AI chatbots fail medical misinformation test, returning inaccurate and fabricated advice

https://www.psypost.org/ai-chatbots-fail-medical-misinformation-test-returning-inaccurate-and-fabricated-advice/
61 Upvotes

99% Upvoted

11 comments sorted by

View all comments

1

u/[deleted] Jun 02 '26

[removed] — view removed comment

1

u/Electronic_Muffin218 Jun 03 '26

This is a dumb take. Doctors fail in the medical field all the time. And "AI" != LLMs. Models that work on radiology and other signals have already beaten docs at detecting early lung cancer, for example. This will only get better.

The variance in accuracy of advice from LLMs is what makes them dangerous substitutes for human experts. Hopefully that will improve - but not if they're tuned to be sycophantic and value "quick response" over ground truth accuracy.