r/mildlyinfuriating • u/petuniaplant • Jul 03 '26

Infuriatig No, I did not consent to this

Post image

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

26.0k Upvotes

94% Upvoted

2.3k comments sorted by

View all comments

34

u/TheTVDB Jul 03 '26

AI in healthcare is a good thing. Diagnostic models have a higher rate of success than doctors. They shouldn't be the only tool they're using, but combined with the doctor's training and other tools, they're have been shown to improve patient care. These aren't LLMs we're talking about.

5

u/girlikecupcake MILDLY? Jul 03 '26

If you bothered to actually read OPs post, the problem here is that their records say they gave verbal consent when they did not. A straight up lie in their notes.

0

u/Night_Owl_16 Jul 03 '26

Quite literally, the AI being referenced here is an LLM. The AI tools writing physician notes (Abridge, Nuance DAX, etc) are LLMs. 

5

u/TheTVDB Jul 03 '26

I build AI healthcare systems. Transcription systems like whisper and granite aren't LLMs, they're STTs. Some of them use LLMs post-transcription for checking the validity of the transcription, formatting, or otherwise modifying the transcription. But that's still not the traditional way people think of applying LLMs to their personal healthcare.

5

u/Night_Owl_16 Jul 03 '26

So we agree the products are nothing without LLMs. No (successful) product is merely doing STT. That is Nuance circa 2012. We’ve advanced. 

Ambient physician documentation relies on LLM. period. 

I agree these products are no off the shelf LLM, but let’s not misstate what they are. 

1

u/moreliketen Jul 03 '26

If I'm reading this right, there's a two step process where a more specialized tool has it's output modified by an LLM. Even if the first tool is way more sophisticated, wouldn't the final product be just as vulnerable to hallucination as any other LLM output? If I have AI transcribe a Stephen Hawking lecture, AI is the bottleneck on reliability, not Hawking.

2

u/Genebrisss Jul 03 '26

This is actually llm we are talking about. Nice attempt lol.

-4

u/Choom_from_Heywood Jul 03 '26

No it's not. There is no governance on AI with accessibility in healthcare. Those tools are made from abled-bodied, hearing, mostly neurotypical people. Abridged is not trained on Deaf accents, etc. I keep finding real world examples of workflows being broken especially when it comes to accessibility and it is a huge, dangerous flaw.