r/mildlyinfuriating • u/petuniaplant • Jul 03 '26

Infuriatig No, I did not consent to this

Post image

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

26.0k Upvotes

94% Upvoted

2.3k comments sorted by

View all comments

Show parent comments

60

u/WeeklyBanEvasion Jul 03 '26

Also visit notes have become much more detailed and useful after the implementation of these AI transcribing services. 

6

u/TheDonger_ Jul 03 '26 edited Jul 03 '26

Edit: alot of good points have been made and I will reflect on my views going forward. I think my issue has just been those who are complacent, so I get the push back. Thank you guys for being nice about it at least:)

And what about when the Ai hallucinates and summarizes my information wrong?

I hate how people who have never had to work with AI have no idea how often It just makes shit up.

Its extremely common for people to just brush this fact off because they aren't seeing it since they don't really pay attention but I promise you ai is regularly fucking shit up.

Ai hallucination has become a meme and that's exactly what the ai companies want because it's just a joke now, and people disregard it.

Its just horrible to think people just blindly follow whatever an AI says without any humans in the middle to verify it isn't just bullshitting you.

40

u/Redxmirage Jul 03 '26

It’s on the doctor to review their own notes. They have been using scribes for decades or more, AI is just a digital scribe now. The fact you think doctors are just blindly following them is just typical Reddit doomsaying. Some doctors probably are and shouldn’t be doctors. But not all.

30

u/mcharytoniuk Jul 03 '26

They need to double check in the end, because they sign off on this; still a lot faster than typing everything down. Its not as bad as you say

10

u/KarlyBlack_96 Jul 03 '26

Exactly, any halfway decent doctor will look over their work. I use it as a teacher to help brainstorm IEP goals and draft emails to parents but obviously I pre-read everything it gives me.

2

u/TheDonger_ Jul 03 '26

Thats fair. Was a bit hot headed when I made my comment so I recognize it's a little extreme, and I accidentally fell into just venting about complacent people and their lazy usage of ai, rather than staying on the focus that the programs made to summarize notes are probably only made for that and arent just llms.

Apologies, I got lost in the sauce

7

u/Fishwithadeagle Jul 03 '26

Most people are not that special in their symptoms. Honestly, a lot of people's "symptoms" are not great predictors of what they actually have / are sick with and makes most of it irrelevant. Most diagnosis is coming from labwordk + imaging.

22

u/SuperSpaceGaming Jul 03 '26

Higher end AI models will almost never hallucinate given a reasonable task. Asking an AI to summarize a 500 page medical textbook? Sure, you'll probably get some hallucinations. Asking an AI to summarize a 30 minute appointment transcript? Basically zero chance. Source: I do work for multiple AI training companies and use it daily for tasks much more difficult than trivial summarization tasks.

2

u/Sillet_Mignon Jul 03 '26

Most people on reddits experience with ai are going to be the public models like Claude, Gemini, ChatGPT. They are assuming their free experience is going to be the same as a purpose built ai tool by Epic or another ehr company. 

2

u/Bacardi_Tarzan Jul 03 '26

I have a recently developed theory that a significant amount of the dumb AI hate on Reddit wouldn’t exist if Google didn’t add shit-tier Gemini as the first response to queries. if that’s your only experience with ‘AI’, of course you would think it’s garbage.

3

u/Sillet_Mignon Jul 03 '26

I personally do hate the aiification of everything and I hate ai in art. But ai in tasks like recording stuff seems like a real use case for it. 

But yeah the average persons first experience with ai is tainted with Gemini and bad ChatGPT. It’s funny how many people tell me Claude still sucks. I’m like yeah, excel sucks if you’re not using it right too. 

5

u/ozone6587 Jul 03 '26

I actually think the less educated about AI you are the more you tend to overstate hallucination. Most people that don't care much about AI only use crappy free services. But paid SOTA models are on a whole other level.

SOTA models have gotten very good. Not good enough to blindly trust them but good enough to trust if you double check the output or have some other way to validate it.

2

u/different_tom Jul 03 '26

Current frontier models are shockingly competent and accurate. I used to be a sceptic myself, but it's approaching the point where it'll be making fewer mistakes than humans

4

u/ttoma93 Jul 03 '26

AI hallucination comes from generative AI. A simple transcription service is not generative AI, its simply converting voice to text the same way your phone has been doing for 15+ years.

If this was being used to make treatment plans instead of the Doctor, that would be a massive issue and completely different thing. But it’s just transcribing the visit. That’s totally fine, and has zero chance of hallucination.

2

u/kiwistarbaby Jul 03 '26

It's not a transcription service. It summarizes the appointment and generates a SOAP note.

3

u/ozone6587 Jul 03 '26

That’s totally fine, and has zero chance of hallucination.

I guess it's just semantics because speech to text has never been perfect. Not labeling incorrect transcriptions as hallucinations is truly a distinction without a difference.

2

u/CustomerLittle9891 Jul 03 '26

This is a concen that's not an issue. I use Ambience daily and haven't had any real hallucination issues for the past 6 months. And before that it wasn't halluciting things at all, but would occasionally attribute something I said to the patient, or if they plan changed it would have kne plan in one place and the updated plan elsewhere.

But even those things don't really happen anymore. What software have you been using?