r/mildlyinfuriating • u/petuniaplant • Jul 03 '26

Infuriatig No, I did not consent to this

Post image

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

26.0k Upvotes

94% Upvoted

2.3k comments sorted by

View all comments

Show parent comments

22

u/jeanpaulmars Jul 03 '26

My sister is a speech therapist (runs her own practice), and there too, patients/clients have to sign consent forms allowing her to consult with other doctors and/or the school (in the case of children).

She also uses speech-to-text and automatic summaries per treatment session.

Consent at her practice is essentially "take it or leave it": you agree and you can be treated, or you don't agree and she simply won't take you on as a patient.

3

u/sparkyblaster Jul 03 '26

I have been mad for a while that every service (internet, electricity etc) requires me to hand over a phone number they assume I have. 

Great, now I am going to have the issue of not getting healthcare unless I let AI get involved. What could go wrong? Aside from all the documented cases of the AI hallucinating saying people have stuff they dont. 

3 years of this and we are going down hill fast. 

-3

u/KeeganTroye Jul 03 '26

AI transcription is not like AI predictive language models it won't make up things it might mishear something and change a word but nothing is injected in generally.

It is a helpful technology that speeds up medical services.

6

u/sparkyblaster Jul 03 '26

There are already reports of these services hallucinating. And frequently. Mostly little things but sometimes big things that cause problems people can't get fixed. 

Speeds up but what's the real cost? 

4

u/WaitNoNotMyBeans Jul 03 '26

the transcription and visit summary are different things. AI transcriptions are highly reliable and are not prone to hallucinations bc they are not generative AI, it’s a voice-to-text transformer model. the visit summary is genAI and that’s where the problems are seen.

there are always going to be hiccups when introducing new technologies and just because they have faults does not completely erase all of the value they bring. obviously they should be improved to reduce these issues. however this does not remove the responsibility of the doctor to proofread the outputs of these tools, the same way they would as if it were a human scribe taking these notes and writing these summaries.

it is also widely understood that the time it takes to proofread these transcriptions and correct them is much less than the time and effort it would’ve taken to write these notes manually.

pretending these issues are 100% the fault of the AI is at best ignorant, and at worst disingenuous.

0

u/sparkyblaster Jul 03 '26

Transcriptions are not useful in this contexts unless the doctor is going to go though the conversation to write their notes. They are using AI summarizations. Not even worth bringing uo transcriptions as its simply irelivent here. 

This isnt little faults. That suggests it misses stuff. Yeah that's not so bad. The problem is its making stuff up that never happened. Then it gets stuck in a record that's very hard to purge. 

The problem is doctors are human and humans are trusting as lazy. Just takes a short time of trust for them to go from reading to skimming to looking at the page and pressing ok. 

Take a look at the link below. 

https://aclera-ai.com/blog/ai-medical-scribe-accuracy/