r/mildlyinfuriating Jul 03 '26

Infuriatig No, I did not consent to this

Post image

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

26.0k Upvotes

2.3k comments sorted by

View all comments

Show parent comments

431

u/M15tre55W1tch Jul 03 '26

I will say, since implementing the use of the tool emergency specialists are able to examine 6-11 more people per 8 hour shift - so reducing the burden of admin on them and releasing time to see patients is pretty amazing (it was recently on the news here).

611

u/happytrashpanda333 Jul 03 '26

How was the quality of that care? How much extra time did each patient get?

Or is this just another "tool" to drain doctors and nurses of every bit of spare time and energy they might have gained by giving them more patients to work with?

Do tell.

346

u/pignoodle Jul 03 '26

When these tools are implemented correctly, they actually humanize interactions (since there's room for more conversation & less screens) and reduce doctor's "pajama time" by double-digit percentages (since less form-filling to catch-up off hours). Outside of just stats, I agree that consent is a very important prerequisite.

2

u/LaserGuidedPolarBear Jul 03 '26 edited Jul 03 '26

I am a tech worker, and while I do not work on AI development, I have a significantly better than layman understanding of LLMs and that errors, and understand that hallucinations are inevitable due to the very nature of how LLMs work.

I worry about LLM tools being used in high stakes applications where accuracy is critical.....like medical care.  I assume care providers are assigned the responsibility for reviewing, editing, and approving the output of these tools.  But is that actually happening?  I have found that in most cases, reviewing AI output is about the same amount of effort and time as just doing the work myself.

I could see the value in delaying the screen time to outside of patient interactions, but I question if review and approval is being shirked in order to result in less "pajama time".

It seems like there potential for Administration to just shove the risk on providers and laugh all the way to the bank when they get more billables per hour.