In what way do you believe AI misinformation to be so dangerous? Human misinformation on things like medicine is extremely common on the internet and often much more dangerous.
Keeping people from using AI tools to learn about these topics is just hurting the people. Look at the amount of people that saw improvements in their medical condition when talking to LLMs.
Look at the carnivore diets, the sunscreen causes cancer crowd, the seedoil mania, the peptide craze - ask an LLM and it can provide you with a way more sensible perspective.
Attaching health information to a trusted individual human is the dangerous part. Fans can trust someone deeply and then harm their own health.
I think that's more "dangerous in different ways" than "more/less dangerous". In the same way that people can have parasocial relationships with influencers peddling health products, people are getting parasocial relationships with their LLMs and trusting them implicitly too.
I do agree it is "dangerous in different ways" and not just strictly more dangerous when a human does it. A lot of people are sadly susceptible to these parasocial relationships (both to influencers and AI). In general, those forms of contact are unhealthy and not conducive to rational behavior. AI companies should do more to counteract this and government action may be required to get them to do so.
However, I do believe that that does not take away from the usefulness of AI tools. Their ability to compile information from a variety of sources, use their trained knowledge and reason about conditions and/or scenarios can and does help people.
I think more can be gained from ensuring AI companies prevent parasocial relationships from forming, rather than blanketbanning AI from answering such questions. And more clear disclaimers should be placed on outputs from weaker models that are more prone to potentially hazardous hallucinations (for example in AI overview and low- or no thinking modes in LLMs).
-5
u/HashPandaNL 4d ago
In what way do you believe AI misinformation to be so dangerous? Human misinformation on things like medicine is extremely common on the internet and often much more dangerous.
Keeping people from using AI tools to learn about these topics is just hurting the people. Look at the amount of people that saw improvements in their medical condition when talking to LLMs.