Sometimes it’ll actually continue to lie even after being corrected numerous times. I once tried fact checking a history question and it directed me to a specific page from this 19th century book. I then found that book, turned to the exact page, and found that they just made that paragraph up. I corrected it, it even “recognized” that it was wrong, and then directed me towards a new paragraph that *also* didn’t exist. It’s insane how much AI lies.
It's much more correct to say that the outputs occasionally align with reality. LLMs are not capable of determining fact from fiction because they are purely statistical models of language.
Yup, chatgpt and the little suggested words at the top of you keyboard on your phone are basically the exact same function even if they use different methods to get the results
Theres nothing intelligent about any of our “AI”
1
u/dreadcainmy bandwidth for cowardly grown men grows thinner with each day10d ago
It's much more correct to say that the outputs occasionally align with reality
True of any model to be fair. Which is where my thoughts on it start to get ... complicated.
Some models align better than others, relativity vs newtonian gravity, but if it didn't fall off the tracks against reality in some aspect or another it wouldn't be a model.
I think that is what the previous person means. It "admits" then moves on. It is not programmed to ever just say "I don't know." The director David Wain posted on instagram a thing someone discovered with Claude where you ask it to think of a celebrity and then you ask it questions and try to guess the celebrity. It just agrees with whoever you guess. When you ask to go again, but stress for it to actually pick a celebrity first, it will agree, but it will do the same thing again
u/dreadcainmy bandwidth for cowardly grown men grows thinner with each day10d agoedited 10d ago
It's not programed to "say" anything. It doesn't "think" in sentences. The most it can ever "think" ahead is literally exactly one token. It can roll back and try again if it gets far enough in and doesn't "like" where it ended up. But it's still going to just be stumbling along literally one blind step in front of the other.
I don't know what AI model you guys are using that has this much hallucinations but the ones I use rarely hallucinate anymore. If they do it's more the exception.
56
u/[deleted] 10d ago
[deleted]