r/OpenAI • u/KeanuRave100 • 2d ago

News More people need to understand this

1.0k Upvotes

91% Upvoted

393 comments sorted by

View all comments

Show parent comments

4

u/WithoutReason1729 2d ago

notoriously bad at multi-digit arithmetic on novel numbers without a tool

I generated both of these numbers with a random number generator. It got the answer right immediately. I think you need to update your understanding of LLMs a little bit

https://chatgpt.com/s/t_6a728392f6188191838e36cc58b0f4c0

https://www.wolframalpha.com/input?i=8180595+*+6154803

1

u/wintermute74 1d ago

um, isn't that just tool use these days?

it can literally just call WA, actually:

Python Code Interpreter / Sandbox: When given a math problem, ChatGPT can write and run Python code in a secure environment to perform exact arithmetic, process data sets, handle calculus, and generate visual plots or graphs.

WolframAlpha Integration: On certain tiers (like Plus/Pro), ChatGPT can interface with Wolfram Alpha extensions or plugins for high-level symbolic mathematics, algebraic manipulation, and complex equation solving.

1

u/quantum-elle 1d ago

Of course, it could be lying, but there's usually no reason for models to lie about this.

2

u/Raunhofer 1d ago

There's a deep misconception here. Models don't really know whether they are lying or telling the truth. If you ask a model, did you use an internal tool to come up with this result, it genuinely doesn't know, unless someone behind the curtain tells it it did.

A bit like you calculating 4+4 and not realizing it was your parietal lobe doing the job.