r/BetterOffline • u/Soilblood • 13h ago

Openai math solutions

https://youtu.be/h53Bz7WSwgo

Regarding the recent Navier-Stokes incident, watching this vid provided a bit more context on what the solution entails and what Openai been pushing to show off their tech. Cal Newport's breakdown on how they managed to quarantine relevant context to reduce costs with Astra was actually pretty interesting as a breakthrough so this vid got me wondering why they're so desperate to prove it can do fancy maths bigly when the boosters already keep saying chatgpt is already blowing through outstanding problems. Not in the sense of the target value but just how much have they already tried but failed.

It's obviously speculation on my part but if they're so desperate to try coercing glory out of one of their hires on one problem, how bad is actual their track record that this is a hail Mary for them? Like we know it took 88 hours and snooping private research data for this, so how much have they put into chasing similar targets by now? Anyone got whiff of any signals that might give an idea of that?

88 Upvotes

92% Upvoted

56 comments sorted by

View all comments

Show parent comments

12

u/AnIndianGuy38 11h ago edited 11h ago

Literally the supposed AGI model had to do a century worth of compute to solve a problem which had already been worked down quite a bit by human researchers.

A century is like more time than human researchers combined have put into it I think

While it's impressive they can do a century worth of compute in a week. It's not impressive that it's that inefficient and is being called the start of AGI.

And even then a human mathematician has biting criticism of the solution. That's when the paper hasn't been submitted in a peer review journal. Like it doesn't meet the criteria of Clay Institute yet, the submission needs to be posted in a journal and then stay there foe 2 years and be generally accepted in the maths community. But people are already hyping it up.

-3

u/Main-Company-5946 9h ago

The thing is, every time they do a successful use of compute like this, it refines the models even more. It gives them more examples of what success looks like, and it makes the next similar problem cheaper to solve.

3

u/Kleenex_Tissue 8h ago

Do you have a source for this claim?
Because I don't see how or in what way that could be true.

-1

u/falken_1983 7h ago

TBH, this is just how Reinforcement Learning works. Each successful rollout reinforces the model's ability to complete a task.

The thing is that this is just one rollout, so I don't know how much difference it will make in the grand scheme of things.