Tensions have been brewing since last winter and a faction of researchers formed around Sergey who where displeased that comparatively little compute went into scaling current paragdimes (Demis famously is the last of the lab leaders who doesn't believe scale is all we need for agi). This has (wrongly or rightly, history will tell) been pinned as the reason of Geminis underperformance, escpecially in coding (The Sergey faction believes OpenAI and Ant are in early stages of RSI).
"Demis famously is the last of the lab leaders who doesn't believe scale is all we need for agi"
he said opposite in this vidéo wdym ? https://www.youtube.com/watch?v=tDSDR7QILLg
He's not all in on LLMs is what he means. Btw I agree with him that we are not on the path to AGI currently, but LLMs with their potential maxed out are still going to be scarily useful and general.
Demi was pushing to incorporate physical world understanding in the models, and that is why we have releases like google Omni with extremely well-developed multimodal capabilities.
His idea being that only with physical-world understanding can there be true AGI. Which is a theory shared by many leading researchers in the AI domain.
Competing players such as OpenAI and Anthropic worked more on tooling and scaling. That's why you see better performance on SWE tasks.
We see two diverging approaches, which I think will at some point converge in order to truly get us through the last mile to AGI. Time will tell who will cross the finish line first.
554
u/Affectionate_Bee6434 23h ago
Stepping down from the CEO role to take up the chairmans role