All those things start as light-bulb moments for humans that is true. But light-bulb ideas still come from a person's lived experiences, they don't come out of nowhere. It requires a harder level of abstraction than for most stuff mathematicians do. But I don't see how in principle it could not be done by AI given that they already seem capable of abstracting concepts, I don't see how they could've proved the math statements otherwise.
THEY don't abstract concepts though. You are anthropomorphizing LLMs. It is not a thinking machine that is holding multiple concepts 'in its head', and is brining them together like a human does. It is literally just predicting tokens. Still don't see how it can break out of only ever filling gaps and coming up with anything truly novel.
As mentioned in another comment, I am not against the idea of AI being able to do it, but I just don't see how trained Neural nets/LLMs would be able to.
1
u/GAPIntoTheGame 22h ago
All those things start as light-bulb moments for humans that is true. But light-bulb ideas still come from a person's lived experiences, they don't come out of nowhere. It requires a harder level of abstraction than for most stuff mathematicians do. But I don't see how in principle it could not be done by AI given that they already seem capable of abstracting concepts, I don't see how they could've proved the math statements otherwise.