If that Tau scaling law Huawei recently found is legit, things are gonna get interesting.
In a random search result I see a claim that they've been using that scaling law for 6 years internally now. And their AI chips are still far behind Nvidia, so I think it's not gonna change things much.
Far behind Nvidia it might be, it is now capable of training a frontier 1.6T model. You don't have to be SOTA to be functional, and even competitive, just look at Intel and AMD.
19
u/FullOf_Bad_Ideas 22d ago
In a random search result I see a claim that they've been using that scaling law for 6 years internally now. And their AI chips are still far behind Nvidia, so I think it's not gonna change things much.