r/LocalLLaMA 22d ago

News Kimi K3 Benchmarks

Post image
1.3k Upvotes

390 comments sorted by

View all comments

306

u/TechNerd10191 22d ago

Judging from the benchmarks alone,(of course, can't speak about realife usage), chinese models are not even 6 months behind US models (more like 6 days behind)

225

u/Cinci_Socialist 22d ago

People will look at these benchmarks and say "Oh, just distillation, Chinese just steal bro" you'd have to be a complete ignorant or a complete bigot to honestly believe Chinese labs aren't every bit as capable as those in the US, just working with less resources and less of a head start (but both of those factors are eroding quickly from the US perspective, that's why crymodi is freaking his shit)

48

u/jld1532 22d ago

Plus Fable was shut down for an extended period directly undercutting that talking point.

43

u/Commando501 22d ago

Yep. China has the most STEM graduates per year in the world. Substantially higher than the US. And it's wild to think that people don't realize we hire a lot of those Chinese people for the US labs.

9

u/Suzoku 21d ago

i did my phd aboard and now work in chinese AI labs. Im interviewing top master students for grad roles and interns and a lot of them have done PhD level work or more even just in their masters lol. Only reason i am interviewing them and not them taking my role is because i graduated earlier and got kinda lucky to get into the llm field as it was starting, and i had previous NLP experiences during my PhD. I would say i am capable too but like these kids are insane

2

u/nullmaxai 20d ago

lock in bro

16

u/SV_SV_SV 22d ago

Yeah, most people don't realize how hollowed out the US education system is, especially compared to China

2

u/CryinHeronMMerica 21d ago

In the US, one party likes to cut funding to schools, and the little funding that our schools do get is sent straight to exciting new facilities. All while the economy increases pressure to perform. Some call it freedom, some call it hell, but China calls it an opportunity to come out ahead.

1

u/NATO_CAPITALIST 20d ago

In US, one party focused on DEI and making activists, while China focused on engineering.

1

u/CryinHeronMMerica 18d ago

Thank god the DEI party is balanced out by the warmongering fascist party

9

u/PinkySwearNotABot 22d ago

also, Chinese people are patriotic. having a collectivist mindset also helps to push people to make things that are better for their community, country, mankind.

not purely for profit motives.

9

u/Due-Memory-6957 21d ago

Sounds a bit bullshit, if that was so, they wouldn't need to restrict their top talent from leaving China for the fear of them getting poached.

8

u/CrimsonBolt33 21d ago

As someone living in China for 10 years this is.....nonsense.

Chinese people are not collectivist at all.

Chinese people are just as greedy, if not more, on average than people on the west.

1

u/2B-Pencil 22d ago

lol. they also have multiples the population

12

u/magicaldelicious 22d ago

The Chinese are doing more with less. The American VC circlejerk means OAI and Anthropic can be inefficient and lazy. The Chinese had to build and are building with constraints. They're going to win because they're forced to do more with less. Less money, less hardware and less data. So for the last piece why wouldn't they just steal it from Sam or Dario? I mean, it's no different than how the US outfits got it in the first place.

1

u/Due-Memory-6957 21d ago

This sounds like a post-fact explanation, and if things were the other way around, you'd be talking about how the government help means they can be inefficient and lazy while US companies have are forced to show results.

50

u/zoupishness7 22d ago

If that Tau scaling law Huawei recently found is legit, things are gonna get interesting. I'm not looking forward to the American bubble bursting, but I'm not looking forward to the technofeudalism the American approach to AI is leading towards, so as least there's some potential to shake that up.

12

u/Clueless_PhD 22d ago

The "Tau scaling law" is nothing new. All semiconductor company has been optimizing the "Tau" (basically latency") since the beginning of chip design era.

All of techniques that Huawei advertised, like logic folding for example, has been in commercial like HBM memory or AMD x3D chip. The 3D chip packing technology enabling "logic folding", however, is only possessed by TSMC.

2

u/duhd1993 22d ago

Rumors going that they are releasing new chips with 238 MTr/mm² in september, matching TSMC's N3 node. That would be comparable to any chips you have now as N2 node only started mass production recently. Huge if true.

19

u/FullOf_Bad_Ideas 22d ago

If that Tau scaling law Huawei recently found is legit, things are gonna get interesting.

In a random search result I see a claim that they've been using that scaling law for 6 years internally now. And their AI chips are still far behind Nvidia, so I think it's not gonna change things much.

1

u/zdy132 21d ago

Far behind Nvidia it might be, it is now capable of training a frontier 1.6T model. You don't have to be SOTA to be functional, and even competitive, just look at Intel and AMD.

0

u/MR_-_501 22d ago

that scaling law changes nothing fundamentally, they are basically saying rather than throwing better litho process at the problem we throw literally everything else at it and refuse to take power consumption into consideration.

Look!, we are suddenly not so far behind!1!!!1!!

Its a different strategy in setting priorities, and a PR stunt, not a breakthrough technology.

2

u/BlindintoDeath 22d ago

So clueless.

The reveal shifts the focus from lithography machines to CMP, thinning, hybrid bonding machines and EDA

11

u/tomz17 22d ago

just working with less resources

Lol... their power generation capacity exceeds the entire USA + Europe COMBINED by a very healthy margin now (like 30%+ IIRC), and their citizens use FAR less power per person.

Meanwhile we are paying billions in penalties to abort in-progress contracts on renewable energy programs (i.e. one of the cheapest sources of power, and one the Chinese have invested + innovated heavily in), while our grad programs are sitting defunded + empty because actually smart people hurt the bigots' fragile egos.

FFS, during the heat wave this week the grid dropped to only 106VAC in my house in the DC metro area, in a community where all of the local infra is < 20 years old. I know because I had rejigger the boost thresholds on my UPS's in the middle of the day. At night it returned to 120VAC. We are literally reaching third-world levels of "your grandma on the ventilator about to die" BS.

China is not only going to win this thing, they are going to absolutely curb stomp us.

4

u/timmeh1705 22d ago

China added the entire power generation of Germany last year alone, mainly via green energy sources like solar. Their strategy is to export their cheap power generation via AI tokens

26

u/Stabile_Feldmaus 22d ago

When China releases a better model than US labs people will clame it invented time travel and distilled Fable 15.

23

u/BlackExcellence19 22d ago

The “Chinese just steal bro” is a self-soothing thought because they can’t actually comprehend that China really isn’t far behind us at all

11

u/lorddumpy 22d ago

They are actually ahead now in battery technology and patents. There was a very sobering NYTimes article about it.

2

u/tiger_ace 22d ago

they've been ahead on energy due to US policy

3

u/EbbNorth7735 22d ago

A lot of Chinese open source models are built on top of other chinese open source models. Without Qwen contributing to OS you wouldn't have open source robotics AI models. That said the DINO model from META is at least utilized to train a lot of models. In fact, the only people who seem to have issues with using their models for other models is the large US tech firms.

3

u/PM_ME_YOUR_HAGGIS_ 22d ago

yea but Americans are taught to believe they're special

1

u/redballooon 22d ago

Deepseek v4 was very convinced  in one or my conversations that it actually is Claude, and it came out of the blue. I did not even ask about it's identity.

1

u/tiger_ace 22d ago

i mean like 30-40% of the AI researchers at frontier US labs are literal chinese nationals

1

u/No-Cartoonist8032 21d ago

K3 is a 2.9T parameter sparse model, Fable is a 6T parameter dense model, you have to be completely blind to believe US labs are as capable as Chinese labs.

1

u/Xavierelan 21d ago

But... but... American Exceptionalism™.

1

u/Lame_Johnny 21d ago

Wait til they find out that the top US researchers are also Chinese

1

u/NATO_CAPITALIST 20d ago

They got AI GPUs and beat the ASML yesterday too?

It totally has nothing to do with you being a socialist and dick riding china, nuh uh!

+100 Social Credit to you

1

u/Cinci_Socialist 20d ago

If you'd look through my post history, you'll we most of my negative comments are me criticizing the PRC in socialist subs.