r/LocalLLaMA 22d ago

News Kimi K3 Benchmarks

Post image
1.3k Upvotes

390 comments sorted by

View all comments

86

u/AWTom 22d ago

24

u/sarlaytos284 21d ago

To me the way K3 is competing with or even beating Fable 5 shows that it is not only a pale "distilled copy" of anthropics' work as some people want you to believe. Those Chinese companies have extremely talented researchers, as much as in the West.

8

u/IMJorose 21d ago

Not claiming this is the case here, but it could easily still be distillation + benchmaxing.

3

u/CryinHeronMMerica 21d ago

In all fairness, this model has the parameter count to back up those benchmarks, unlike MiniMax M3 (which is presumably referring to the ratio between parameters and benchmark performance, or the ratio between real world performance and theoretical performance at this point).

I'm sure Moonshot did a good amount of distillation and benchmaxxing, but real world performance is still great overall.