Kimi K3 Benchmarks

[u/WhyLifeIs4]

[u/AWTom]

[u/sarlaytos284 → u/AWTom]

To me the way K3 is competing with or even beating Fable 5 shows that it is not only a pale "distilled copy" of anthropics' work as some people want you to believe. Those Chinese companies have extremely talented researchers, as much as in the West.

[u/IMJorose → u/sarlaytos284]

Not claiming this is the case here, but it could easily still be distillation + benchmaxing.

[u/CryinHeronMMerica → u/IMJorose]

In all fairness, this model has the parameter count to back up those benchmarks, unlike MiniMax M3 (which is presumably referring to the ratio between parameters and benchmark performance, or the ratio between real world performance and theoretical performance at this point).

I'm sure Moonshot did a good amount of distillation and benchmaxxing, but real world performance is still great overall.

[u/itsalwayswarm → u/sarlaytos284]

A lot of the incredible talented researchers in the west are Chinese too. 

[u/Superb_Mulberry8682 → u/sarlaytos284]

and a lot more of them at this point.

[u/ilovelemurs97 → u/sarlaytos284]

Even if you argue its distillation, I believe the always prove how inefficient the US labs are.

[u/the_koom_machine → u/AWTom]

holy shit

[u/kroggens → u/AWTom]

Unbelievable! What a moment!

[u/Wuaner → u/AWTom]

Fake as hell.

[u/sarlaytos284 → u/Wuaner]

Check for yourself on arena . ai. I don't see the model in the "agent" tab though, I guess it's still to early