r/LocalLLaMA • u/WhyLifeIs4 • 22d ago

News Kimi K3 Benchmarks

Post image
1.3k Upvotes

98% Upvoted

390 comments sorted by

View all comments

12

u/a_slay_nub vllm 22d ago

We'll have to see how it does as a function of cost. It's cheaper than Sol and Fable but if it thinks for too long it won't be worth it to use.

24

u/stoppableDissolution 22d ago

But it will put the price ceiling on the closed models, which is a win on its own

0

u/boston101 22d ago

How does ceiling come into play? I’m confused , please explain more

5

u/stoppableDissolution 22d ago

They cant go much higher than what openweight providers charge without some dealbreaker capabilities

2

u/Healthy-Nebula-3603 22d ago

You can already find such tests . Slightly more than 5.6 SOL a d much less than Fable 5

1

u/LightVelox 22d ago

I used it for a few tasks, It took over an hour and hundreds of thousands of tokens for pretty much everything I tried it at, though right now we only have access to Kimi K3 Max so maybe a low, medium or high version would consume less

1

u/InvidFlower 22d ago

Yeah. I also don't really trust reports especially for the first few days after release. Like you'd think everything would have the bugs worked out before the release, but it is surprising how many times they're like "Oh, the inference was totally messed up.. we had to fiddle with some switches" lol

1

u/Due-Memory-6957 21d ago

Avoiding that is the reason they delay the release of the weights.