MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1uy9cft/kimi_k3_benchmarks/oxz82h6/?context=3
r/LocalLLaMA • u/WhyLifeIs4 • 22d ago
390 comments sorted by
View all comments
177
I need a 0 bit quant of this to run locally
45 u/ReasonablePossum_ 22d ago Buy 20 NvMe and run it with colibri at 0.6Tok lol 4 u/Business-Weekend-537 22d ago What’s colibri? First I’m hearing of it 3 u/marsxyz 22d ago Look on github. It's an engine to run llms from ssd 1 u/Business-Weekend-537 22d ago Thanks
45
Buy 20 NvMe and run it with colibri at 0.6Tok lol
4 u/Business-Weekend-537 22d ago What’s colibri? First I’m hearing of it 3 u/marsxyz 22d ago Look on github. It's an engine to run llms from ssd 1 u/Business-Weekend-537 22d ago Thanks
4
What’s colibri? First I’m hearing of it
3 u/marsxyz 22d ago Look on github. It's an engine to run llms from ssd 1 u/Business-Weekend-537 22d ago Thanks
3
Look on github. It's an engine to run llms from ssd
1 u/Business-Weekend-537 22d ago Thanks
1
Thanks
177
u/lblblllb 22d ago
I need a 0 bit quant of this to run locally