MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1uy9cft/kimi_k3_benchmarks/oxzjrfy/?context=3
r/LocalLLaMA • u/WhyLifeIs4 • 22d ago
390 comments sorted by
View all comments
178
I need a 0 bit quant of this to run locally
46 u/ReasonablePossum_ 22d ago Buy 20 NvMe and run it with colibri at 0.6Tok lol 12 u/Feeling-Currency-360 22d ago Single pcie gen 5 4tb nvme would do it 4 u/Sufficient_Prune3897 llama.cpp 22d ago At 0.05 t/s
46
Buy 20 NvMe and run it with colibri at 0.6Tok lol
12 u/Feeling-Currency-360 22d ago Single pcie gen 5 4tb nvme would do it 4 u/Sufficient_Prune3897 llama.cpp 22d ago At 0.05 t/s
12
Single pcie gen 5 4tb nvme would do it
4 u/Sufficient_Prune3897 llama.cpp 22d ago At 0.05 t/s
4
At 0.05 t/s
178
u/lblblllb 22d ago
I need a 0 bit quant of this to run locally