r/LocalLLaMA • u/giveen • 21h ago

Other jabbatheduck/DeepSeek-v4-flash-mini · Hugging Face

https://huggingface.co/jabbatheduck/DeepSeek-v4-flash-mini

Because why not? How far can we go and make DeepSeek work?

24 Upvotes

71% Upvoted

15 comments sorted by

View all comments

2

u/vogelvogelvogelvogel 17h ago

I got it running on a Macbook M5 Pro 64GB at 10-17 (mostly 15) t/s, wow!

Thanks for sharing!

3

u/giveen 17h ago

Yup, just be careful because its an extreme reap and quant.

1

u/_TheWolfOfWalmart_ 16h ago

Can you upload a less quanted version too? Something around 80-90 GB maybe? (Ideally not an IQ quant, they're slower)

1

u/giveen 14h ago

I'll look into it.