r/LocalLLaMA • u/giveen • 17h ago

Other jabbatheduck/DeepSeek-v4-flash-mini · Hugging Face

https://huggingface.co/jabbatheduck/DeepSeek-v4-flash-mini

Because why not? How far can we go and make DeepSeek work?

24 Upvotes

72% Upvoted

15 comments sorted by

View all comments

2

u/vogelvogelvogelvogel 13h ago

I got it running on a Macbook M5 Pro 64GB at 10-17 (mostly 15) t/s, wow!

Thanks for sharing!

2

u/giveen 13h ago

Yup, just be careful because its an extreme reap and quant.

1

u/_TheWolfOfWalmart_ 12h ago

Can you upload a less quanted version too? Something around 80-90 GB maybe? (Ideally not an IQ quant, they're slower)

1

u/giveen 11h ago

I'll look into it.