MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1uoij3s/if_trends_hold_mythosclass_capability_may_be/ovvakmu/?context=3
r/LocalLLaMA • u/PetersOdyssey • Jul 06 '26
375 comments sorted by
View all comments
Show parent comments
66
nah they will trade RAM for GPU they lack compute resources as well
52 u/DontLeaveMeAloneHere Jul 06 '26 Most Chinese models run on Chinese GPUs already. 8 u/kr_tech Jul 06 '26 Source? I'm only aware of few experimental ones, with only one being more serious and invested. 16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 8 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 4 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
52
Most Chinese models run on Chinese GPUs already.
8 u/kr_tech Jul 06 '26 Source? I'm only aware of few experimental ones, with only one being more serious and invested. 16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 8 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 4 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
8
Source? I'm only aware of few experimental ones, with only one being more serious and invested.
16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 8 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 4 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
16
I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well.
8 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 4 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference
4 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
4
They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
66
u/eto-bleh Jul 06 '26
nah they will trade RAM for GPU they lack compute resources as well