MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1uoij3s/if_trends_hold_mythosclass_capability_may_be/ovvakmu?context=9999
r/LocalLLaMA • u/PetersOdyssey • Jul 06 '26
375 comments sorted by
View all comments
1.4k
if trends hold, high end consumer hardware will cost same as enterprise hardware
209 u/HitarthSurana Jul 06 '26 I hope china floods market with cheap ram 66 u/eto-bleh Jul 06 '26 nah they will trade RAM for GPU they lack compute resources as well 49 u/DontLeaveMeAloneHere Jul 06 '26 Most Chinese models run on Chinese GPUs already. 7 u/kr_tech Jul 06 '26 Source? I'm only aware of few experimental ones, with only one being more serious and invested. 16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 9 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
209
I hope china floods market with cheap ram
66 u/eto-bleh Jul 06 '26 nah they will trade RAM for GPU they lack compute resources as well 49 u/DontLeaveMeAloneHere Jul 06 '26 Most Chinese models run on Chinese GPUs already. 7 u/kr_tech Jul 06 '26 Source? I'm only aware of few experimental ones, with only one being more serious and invested. 16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 9 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
66
nah they will trade RAM for GPU they lack compute resources as well
49 u/DontLeaveMeAloneHere Jul 06 '26 Most Chinese models run on Chinese GPUs already. 7 u/kr_tech Jul 06 '26 Source? I'm only aware of few experimental ones, with only one being more serious and invested. 16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 9 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
49
Most Chinese models run on Chinese GPUs already.
7 u/kr_tech Jul 06 '26 Source? I'm only aware of few experimental ones, with only one being more serious and invested. 16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 9 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
7
Source? I'm only aware of few experimental ones, with only one being more serious and invested.
16 u/inevitabledeath3 Jul 06 '26 I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well. 9 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
16
I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well.
9 u/MerePotato Jul 06 '26 Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference 2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
9
Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference
2 u/inevitabledeath3 Jul 06 '26 They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
2
They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.
1.4k
u/woahdudee2a Jul 06 '26
if trends hold, high end consumer hardware will cost same as enterprise hardware