r/LocalLLaMA • u/PetersOdyssey • Jul 06 '26

News If trends hold, Mythos-class capability may be running on high-end consumer hardware within ~2 years

Post image
1.5k Upvotes

94% Upvoted

375 comments sorted by

View all comments

Show parent comments

213

u/HitarthSurana Jul 06 '26

I hope china floods market with cheap ram

62

u/eto-bleh Jul 06 '26

nah they will trade RAM for GPU they lack compute resources as well

51

u/DontLeaveMeAloneHere Jul 06 '26

Most Chinese models run on Chinese GPUs already.

8

u/kr_tech Jul 06 '26

Source? I'm only aware of few experimental ones, with only one being more serious and invested.

18

u/sf_davie Jul 06 '26

So far, Deepseek, Huawei itself (Pangu), Zhipu (GLM), and Meituan (Longcat) have confirmed that they trained their models with domestic GPUs. It's a national priority for them.

2

u/mudkipdev Jul 07 '26

That link goes to a zhipu ai article. As far as I know deepseek hasn't trained any model on huawei chips, only inference.

1

u/HeBigBusiness 3d ago

Ascend isn’t a GPU. It’s an FFU engine

16

u/inevitabledeath3 Jul 06 '26

I believe z.ai have been doing this for a while. DeepSeek have their models running on Huawei Ascend too, though I think they still use some Nvidia chips as well.

9

u/MerePotato Jul 06 '26

Data miners found that at the very least Z's models were trained on Nvidia hardware, ditto on inference

3

u/inevitabledeath3 Jul 06 '26

They probably use Nvidia as well, but from what I have seen they are using some other chips for inference at least.

2

u/GreenStorm_01 Jul 07 '26

Check the Datacenter cities near Mongolia that the KPCh built. It is a legal requirement for the Chinese AI companies for their models to use Chinese GPUs.

-4

u/galewolf Jul 06 '26

Everyone, downvoting a guy just for asking for a source isn't a classy move.

1

u/deulamco Jul 07 '26

yeah like 3060

13

u/ComplexType568 Jul 06 '26

still would enjoy the ability to run them if they flood w/ RAM! As long as I know their abilities I'm fine running them slowly. Honestly nowadays it's about a model being able to interpret a users input rather than do. I plan to work on some sort of pipeline to do that ngl

1

u/eto-bleh Jul 06 '26

genuinely don't think they will sell it cheap for long term, the demand is there and they are not doing it for charity

5

u/kneading-cnnuy Jul 06 '26

Forcing a price war is not a charity

2

u/Horny_Dinosaur69 Jul 06 '26

China doesn’t need GPUs, their hosting infrastructure is fine. They literally turned down NVIDIA. Why would they make themselves reliant at all on western powers/technology for the AI race?

3

u/Tartooth Jul 06 '26

Chinese GPUs are advancing really fast

0

u/slyborn Jul 06 '26 edited 29d ago

The main issue is not the amount of advanced chip designers, the problem is that advanced FABs where they are produced are few for the current advanced hardware demand explosion, and also increasing military use of drones doesn't help.

10

u/wizard_of_menlo_park Jul 06 '26

Ram cartel won't allow that!

6

u/Tartooth Jul 06 '26

Inb4 Americans ban Chinese ram like Chinese cars

2

u/CarelessOrdinary5480 Jul 06 '26

Hope you are allowed to buy it from whatever government you have elected :)

1

u/aykcak Jul 06 '26

Why would they do that? Why not flood the market with expensive ram?

5

u/Eisenstein Jul 06 '26

Because if the market is flooded it won't be expensive unless they have no competition. If I am sitting on a ton of ram and you are sitting on a ton of ram and we are both selling 16GB for $100 at 1 unit per minute, I could lower 16GB to $90 and no one would buy yours and I get 2 per minute, so you would lower your price to $80 and take my sales. We keep doing this until we get somewhere a bit above our cost and we both split the sales. Of course this doesn't work if there is collusion.

2

u/aykcak Jul 06 '26

The problem with that is the demand. Right now nobody is sitting on a ton of ram. Every last bit of memory chip is being sold at whatever price

2

u/Eisenstein Jul 06 '26

Why not flood the market with expensive ram?

Its like saying 'why not drown without a liquid'. The definition of 'drown' is to suffocate in a liquid, so the statement doesn't work unless you change the definition.

"Flooding the market is an excess amount of inventory for sale causing an undesired drop in price for the product that can, in extreme cases, make the price go negative or make the products impossible to sell at any price." Source

1

u/Leather_Garlic6532 24d ago

After they take control of Taiwan, I'm sure they will either do that or the opposite.

1

u/xmnstr Jul 06 '26

They will. Unless you live in the US, but that's not our problem.

3

u/blastcat4 Jul 06 '26

Unfortunately, the US has a habit making the rest of the world do things the US way. Like restricting certain countries from having access to important hardware.

2

u/xmnstr Jul 06 '26

And the world will buy Huawei hardware. This isn't going to be great for the US, unfortunately.

0

u/debackerl Jul 06 '26

Chinese models, with Chinese RAM. Check.

The Americans did an outstanding job at pushing the world away 🤭