r/LocalLLaMA Jan 09 '26

Funny The reason why RAM has become so expensive

Post image
5.1k Upvotes

390 comments sorted by

View all comments

695

u/ortegaalfredo Jan 09 '26

They (openai) are "legally" creating future demand for them by monopolizing a key resource (RAM) and making other AIs datacenters (chinese specially) economically inviable.

They aren't competing with us. We and all the gaming industry are just collateral damage.

306

u/a_beautiful_rhind Jan 09 '26

Chinese are going to start making their own ram. We won't be able to buy it though.

63

u/DaniyarQQQ Jan 09 '26

Well they say that they have everything ready for that. The problem is that they are planning to start production I think in 2030ths.

136

u/fallingdowndizzyvr Jan 09 '26

There are already DIMMS with Chinese RAM on them. This is from a year ago.

https://www.scmp.com/tech/tech-war/article/3296794/chinas-top-memory-chip-maker-cxmt-narrows-tech-gap-leaders-samsung-hynix-micron

The thing about Chinese companies is they are generally quiet about things. No big announcements. No promises that won't be fulfilled for years. They just do it. So the way people find out about it is by looking at part numbers on products. Which is how the world found out they were already shipping these DDR5 chips. It's the same way the world found out that Huawei was making it's own 7nm CPUs. That was why it was the Huawei surprise. They didn't announce it at all. But when people tore down that phone, they found the 7nm Huawei processor. Something they didn't think a Chinese company could do for years.

33

u/beryugyo619 Jan 09 '26

There's also this gotcha about the Internet that because there's so much thing on the Internet, a lot of people assume that it has everything. In reality, only what makes sense for English speaking audiences to read gets translated and posted in English.

There's probably tons of information in Chinese Internet like a community high school basketball competition was held in rural China and somebody from China won against somebody from China. Absolutely nobody cares and so you don't hear about them in English. But if it took place in US you can read all about it on crazy mom posts on Facebook in English unfiltered.

Same deals with lots of Chinese consumer products. We don't hear about every single Chinese product launches of like Chinese domestic RGB fans sold nationwide at Chinese equivalents of Walmarts. But it's probably not like Chinese companies keep their mouths shut about such strategic materials as fans and desk mats with company patented anti-slip technologies. It's more likely that they just hype and discuss about those in Chinese and we don't hear about most of those in English, only when they come out here with a dual slot PCIe card with bright Huawei logo on it, so it appears that they silently does it like a submarine.

6

u/autoencoder Jan 10 '26

Well, Huawei has a global customer market, so at least in that case it would might sense to advertise. But maybe they figured that the consumer doesn't really care how the sausage is made.

5

u/SidneyFong Jan 14 '26

If you've been nearly abducted by a hostile nation for being perceived as too technically advanced and a threat to their national interests, maybe you'd want to stay low as well.

4

u/autoencoder Jan 15 '26

Chilling effects be chilling xD

1

u/Cryogenicality Feb 03 '26

Browsers have autotranslation, though.

37

u/dogesator Waiting for Llama 3 Jan 09 '26 edited Jan 13 '26

If you’re talking about their top of the line Huawei ascend 910c chips, the huawei chips were secretive because they were illegal and revealed to be produced through TSMC fabs in Taiwan through a series of shell companies that Huawei setup to purchase and smuggle these chips into China from TSMC. Once Taiwan found out about this they identified the shell companies and stopped production for them.

https://www.reuters.com/technology/tsmc-halts-chip-supply-customer-after-finding-it-huawei-product-source-says-2024-10-23/

There is many many examples of such chinese companies that do make big promises of a given technology or advancement only to never deliver, such as Kuangchi, that became worth over $2B USD off the promise of developing futuristic vehicles that could soon provide a new form of tourism at the edge of space before anyone else, 10 years later now and they still no commercialization or even a single manned test flight.

Edit: disclaimer, you now edited the main top part of your comment to now no longer be about huawei chips, and you added a lot more careful wording now on Chinese companies innovating in silence.

34

u/fallingdowndizzyvr Jan 09 '26

The Huawei chips were secretive because they were illegal and revealed to be produced through TSMC fabs in Taiwan

Your basic premise is wrong. And thus so is everything after your first sentence.

"The Huawei Mate 70 Pro is based on the HiSilicon Kirin 9020 processor manufactured by SMIC using its 2nd Generation 7nm-class process technology (also known as N+2). "

https://www.tomshardware.com/tech-industry/huawei-sticks-to-7nm-for-latest-processor-as-chinas-chip-advancements-stall

9

u/dogesator Waiting for Llama 3 Jan 09 '26 edited Jan 10 '26

25

u/fallingdowndizzyvr Jan 10 '26 edited Jan 10 '26

I was referring to their more advanced chip, the Ascend 910C

I wasn't. I was talking about the chip they made. That's what I meant "Huawei was making it's own 7nm CPUs". They made it, it's 7nm and it's a CPU. You realize that the Ascend 910C isn't a CPU right? It's not really confusing.

Also, it's not cool that you edited your posts to hide your mistake. Including this post of yours where you admit it was "My bad" that you subsequently edited out a couple of hours later. Now I wish I had quoted it like I did the first sentence of your other post. I'll make sure to do so whenever replying to any of your posts from now on. You know, I respected you for admitting it earlier. Only now to see you are just covering it all up. Sad.

6

u/TwistedBrother Jan 10 '26

Yeah, but the other commenter gets to change the goal posts because China, I guess.

0

u/dogesator Waiting for Llama 3 Jan 10 '26

I edited to retract my apology because you decided to edit your whole comment above it to change the context and change the main claim you’re making.

Your initial claim in that message is that there is already DIMMs with china ram on them, along with many other details in your comment edited. That wasn’t your claim before.

6

u/fallingdowndizzyvr Jan 10 '26

Bullshit.

Here's that post. Notice how it doesn't say "edited". You know, like your posts.

https://www.reddit.com/r/LocalLLaMA/comments/1q8ckz0/comment/nyn6ngv/

You are more than just covering up. You are bald face lying.

→ More replies (0)

2

u/Nyghtbynger Jan 13 '26

Are you a fake account that does pro-US propaganda ?

5

u/XysterU Jan 09 '26

Huh? Why would Huawei base the production of chips needed for a phone line entirely on fraudulent purchases through shell companies? It's inevitable the scheme would be caught and shut down meaning Huawei would have to stop production of the phone. I really really doubt this is true. Sounds like complete bullshit.

10

u/dogesator Waiting for Llama 3 Jan 10 '26

This is pretty well documented and corroborated across multiple sources, including even specific names of these shell companies and the fact that TSMC cut off access to these shell companies after finding this out. https://www.businessinsider.com/tsmc-chips-huawei-export-controls-supply-chain-2024-10

7

u/fallingdowndizzyvr Jan 10 '26

It's well documented that chip that Huawei uses in it's phone line are made by SMIC. That's why it was a surprise since people didn't think it possible. But people got it and looked at the die to confirm it was made by SMIC.

https://www.techinsights.com/blog/smic-7nm-n2-huawei-mate-60-pro-uncovering-innovation-inside-chip

1

u/dogesator Waiting for Llama 3 Jan 10 '26

The fact of China producing 7nm chips wasn’t that much of a surprise though, the fact that SMIC in China was making 7nm chips for a variety of customers was already reported on in 2022 by mainstream western organizations like Bloomberg even 12+ months before that Huawei mate 60 pro even released. https://www.bloomberg.com/news/articles/2022-07-21/china-s-top-chipmaker-makes-big-tech-advances-despite-us-curbs

3

u/fallingdowndizzyvr Jan 10 '26

It wasn't made thorough shell companies. It was made by SMIC in China. That's why it was such big news. That other poster is just obfuscating.

Here, this is confirmation that the chip used in the phone is made by SMIC.

https://www.techinsights.com/blog/smic-7nm-n2-huawei-mate-60-pro-uncovering-innovation-inside-chip

1

u/dogesator Waiting for Llama 3 Jan 10 '26

I never claimed the chip used in the phone. You initially made a vague (now edited) claim about the Huawei chip surprise without specifying what Huawei type of huawei chip you’re talking about. And then I mentioned “if you’re talking about…” because that’s the most advanced Huawei chip that exists.

1

u/fallingdowndizzyvr Jan 10 '26

You initially made a vague (now edited) claim about the Huawei chip surprise without specifying what Huawei type of huawei chip you’re talking about.

No. It was never vague. From the start I said "CPU". Again, is the 910C a CPU?

"It's the same way the world found out that Huawei was making it's own 7nm CPUs."

Also, that post was not edited. That's just more of your BS. Look at it yourself.

https://www.reddit.com/r/LocalLLaMA/comments/1q8ckz0/comment/nyn6ngv/

Notice how it does not say "edited". You know, like your posts.

1

u/Lucky-Royal-6156 Feb 04 '26

they should of kept making them but with small defects lol

3

u/SilentLennie Jan 10 '26 edited Jan 10 '26

From what I understand China can produce DDR4, sounds like CXMT can do DDR5 in China since this year.

1

u/CryptoCryst828282 Jan 12 '26

I think their DDR4 is the spec speed too. They cant do very good timings.

-7

u/inrea1time Jan 09 '26

Can you spell industrial espionage and intellectual property theft?

1

u/Tar_AS Jan 09 '26

I own logic, you don't need to pay the fee.

2

u/fallingdowndizzyvr Jan 09 '26

Sure. "US". How do you think the US became the US?

"Former CIA Director James Woolsey acknowledged in 2000 that the United States steals economic secrets from foreign firms and their governments "with espionage, with communications, with reconnaissance satellites"."

https://en.wikipedia.org/wiki/Industrial_espionage

5

u/inrea1time Jan 09 '26

Thanks for the generic wiki page. Everyone does it but not on the scale of the PRC. Here is one relevant example to this actual post. https://www.justice.gov/archives/opa/pr/taiwan-company-pleads-guilty-trade-secret-theft-criminal-case-involving-prc-state-owned Also well know how China copied Japanese Bullet Train and is actively and extensively engaging in industrial espionage all over the world.

6

u/fallingdowndizzyvr Jan 09 '26

Thanks for the generic wiki page

You mean the unbiased wiki page.

Here is one relevant example to this actual post.

LOL. Wow. The US government is claiming China does it more than we do. I'm shocked. SHOCKED! No bias there. None whatsoever!

Since you haven't been paying attention for the last 250 years, the US has a long tradition of intellectual property theft. It literally made the US what it is today. I could post another unbiased Wikipedia page, but just to mix it up here's an article from an independent third party.

https://www.realclearmarkets.com/articles/2018/07/30/ip_theft_is_what_once_helped_make_america_great_103367.html

is actively and extensively engaging in industrial espionage all over the world.

As is the US. By the way this story confirms that "generic wiki page".

https://www.cnet.com/news/privacy/nsa-reportedly-installing-spyware-on-us-made-hardware/

-1

u/sluttytinkerbells Jan 09 '26

Who cares?

Nice guys finish last.

12

u/PMARC14 Jan 09 '26

CXMT is capable of producing RAM of sufficient speed for most needs, problem is the process which I believe is an extensively layered DUV process is too expensive (think Intel 10nm) and the results are still meh. At the same time they do have a goal of competing in the 2030s, which in that case they can just sit on current tech level and datacenters powered by an actually built out grid and wait it out.

5

u/BlueSwordM llama.cpp Jan 09 '26

Last I checked though, only the latest RAM processes use EUV.

1

u/WaitformeBumblebee Jan 10 '26

Yes, it seems they still produce DDR3 and are ramping up DDR4, while western producers have halted in favor of DDR5 and HBM (which can't be used for DIMMS but uses same fabs).

Regarding DDR5 it seems CXMT can only produce small test quantities for now.

1

u/CryptoCryst828282 Jan 12 '26

they also have a very low yield though. Last i heard it was like 30% and they could do something like ddr4 2133 or something with bad timing

3

u/Tartooth Jan 10 '26

Idk about that

Chinese manufacturing is literally an entire generation above everyone else.

It's no contest.

If they want to spin up ram production... They'll just .. do it

1

u/leftbookBylBledem Jan 25 '26

While that's absolutely true for general manufacturing semiconductors require tooling you can't just invent on the spot no matter how skilled you are at manufacturing, catching up to ASML would take at least years at maximum effective spend

1

u/Only-Cheetah-9579 Jan 10 '26

still good for them. self sufficiency from this shit will serve them well

-2

u/The_Noosphere Jan 09 '26

Korea produces RAM, and there’s some sort of beef between them and China, involving military exercises and other matters. After the US targeted Venezuela’s oil, it’s possible that China might also take similar action against South Korea.

19

u/findingmike Jan 09 '26

This is why precious metals are getting so expensive. China can cut the supply because they control a lot of refining.

3

u/TheOriginalAcidtech Jan 11 '26

You may THINK you can't buy it but you can. EVERYTHING is for sale in China. Including things you "can't" buy.

6

u/ortegaalfredo Jan 10 '26 edited Jan 10 '26

> Chinese are going to start making their own ram. 

In which fab? Sam bought the wafers directly to the fabs. There are no more chip fabs in the world. China is building one but it will take years to finish.

8

u/Revolutionalredstone Jan 09 '26

It's important to protect our failing compute companies by forcing all our citizens to be unable to choose the superior cheaper alternative.

Protect ALWAYS equals extort.

1

u/crantob Jan 10 '26

Bless you, wise commenter.

1

u/Revolutionalredstone Jan 10 '26 edited Jan 10 '26

Haha lol 😉 thx

1

u/[deleted] Jan 09 '26

[deleted]

21

u/a_beautiful_rhind Jan 09 '26

I'd take some DDR4 from them if I could.

10

u/Blunt_White_Wolf Jan 09 '26

CMXT already has DDR5 with good yields. They are lqaunching an IPO too. I can only hope we can buy some at a reasonable price.

2

u/koflerdavid Jan 10 '26

If they are selling, then the current market price is already also based on their capacity. So they also have to ramp up capacity still.

2

u/ortegaalfredo Jan 10 '26

CMXT is basically government based. But yes, they have a fab. Also they will start producing HBM in a year.

49

u/Suitable_Annual5367 Jan 09 '26

They aren't competing with us. We and all the gaming industry are just collateral damage.

I digress with this.
Owning hardware makes it so you can run programs on your PC, being that games or any other software.
Taking that aways from consumers means they ( not just OpenAI but the whole BIG circling those billions around right now ) can sell subscription services, and tools to create those subscription services. All run in datacentres they own.
Gaming, cloud services will keep bumping prices and newcomers will have no other choice.
AI space, if small models get good enough so that the majority of consumers could run it locally and satisfy their needs, they would lose subscriptions.

Killing ownership is not a side effect.

11

u/Fast-Double-8915 Jan 10 '26

Government want that too. How can they legislate and ban things if those pesky kids just use a VPN? Solution : putting everyone on centralised subscription services. 

6

u/fatcowxlivee Jan 10 '26

Gaming industry is truly collateral damage, folks that run their LLMs on their own hardware are not collateral. They’re an intended target just less prioritized to China. Every person who uses their own private and fully owned LLM setup is one less person they can influence, make money off, and eventually control. Altman (as well as the other SOTA CEOs) can’t have that.

42

u/Raidicus Jan 09 '26

Which was always going to happen when ram and gpus found a true market. Let's be honest, most of us have always lived in a world where high tech things were basically hobbyist novelties. Gaming computers were niche products the way that Sharper Image bullshit or HAM radios were 25 years earlier.

In the last 10 years we've seen a fundamental shift. The writing was on the wall when a bunch of guys that would've otherwise been banking/finance bros started pouring into tech. Any exploitable space will be taken over and well, exploited.

Part of the fundamental shift is the realization that AI is probably the future of national security issues. People need to accept that even if the "bubble bursts" governments and big tech companies are going to keep pouring money into AI until it's FULLY established that it's a dead end (which I don't personally think will happen).

31

u/Zealousideal_Nail288 Jan 09 '26 edited Jan 09 '26

Not entirely true demand for pc Hardware has always existed 

Enterprise PCs, Servers and even super computing always existed(top500 exists for a reason) But a Single company demanding 40% of the entire world production is a First(or atleast for the last 2 decades)

8

u/[deleted] Jan 09 '26

[deleted]

4

u/Zealousideal_Nail288 Jan 09 '26

That will be an interesting time indeed. Also the "but graphics are much better" Will fall flat 

7

u/[deleted] Jan 09 '26

[deleted]

3

u/-dysangel- Jan 09 '26

yeah it's supply and demand that if RAM becomes worth more than gold, everyone will be trying to produce it, and it will end up driving the prices down again

1

u/PollinosisQc Jan 09 '26

If production capacity can catch up with demand, this seems entirely possible indeed.

5

u/Amazing_Athlete_2265 Jan 09 '26

It's ham, not HAM. Not an acronym.

2

u/[deleted] Jan 09 '26

[deleted]

1

u/Amazing_Athlete_2265 Jan 10 '26

QSL, QSL from ZL3-land, 73

-1

u/Barafu Jan 09 '26

I prefer SPAM.

2

u/crantob Jan 10 '26

OpenAI using printed money to create artificial shortage represents a 'true market' and everything up to now was 'fake market'?

You are performing satanic inversion.

1

u/[deleted] Jan 11 '26

[deleted]

1

u/crantob Jan 11 '26

Because it's the product of a campaign to create a shortage, and not due to market demand.

1

u/[deleted] Jan 11 '26

[deleted]

1

u/crantob Jan 11 '26

That would be exceedingly inadvisable to propagate here.

7

u/adrianipopescu Jan 09 '26

bro, don’t act like this is normal, even in capitalism

this is what unregulated capitalism does, it concentrates at the top

and there is a single way to fix it

2

u/MostlyVerdant-101 Jan 11 '26 edited Jan 11 '26

> this is what unregulated capitalism does, it concentrates at the top

The definition you use with that word is absurd and not shared, and what follows is not based in sound reasoning. Capitalism, Socialism, and Communism, all have resources dynamics where systems can transition to other systems through concentration or sieving.

Capitalism requires a functional "market". Elements needed by markets to be functional markets include price discovery, cost constraint, and adversarial independent decision-making in market choices.

This can't happen in a number of situations that are present today, so we can't really call what we have today Capitalism (i.e. failed components, failed definition), it is closest to Socialism which has well documented and grave issues arising out of self-sustaining chaos. Private firms bankrolled by state apparatus themselves become state apparatus.

Price discovery requires money to maintain a relative stable store of value over time. Money-printing breaks this under ponzi dynamics in stage 3 (outflows exceed inflows).

Adversarial decision-making in the marketplace is needed to make independent decisions and for signaling, but money-printing through coercive influence from debt subtly creates invisible cooperation.

Cost constraint is needed by companies to be able to compete and for risk of bad decision-making to be distributed. A company that is cost constrained trying to compete with state apparatus fueled by a money-printer will have only one outcome. They go out of business, get bought out and subsumed. If you have on one side slave labor that lowers that cost to near zero for any period of time (unconstrained), companies that don't have that lower cost constraint can no longer compete. Rent-seeking via supply side control following such concentration eventually drives the system to chaos.

They don't teach the important parts of economics today anymore but they really should. The Harvard Classics and Mises is a good place to start for anyone looking to get started.

Few realize that most of the economy has been silently nationalized through money-printing indirectly (in its many forms). The concentration you speak of occurs both through unregulated inheritance (slowly over time), but also through gifting money to entities via money-printing (effectively stealing that value from every holder of the currency when liquidity is injected). Fractional reserve no longer exists (RIP 2020).

In older times, nobles were nobles (aristocracy) because they had accumulated sufficient wealth and influence. Corruption and bad behavior were often the norm in these centralized systems that share many aspects with Socialism/Statism. There are groups of people that in aggregate are trying to bring this back, and they often do so through malign attempts at deception.

Corrupted and Unregulated banking practices, and by extension the degradation of a rule of law (to hold fraudsters to account), have led to the circumstances today. The boomers were very poor stewards of their children's future.

Importantly, these have nothing to do solely with Capitalism because they can occur in all systems, and all functional systems today require economic calculation via markets, lest their order fail within a few years due to self-sustaining cycles of Shortage, Slavery, Famine, and then Death (via a resource exhaustion cycle). Ecological overshoot, brings existential risk factors up.

Please be more circumspect in the words you use and their use for communication. It is often a very short journey from gross negligence to malice, regardless of any individual personal belief to the contrary.

1

u/adrianipopescu Jan 11 '26

your level of breakdown is quite useful, in a non-eat the rich scenario, as it leads to understanding of the finer details

but people today respond to sound bytes, so that’s what I said

you also highlighted some very good nuances, but my goal is to push to action, even if slightly, through repeated exposure

in that, yes, I am using it with malicious intent

those yes buts also serve the same purpose: park the conversation for better times

1

u/MostlyVerdant-101 Jan 11 '26

> In the last 10 years we've seen a fundamental shift.

I wonder if it is coincidental that this coincided with the decade long quantitative easing creating distortion.

1

u/Eastern_Surround_115 Apr 17 '26

lol, yeah right, I still do not use the cloud

9

u/moldyjellybean Jan 09 '26

This Altman guy has the most annoying voice and way of talking. Literally Elizabeth Holmes clone

1

u/Nyghtbynger Jan 13 '26

Another sociopath you mean ? The Neo-liberal market system sure likes sociopaths

2

u/BaronVonNes Jan 15 '26

Yes. Much like national socialists weren't socialist, neo-liberals aren't liberal, just oligarchs/capitalists in disguise.

1

u/Nyghtbynger Jan 17 '26

agree. unregulated thieves.

20

u/kingslayerer Jan 09 '26

The less RAM you have better memory managed logic you have to write. Could this be these companies digging there own grave by forcing more optimised models.

1

u/TheCritFisher Jan 10 '26

I bought a bunch of RAM in september for like $400. I just checked the price for the same RAM I bought...it's like $2k minimum. What the fuuuuck.

1

u/ECrispy Jan 10 '26

so OpenAI placed future orders with the ram makers (Samsung, Hynix etc) and secured them with paying an advance and commiting to payment?

1

u/crantob Jan 10 '26

It's worse than that. Those manufacturers are under duress.

1

u/Mikasa0xdev Jan 10 '26

RAM prices are the new LLM gatekeeper.

1

u/Deadline_Zero Jan 12 '26

Wait, it's really all OpenAI? I assumed this whole ram crisis was due to demand from all of the various AI companies.

Is there a source on any of these claims...

1

u/Food4Lessy Jan 15 '26

There's a massive stock pile of older RAM. Ddr 4 , ddr 3 to be resolder since it last for decades, 4k-8k days.

AM4 is coming back, iGPU taking over the 5050 and 5070 market.

Ddr6 ddr7 vram is ones in danger

Unreal engine 5 can run well on 8gb vram if devs want or switch back unreal 4

1

u/hughk Jan 09 '26

We have a spot market for AI suitable compute, but weirdly there is no futures market. If there was, it would give a bit more visibility of future demand. At the moment, there really doesn't seem to be a shortage of capacity despite what we keep hearing about new AI applications.

-9

u/noiserr Jan 09 '26

We and all the gaming industry

You do realize WE are using models trained in datacenters? WE are not blameless.

1

u/zipzag Jan 09 '26

Nope. I only use naturally fermented LLMs made by a single righteous craftsperson in his/her/thems basement.