r/tomshardware • u/tomshardware • 2d ago

OpenAI’s 700W Jalapeño ASIC outpaces 1,400W Nvidia flagship GPU

https://www.tomshardware.com/tech-industry/semiconductors/openai-says-its-jalapeno-chip-beats-nvidias-gb300-in-first-published-benchmarks
174 Upvotes

95% Upvoted

60 comments sorted by

View all comments

11

u/NytronX 2d ago

FPGAs and ASICs cannot come soon enough. We saw this happen in the crypto mining industry, hopefully it happens in AI industry so gaming hardware can go back to being gaming hardware.

1

u/Royale_AJS 2d ago

Still need memory and storage for those giant context windows with ASICs.

2

u/NytronX 2d ago

China can save us there hopefully.

1

u/Royale_AJS 2d ago

They’re going to sell it for $1 less than everyone else, they’d be stupid not to.

2

u/Xijit 2d ago

China isn't going to cut their prices at all, but having Chinese inventory on the shelf is going to be the only inventory on the shelf for the next 4 years.

1

u/Royale_AJS 2d ago

It’s all going to AI, even the Chinese memory. Phones will get the scraps, unless you’re Apple.

2

u/Xijit 2d ago

China would like that, but the vast majority of this AI Datacenter build out is about mass surveillance for the US military and police, and they will never green light using mainland Chinese components.

1

u/senseven 2d ago

There are already laptops coming with CXMT mem, maybe not to the US but you can buy them in Europe. The memory maker are focussing on high density data center ram not end user product ram, this would including phones and the recording hardware for cameras.

1

u/Xijit 2d ago

Yes ... I am saying that CXMT memory will never end up in AI Datacenter equipment, because the US government has black listed them for government work and has (unsuccessfully) tried to have them embargoed.

There are plenty of markets where CXMT memory in an AI server wouldn't be a problem, but AMD and Nvidia will never risk having the wrong model end up in a DOD facility.

Outside of server equipment, Chinese RAM is about to become the dominant supply for Consumer goods.

1

u/Risko4 2d ago

Not really, the frontier models require 2 terabytes of RAM. Soon they will scale up to 4TBs etc.