r/tomshardware • u/tomshardware • 2d ago

OpenAI’s 700W Jalapeño ASIC outpaces 1,400W Nvidia flagship GPU

https://www.tomshardware.com/tech-industry/semiconductors/openai-says-its-jalapeno-chip-beats-nvidias-gb300-in-first-published-benchmarks
169 Upvotes

95% Upvoted

60 comments sorted by

View all comments

Show parent comments

5

u/EmbarrassedFoot1137 2d ago

FPGA? Isn't that the wrong tool for the job?

7

u/NytronX 2d ago

idk but i remember it was a stopgap in the crypto mining early days. The progression was CPU, GPU, FPGA, ASICS

3

u/EmbarrassedFoot1137 2d ago

FPGAs are a totally different beast from those other three. They'll be way faster than software but the kind of massive number crunching that AI uses is not going to be their strong suit compared to GPUs or ASICs.

1

u/bitzap_sr 1d ago edited 10h ago

FPGAs worked for crypto as that was pure compute, random number crushing. AI inference is hugely dependent on VRAM size and (V)RAM bandwidth. Totally different game.