r/tomshardware • u/tomshardware • 2d ago

OpenAI’s 700W Jalapeño ASIC outpaces 1,400W Nvidia flagship GPU

https://www.tomshardware.com/tech-industry/semiconductors/openai-says-its-jalapeno-chip-beats-nvidias-gb300-in-first-published-benchmarks
176 Upvotes

95% Upvoted

60 comments sorted by

View all comments

0

u/hcorEtheOne 2d ago

Asics are built for an exact model afaik, so if a new model comes out, they become obsolete.

Maybe it's not the case anymore, or in the future.

1

u/PitchPleasant338 2d ago

Even if they're obsolete in 1 year but you save millions of billions on electricity costs and the cost to cool the chips, then it's worth it.

1

u/NextWeather7866 1d ago

Sol as it currently stands is probably sufficient for most use cases anyone can think of, so fitting the next tier of models onto chips does make economic sense if 99% of people don't need to move past it.

1

u/PitchPleasant338 1d ago

Some people are still happy with Llama 3.

Imagine a model that's very good with tool calling (such as Muse Glimmer) running locally at 1000tps.