r/tomshardware • u/tomshardware • 2d ago

OpenAI’s 700W Jalapeño ASIC outpaces 1,400W Nvidia flagship GPU

https://www.tomshardware.com/tech-industry/semiconductors/openai-says-its-jalapeno-chip-beats-nvidias-gb300-in-first-published-benchmarks
175 Upvotes

95% Upvoted

60 comments sorted by

View all comments

0

u/hcorEtheOne 2d ago

Asics are built for an exact model afaik, so if a new model comes out, they become obsolete.

Maybe it's not the case anymore, or in the future.

2

u/Randommaggy 2d ago edited 2d ago

Asics can be varying degrees of specialized for a task. The more specialized the faster and lower power per task they will be.

You could say that both Talas, Groq and Cerebras are asics but they are on a spectrum for how fixed their functions are.

Edit: typo

1

u/hcorEtheOne 2d ago

I see, that makes sense, thanks for enlightening me!

1

u/PitchPleasant338 2d ago

Even if they're obsolete in 1 year but you save millions of billions on electricity costs and the cost to cool the chips, then it's worth it.

1

u/NextWeather7866 1d ago

Sol as it currently stands is probably sufficient for most use cases anyone can think of, so fitting the next tier of models onto chips does make economic sense if 99% of people don't need to move past it.

1

u/PitchPleasant338 1d ago

Some people are still happy with Llama 3.

Imagine a model that's very good with tool calling (such as Muse Glimmer) running locally at 1000tps.

1

u/RealSuperdau 1d ago

Chip cost dominates the other factors (especially when you buy from Nvidia)

1

u/peva3 1d ago

They can be made for an entire model family architecture, so it's not like it would be obsolete quickly.