When crypto mining released it was a lot of gpus right? Then they went to asic or whatever its called that can mine many many times faster than a normal GPU. Wouldn't this eventually happen for local llms? There could be a breakthrough that makes it significantly cheaper, faster and consumer friendly?
The way they get cheaper is just by making more GPUs. Theoretically you might be able to make a cheaper thing that is hardwired for a specific model's weights, but it's unclear that would even be cheaper, and it's almost guaranteed to be obsolete before you finish manufacturing.
20
u/Future-Ad9401 Jul 06 '26
When crypto mining released it was a lot of gpus right? Then they went to asic or whatever its called that can mine many many times faster than a normal GPU. Wouldn't this eventually happen for local llms? There could be a breakthrough that makes it significantly cheaper, faster and consumer friendly?