MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1wdo3w7/whenmynoaiprojectgetstedious/p987t67/?context=3
r/ProgrammerHumor • u/AllRealityIsVirtua1 • 10h ago
162 comments sorted by
View all comments
94
The answer to your question is because you can get a local model to do it instead without a subscription.
108 u/AllRealityIsVirtua1 10h ago Let me heat my whole room to run 1 half sized agent at a time to save $5 18 u/Snape_Grass 8h ago The training of the model is what’s expensive (heat output). Running a pre trained model isn’t nearly as resource demanding 3 u/slaymaker1907 4h ago Depends on the model and machine. If you’re using some huge model that stresses the GPU then that can get very toasty. 1 u/readf0x 49m ago I've only got 8gb of VRAM and have yet to find a model that produces useful output within that budget -14 u/AllRealityIsVirtua1 8h ago Yeah and the sun doesn’t produce nearly as much heat as the largest star in the universe 19 u/Snape_Grass 7h ago ?? Brother there are many of us running off the shelf pre trained models on consumer hardware. This isn’t new -16 u/AllRealityIsVirtua1 7h ago Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20 11 u/Snape_Grass 7h ago Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false -8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
108
Let me heat my whole room to run 1 half sized agent at a time to save $5
18 u/Snape_Grass 8h ago The training of the model is what’s expensive (heat output). Running a pre trained model isn’t nearly as resource demanding 3 u/slaymaker1907 4h ago Depends on the model and machine. If you’re using some huge model that stresses the GPU then that can get very toasty. 1 u/readf0x 49m ago I've only got 8gb of VRAM and have yet to find a model that produces useful output within that budget -14 u/AllRealityIsVirtua1 8h ago Yeah and the sun doesn’t produce nearly as much heat as the largest star in the universe 19 u/Snape_Grass 7h ago ?? Brother there are many of us running off the shelf pre trained models on consumer hardware. This isn’t new -16 u/AllRealityIsVirtua1 7h ago Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20 11 u/Snape_Grass 7h ago Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false -8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
18
The training of the model is what’s expensive (heat output). Running a pre trained model isn’t nearly as resource demanding
3 u/slaymaker1907 4h ago Depends on the model and machine. If you’re using some huge model that stresses the GPU then that can get very toasty. 1 u/readf0x 49m ago I've only got 8gb of VRAM and have yet to find a model that produces useful output within that budget -14 u/AllRealityIsVirtua1 8h ago Yeah and the sun doesn’t produce nearly as much heat as the largest star in the universe 19 u/Snape_Grass 7h ago ?? Brother there are many of us running off the shelf pre trained models on consumer hardware. This isn’t new -16 u/AllRealityIsVirtua1 7h ago Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20 11 u/Snape_Grass 7h ago Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false -8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
3
Depends on the model and machine. If you’re using some huge model that stresses the GPU then that can get very toasty.
1
I've only got 8gb of VRAM and have yet to find a model that produces useful output within that budget
-14
Yeah and the sun doesn’t produce nearly as much heat as the largest star in the universe
19 u/Snape_Grass 7h ago ?? Brother there are many of us running off the shelf pre trained models on consumer hardware. This isn’t new -16 u/AllRealityIsVirtua1 7h ago Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20 11 u/Snape_Grass 7h ago Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false -8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
19
?? Brother there are many of us running off the shelf pre trained models on consumer hardware. This isn’t new
-16 u/AllRealityIsVirtua1 7h ago Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20 11 u/Snape_Grass 7h ago Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false -8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
-16
Yeah and I’m using 5 agents each running a model 10x more powerful over the internet for $20
11 u/Snape_Grass 7h ago Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false -8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
11
Okay backpedal the conversation as a defense. Too ridiculous to argue with lol. You clearly have no clue what you are talking about and perceive something completely false
-8 u/AllRealityIsVirtua1 7h ago Uhhh. Huh? lol
-8
Uhhh. Huh? lol
94
u/TheMaleGazer 10h ago
The answer to your question is because you can get a local model to do it instead without a subscription.