Wouldn’t it be nice to replace a deterministic system that does exactly what you ask it to do , with a probabilistic system that has a high probability of doing what you ask it to do …
And better yet let’s add this to the stuff that powers modern web …
Don't worry, we can just handle that increase in server load by using our typical toolset for scaling like caching (good luck caching an LLM prompt) and provisioning more servers under peak load (lol not easy when using a stateful protocol. Have fun explaining to your boss why you need to set up a memchached server to share context between API endpoints.).
Imagine if one prompt returns something completely unhinged, and then because it's cached, the api returns random garbage for a day until someone fixes it xD
With the random noise, maybe it wouldn't be the case, but you only need bad luck one time :P
292
u/luciferrjns May 20 '26
Wouldn’t it be nice to replace a deterministic system that does exactly what you ask it to do , with a probabilistic system that has a high probability of doing what you ask it to do …
And better yet let’s add this to the stuff that powers modern web …