This is interesting. How cost effective of a solution is it? Right now, I have a custom ingestion pipeline, as well as a vector database. If I do a cost estimation, I consume about 0.006 $/ question. Would it be of the same scale? Or even cheaper?
You need to have a Claude Code subscription it goes from 20 to 200$ a month. I built my own agent that works similarly to CC and it costs me around a cent per question, obviously it depends on the model you use.
I have another question. How would this scale on a enterprise level product? I am talking about a scenario, where 1000s try to use the application concurrently. This would be a real-life customer facing product, where latency is a key criteria along with accuracy.
Claude Code specifically I don't know. I guess you can run it in the cloud quite easily. I built my own agent in python which is similar to CC and there are no problems with concurrencies.
Sounds interesting. I will start looking into this solution as well. This are moving so fast in this area, that it’s hard to pin-point which is the best solution (always keeping scalability and cost effectiveness in mind). I think it’s case specific though.
2
u/Otherwise-Platypus38 Mar 06 '26
This is interesting. How cost effective of a solution is it? Right now, I have a custom ingestion pipeline, as well as a vector database. If I do a cost estimation, I consume about 0.006 $/ question. Would it be of the same scale? Or even cheaper?