The Build-vs-Buy LLM Infrastructure Decision Most Teams Get Wrong
· 10 min read
A FinTech team built their AI chatbot on GPT-4o. Month one: $15K. Month two: $35K. Month three: $60K. Projecting $700K annually, they panicked and decided to self-host. Six months and one burned-out engineer later, they were spending $85K/month on infrastructure, a part-time DevOps engineer, and three CUDA incidents that took down production. They eventually landed at $8K/month — but not by self-hosting everything. By routing intelligently.
Both decisions were wrong. The real failure was that they never ran the actual math.
