Page 129
12 articlesCloud Agents Are Rewriting How Software Gets Built
AI coding tools have moved from autocomplete to local agents to cloud agents—and each shift changes the fundamental unit of work. Here's what the cloud agent era actually requires from engineers and engineering infrastructure.
LLM-as-a-Judge: A Practical Guide to Building Evaluators That Actually Work
Most LLM evaluation setups are broken by design—wrong metrics, wrong people, wrong methodology. Here's a concrete framework for building LLM judges that actually correlate with quality and catch real regressions.
A Year of Building with LLMs: What the Field Has Actually Learned
Hard-won lessons from teams that have shipped LLM-powered systems into production: why the model is the least durable part of your stack, how to build eval infrastructure that actually works, and when RAG beats finetuning.
Beyond RAG: Hybrid Search, Agentic Retrieval, and the Database Design Decisions That Actually Matter
Pure vector search fails in production when users query exact identifiers, error codes, and named entities. A guide to hybrid search architectures, agentic retrieval patterns, and the database design decisions that follow.
How AI Agents Actually Work: Architecture, Planning, and Failure Modes
A practical breakdown of how AI agents work under the hood — covering tool use, planning patterns, reflection loops, multi-agent coordination, and the five ways plans actually fail in production.
Hard-Won Lessons from Shipping LLM Systems to Production
Practical engineering lessons from shipping LLM systems: why evals come first, why hybrid search beats pure vector retrieval, and why the model is never the moat.
Building LLM Applications for Production: What Actually Breaks
A practical guide to what breaks when you move LLM applications from demo to production—covering inference cost, latency trade-offs, prompting vs RAG vs finetuning decisions, multi-step pipeline failures, evaluation frameworks, and observability.
LLM-Powered Autonomous Agents: The Architecture Behind Real Autonomy
Most teams claiming to run agents in production aren't — only 16% of deployments meet the bar for true autonomy. A breakdown of the planning, memory, and tool-use subsystems that separate real agents from glorified chatbots, and the five failure modes that sink production systems.
Seven Patterns for Building LLM Systems That Actually Work in Production
A practical breakdown of seven engineering patterns — evals, RAG, fine-tuning, caching, guardrails, UX design, and feedback loops — that separate working LLM prototypes from reliable production systems.
Common Pitfalls When Building Generative AI Applications
95% of generative AI pilots yield no measurable business impact. Here are eight engineering and product failures that kill AI projects — from problem selection through evaluation — with production examples.
The Agent Evaluation Readiness Checklist
A practical, sequenced checklist for building AI agent evaluations that actually catch failures — covering trace review, dataset design, grader patterns, and connecting evals to production.
Self-Healing Agents in Production: How to Build Systems That Fix Themselves
Production AI agents fail silently — wrong answers, stalled tasks, no stack traces. A layered approach to detection, triage, and automated recovery can catch most failures before users notice.
About Tian Pan
I'm Tian Pan, an engineer-founder focused on agentic engineering — building autonomous AI systems and scaling engineering teams. I write practical guides on system design, technical leadership, and shipping with AI agents. Previously an early engineer at Uber, Brex, and IoTeX.
