Page 104
12 articlesPrompt Injection at Scale: Defending Agentic Pipelines Against Hostile Content
Prompt injection is the #1 vulnerability in production AI agents. Here's the attack surface, why instruction-level defenses fail, and the architecture that keeps systems useful under adversarial pressure.
Prompt Regression Tests That Actually Block PRs
Most teams claim to test their prompts. Almost none have CI gates that will fail a build. Here's the lightweight harness that changes that without burning your API budget.
Retrieval Debt: Why Your RAG Pipeline Degrades Silently Over Time
Your RAG pipeline was working fine at launch. Now answers feel slightly off and nobody can explain why. Here's how retrieval debt accumulates through stale embeddings, tombstoned chunks, and encoder drift — and how to stop it before users notice.
Sampling Parameters in Production: The Tuning Decisions Nobody Explains
Temperature, top-p, and top-k silently shape your LLM's output quality. Here's what engineers actually need to know about tuning them in production—including why temperature=0 isn't deterministic and how top-p and temperature interact.
Structured Outputs Are Not a Solved Problem: JSON Mode Failure Modes in Production
JSON mode feels like a solved problem until you hit deeply nested schemas, enum-heavy types, or long completions that truncate silently. A complete failure taxonomy and the validation patterns that catch breakage before it reaches users.
When Code Beats the Model: A Decision Framework for Replacing LLM Calls with Deterministic Logic
The 'just use the model' reflex is the main driver of unnecessary complexity in AI systems. A decision framework for recognizing when a regex, lookup table, or rule-based classifier outperforms an LLM call on accuracy, latency, and cost.
Writing Acceptance Criteria for Non-Deterministic AI Features
Standard acceptance criteria break when your system is probabilistic. Here are the eval threshold contracts, example-based specs, and measurement patterns that let product and engineering agree on 'done' for AI features.
Tracing the Planning Layer: Why Your Agent Traces Are Missing Half the Story
Agent observability tools give you complete tool-call logs and timing, but the planning and reasoning that drove those decisions stays invisible. Here's what planning-layer tracing looks like, why it catches a completely different failure class, and how to instrument it today.
Agentic Web Data Extraction at Scale: When Agents Replace Scrapers
AI agents solve real problems traditional scrapers can't, but the 'LLM reads the page' prototype collapses at 1,000 pages per hour. Here's the hybrid architecture, cost model, and monitoring design that actually works in production.
The Accessibility Gap in AI Interfaces Nobody Is Shipping Around
Streaming token-by-token output breaks screen readers in ways most teams never test. Here's why WCAG has no answer for it, and the design patterns that actually work.
AI Agents in Your CI Pipeline: How to Gate Deployments That Can't Be Unit Tested
Traditional CI/CD infrastructure wasn't designed for non-deterministic software. Here's how to add meaningful deployment gates for LLM-powered features without turning your pipeline into a money-burning eval farm.
The Silent Regression: How to Communicate AI Behavioral Changes Without Losing User Trust
When you silently update a model or prompt, power users experience real regression even when aggregate metrics improve. Here's how to detect behavioral drift and communicate AI changes without destroying user trust.
About Tian Pan
I'm Tian Pan, an engineer-founder focused on agentic engineering — building autonomous AI systems and scaling engineering teams. I write practical guides on system design, technical leadership, and shipping with AI agents. Previously an early engineer at Uber, Brex, and IoTeX.
