Page 16
12 articlesThe Chunk Boundary That Bisected the Sentence Your Answer Depended On
Fixed-size token chunking cuts critical clauses in half, and neither fragment retrieves alone. A look at why the failure is invisible to standard evals and which chunking strategies actually close the gap.
The Coding Agent That Passes Locally and Fails in CI
Coding agents inherit your laptop's warm environment and ship diffs that pass locally then fail in CI. The fix is a repo-level environment contract, a pre-flight parity check, and grading on dev-vs-CI divergence.
The Conversation Tree Your Server Stored As A Log
Chat UIs let users edit and regenerate messages while backends quietly append every revision to a linear log — so the model answers the conversation the user thought they took back.
The Customer Who Cancelled Because Your Agent Was Too Confident
Overconfident AI agents do not lose renewals at the survey — they lose them six weeks later at the renewal call. Treating confidence display as a versioned product surface, not a stylistic accident.
The Demo You Recorded in March Was the Last Time It Worked
Recorded sales demos become liability surfaces as model snapshots, prompts, tool catalogs, and retrieval substrates drift underneath them. A demo manifest plus a nightly eval suite turns recordings into testable behavioral commitments.
The Eval Set That Started Leaking Into Your Prompt
How few-shot retrieval and a shared CSV quietly turn a careful eval bank into the in-context examples you serve — and the storage-layer separation that stops it.
The Finish Reason Your Code Never Inspects
Every inference API returns a stop signal alongside the text. Ignoring it is the same shape of bug as ignoring HTTP status codes — and your dashboard cannot see the failures it causes.
The Free Trial That Burned Your Quarterly Inference Budget in Eleven Hours
Trial caps sized for human attention break the moment a programmatic signup points an agent at the endpoint. A field guide to redesigning quotas, detection, and exhaustion UX for the population actually signing up.
The Hot-Reload Loop Your Coding Agent Polluted
When coding agents write faster than your dev server's watcher debounce, the HMR overlay becomes a self-exciting oscillator that the agent reads back into its own reasoning.
The Idiom Your Coding Agent Wrote Around Instead Of Using
Coding agents ship code that compiles, tests pass, and reviewers approve — but uses idioms your codebase does not speak. Here is why, and what to do about the drift.
The Inner Loop Your Coding Agent Quietly Broke
Coding agents accelerate diffs and decelerate cognition. The hidden cost is the engineer's mental model — and the practices that keep it alive.
The Internal Search Box You Replaced With an Agent Just Became Your SLO
Retiring a deterministic feature in favor of an agent silently hands the predecessor's SLO to a system that cannot meet it — and the gap shows up the morning your inference provider throttles.
About Tian Pan
I'm Tian Pan, an engineer-founder focused on agentic engineering — building autonomous AI systems and scaling engineering teams. I write practical guides on system design, technical leadership, and shipping with AI agents. Previously an early engineer at Uber, Brex, and IoTeX.
