Page 106
12 articlesWhen Everyone Has an AI Coding Agent: The Team Dynamics Nobody Warned You About
When every engineer on your team has an AI coding agent, individual productivity gains can quietly destroy collective code ownership, accelerate knowledge silos, and break code review culture — here's what to do about it.
The AI Product Metrics Trap: When Engagement Looks Like Value but Isn't
How teams measure session count and completion rate while missing what actually predicts value — and why the first 30 days of AI feature metrics are almost always wrong.
AI for SRE Log Analysis: The Tiered Architecture That Actually Works
Real-time frontier model analysis of streaming logs is financially and latency-untenable. Here's the tiered approach—fast anomaly detection gating selective LLM calls—that actually works in production.
AI Succession Planning: What Happens When the Team That Knows the Prompts Leaves
When the engineer who wrote your system prompt leaves, the reasoning behind every phrasing decision leaves with them. Here's how to build AI systems that survive personnel changes.
AI User Research: What Users Actually Need Before You Write the First Prompt
Most AI features fail not because the technology is wrong, but because teams asked users what they wanted instead of observing what they actually do. Here's how to run user research that produces reliable behavioral signal before you build.
The Alignment Tax: Measuring the Real Cost of Shipping Safe AI
Every safety layer you add to a production AI system has a measurable cost in latency, tokens, and user friction. Here's how to instrument that cost and make principled tradeoffs.
Ambient AI Architecture: Designing Always-On Agents That Don't Get Disabled
Most ambient AI features get disabled within two weeks of launch — not because the model is bad, but because the interrupt threshold is wrong. Here's the architectural and UX framework that prevents it.
Your Annotation Pipeline Is the Real Bottleneck in Your AI Product
Teams invest in feedback capture UI while the downstream annotation pipeline — schema versioning, IAA scoring, queue prioritization — runs two sprints behind indefinitely. Here's how to fix it.
Annotation Workforce Engineering: Your Labelers Are Production Infrastructure
Most ML teams treat annotation as a procurement problem. It's an infrastructure problem. Here's how to run a labeling operation with the same rigor as production systems.
Annotator Bias in Eval Ground Truth: When Your Labels Are Systematically Steering You Wrong
How annotator selection, demographics, and systematic error patterns corrupt your eval ground truth before training even begins — and the audit methodology to catch it.
API Contracts for Non-Deterministic Services: Versioning When Output Shape Is Stochastic
Traditional API contracts break when services wrap LLMs. Here's how to version, test, and maintain backward compatibility for probabilistic systems.
API Design for AI-Powered Endpoints: Versioning the Unpredictable
When you upgrade an AI model behind your API, the JSON schema stays the same but the tone, refusal behavior, and reasoning style can all shift. Here are the patterns — snapshot pinning, structured outputs, behavior envelopes, and shadow deployments — that keep AI endpoints stable for callers.
About Tian Pan
I'm Tian Pan, an engineer-founder focused on agentic engineering — building autonomous AI systems and scaling engineering teams. I write practical guides on system design, technical leadership, and shipping with AI agents. Previously an early engineer at Uber, Brex, and IoTeX.
