Ideas for building a better agent experience.

Practical guides to understanding your AI agent, the people using it, and the conversations that connect them.

Traces record software execution. Analytics measures human task completion. TWO DIFFERENT PARADIGMS ENGINEERING TRACE invoke_agent (1.2s) tool_search (420ms) llm_generate (680ms) ✓ 200 OK · 0 Exceptions PRODUCT ANALYTICS find the source (96.2%) read it (528 stopped) write summary (64% done) ✗ User abandoned at Turn 9 THE CORE GAP Traces tell you whether the software ran. Analytics tells you whether the person succeeded.

What is AI agent analytics?

A practical guide to reading live conversations: uncovering what people came to do, where the agent lost them, and why traces and latency aren't enough.

13 min read1 Sep 2026

Read the post

More guides

Turn-level dialogue forensics: surface sentiment versus forensic reality on the deciding turn. TURN-LEVEL FORENSICS SURFACE SENTIMENT LENS “Could you include the other files?” · Polite (+0.42) · 200 OK · No alert CONVERSATION FORENSICS LENS Turn 4: search_repo returned empty array [] (unhandled filter) Turn 7 deciding turn: User catches omission, agent gives evasion Turn 9: Customer quietly closes tab · Task abandoned THE CORE LESSON Sentiment scores tone. Forensics finds where the interaction actually broke.

Conversation analytics for AI agents: turn-level forensics

Why surface sentiment misses failure: how to deconstruct multi-turn dialogue, isolate deciding turns, and turn chat logs into engineering priorities.

9 min read12 Sep 2026

Product analytics for AI agents: measuring real task completion and funnel drop-offs. PRODUCT ANALYTICS FRAMEWORK TRADITIONAL SAAS High time-in-app = Good Clicking buttons & tabs Engagement is sticky AUTONOMOUS AGENTS High time-in-app = Distress Clarification loops Engagement is churn THE NORTH STAR: TASK COMPLETION RATE Fast autonomous delegation in 2 turns beats an 11-turn loop. Connect conversation outcomes directly to account cohorts.

Why traditional product analytics breaks for AI agents

Why clickstream events, pageviews, and session counts cannot tell you whether someone got what they came for.

7 min read11 Sep 2026

Traces record software execution. Analytics measures human task completion. TWO DIFFERENT PARADIGMS ENGINEERING TRACE invoke_agent (1.2s) tool_search (420ms) llm_generate (680ms) ✓ 200 OK · 0 Exceptions PRODUCT ANALYTICS find the source (96.2%) read it (528 stopped) write summary (64% done) ✗ User abandoned at Turn 9 THE CORE GAP Traces tell you whether the software ran. Analytics tells you whether the person succeeded.

What is AI agent analytics?

A practical guide to reading live conversations: uncovering what people came to do, where the agent lost them, and why traces and latency aren't enough.

13 min read1 Sep 2026

A production conversation passing through execution telemetry, evaluation, and user outcome evidence. ONE PRODUCTION CONVERSATION PROMPT TOOL CALLS RESPONSE PERSON TRACE what ran? latency · errors · cost EVALUATION was it acceptable? quality · safety · drift EXPERIENCE did they finish? task · intent · replay Production observability needs all three readings.

What is AI agent observability?

A practical guide to the traces, evaluations, metrics, silent failures, user outcomes and investigation workflow behind an observable production agent.

17 min read27 Aug 2026

USER REQUEST “Summarise the launch blockers and cite the tickets.” OUTCOMEFRICTIONPOLICYEVIDENCE Delivered?Reasked?Within bounds?Which turn? READ THE WHOLE ATTEMPT Keep the user goal, result, and supporting turns connected.

How to measure AI agent performance in production

A practical guide to user requests, task outcomes, friction, policy signals, and the conversations behind them.

11 min read24 Sep 2026

AGENTENVIRONMENTSESSIONEVENTS model · prompt · toolsthe sandbox it runs inone running taskmessages, both ways THE STREAM SAYS session.status_idle · end_turn · 0 errors THE TASK SAYS 3 of 9 sizes delivered

Claude Managed Agents: what they are and how to run one

The agent, environment, session and events model, working API calls, permissions, cost, and how to tell whether a session finished the person’s task.

11 min read16 Oct 2026