See what people ask your agent, what works, and what breaks.

Your agent talks to thousands of people. See what they asked for, and what they didn’t get. Every finding links back to the conversation behind it.

One conversation in the abracadabra workspace. The task “resize this banner for every channel” failed at the intent “resize it”, after 6 of the 9 sizes came back blank.
  1. Find the formatsdone
  2. t1PersonResize this banner for every channel we post on.
  3. t2AgentSocial only, or email headers too?
  4. t3PersonSocial only.
  5. t4AgentFound 9 formats.
  6. Resize itfailed
  7. t5PersonGreat, go ahead.
  8. t6AgentResizing for the 9 formats now.
  9. t7Agent6 of the 9 sizes came back blank. Sending the other 3.Blank sizes
  10. Export the filesincomplete
  11. t8AgentHere are 3 sizes, ready to post.
  12. t9PersonWhere are the rest? Can you try that again?Dissatisfaction
Topic Editing designs
Task Resize this banner for every channel Failed at resize it
Signals
  • Blank sizest7
  • Dissatisfactiont9
Cohort Enterprise, EMEA 52% task success. Baseline 64%. 986 users in this cohort.

There’s more to learn from every conversation.

Your traces and evals tell you how the agent runs. Your conversations tell you what people need. Abracadabra helps you bring that part of the picture into focus.

User needs

What are people trying to accomplish?

Conversation signals

Where do they need more help?

Affected users

Which groups encounter the same issue?

Find out what people come to your agent for.

People ask for the same thing in different ways. Abracadabra brings those conversations together, so you can see what they’re trying to do.

Spot repeated requests, moments of confusion and unresolved questions without reading through every conversation yourself.

Each finding links back to the words behind it, so you can check the context for yourself.

Example conversation

9 turns
User request
Agent guidance
User follow-up
+2 turns
Identify intent and conversation signals
Topic Editing designs
Task resize this banner for every channel
Intent resize it
Signal Unresolved request

See where people keep getting stuck.

Some issues happen once. Others come up again and again. Group similar tasks to see where people need the most help.

resize this banner for every channel 2,400 attempts

find the formats

923.8% stop

resize it

52822.9% stop

export the files

24413.7% stop

Finished the task

1,53664%

Illustrative data: 2,400 task attempts. Each bar shows attempts reaching a step; its coloured end shows those that stopped there.

In this example, 528 attempts stop on resize it. Open those conversations to find out what’s getting in the way.

Task completion by user group

64% baseline

Enterprise EMEA

52%12 points below

EMEA

58%6 points below

Returning users

61%3 points below

Enterprise

66%2 points above

Self-serve

71%7 points above

Illustrative data. A 19 percentage point gap between the highest and lowest success rates.

See how the experience differs.

The same agent can work well for one group and leave another asking for help. Compare plans, regions or returning users to spot the difference.

In this example, self-serve users finish the task 71% of the time. Enterprise users in EMEA finish it 52% of the time.

Look at the conversations within each group to understand why.

Go back to the conversation.

Found a pattern worth a closer look? Open an affected conversation in session replay. See what the person asked, how the agent responded, and what happened next.

All conversations · illustrative data 12,400
Attempts to resize this banner for every channel 2,400
Stopped on resize it 528

“Where are the rest? Can you try that again?”

Person · turn 9 · the sentence that ends it

Build a better experience for your users.

Start with the conversations your agent is already having. Find out what people need and where you can make things better.

Free during early access, up to 1,000 classified conversations.