User Experience Metrics

Master UX metrics to measure and optimize AI agent performance from the user perspective

Task Success & User Engagement

Success metrics measure goal achievement: did the user accomplish what they came to do? Engagement metrics track interaction depth and duration. High engagement with low success signals frustrationβ€” users are trying hard but failing. Low engagement with high success is ideal: efficient task completion.

Interactive: User Journey Simulator

Compare successful vs failed user journeys to see how success and engagement differ:

Click 'Simulate' to watch a user journey

Success & Engagement Metrics

Task Success
  • β€’ Completion rate (did user finish?)
  • β€’ First-attempt success rate
  • β€’ Goal achievement score
  • β€’ Escalation to human rate
User Engagement
  • β€’ Messages per session
  • β€’ Session duration
  • β€’ Feature exploration rate
  • β€’ Return visit frequency
πŸ’‘
The Success-Engagement Matrix

Plot users on success (x-axis) vs engagement (y-axis) to identify patterns:

  • β€’ High success + Low engagement: Efficient (ideal)
  • β€’ High success + High engagement: Exploring features (good)
  • β€’ Low success + High engagement: Struggling (fix urgently)
  • β€’ Low success + Low engagement: Giving up (critical issue)
← Quality Metrics