Case 1
AI-assisted UX audit of Agentic Test Case Designer
From a screen-by-screen review to a prioritized, formula-driven tracker.
Hands-onI ran the audit, reviewed every AI-drafted finding and built the tracker.
LeadershipI set the scope and the prioritization method, and carried the systemic findings into the suite-level plan.
Problem statement and brief
The Agentic Test Case Designer (TCD) had grown screen by screen, and the team had no single view of its usability, consistency and accessibility issues, or of which to fix first.
Brief: produce an audit the team can act on, with every finding tied to a screenshot, a suggested fix and a priority.
Context
Agentic TCD is part of Cyara’s automated CX testing platform. The audit covered Campaigns, New Campaign, Test Cases and Agentic Tests, New/Edit Agentic Test, Reporting, and the Designer canvas. The reference point was Cyara Rocket, the internal design system, with its ultramarine, San Marino and malibu blue palette.
Preliminary research and discussion
User feedback came first: the historical run view in the Designer canvas leaves too little room to read conversation steps, and the hide-summary and hide-audio toggles only partly solve it. I then walked each page group with annotated screenshots and checked them against Rocket components and colors.
The key discussion was scope. Rather than one giant pass, I chose a progressive audit, one page group at a time, so findings could be reviewed and reprioritized as they came in.
Approach
- Feed annotated screenshots to Claude and have it draft findings, suggested fixes, and Impact and Effort ratings.
- Review every drafted line against product context. Nothing went into the tracker unreviewed.
- Edit my existing tracker in place instead of building a new workbook: 10 columns, tabs for Overall, New Agentic TC, TCD, Campaign Index and Report, and a Priority score calculated by formula from Impact and Effort.
- Write a short brief document alongside the tracker for stakeholders who won’t open a spreadsheet.
Result
31 issues, split by scope
Notable findings:
- Missing flow connector lines in the Designer canvas.
- A clipped “Sensitive Data” badge on a compliance-critical field.
- A “Classic View” migration toggle shipping in the production UI.
- Three distinct navy header shades where one was intended.
Status
Tracker and audit brief are complete. The three systemic findings fed directly into Case 2.
Reflection
AI was fastest at turning screenshots into consistent, well-structured findings. It was weakest at business context: whether a clipped badge was a cosmetic bug or a compliance risk was a human call. Editing my own tracker in place meant the output fit my existing workflow and was usable immediately.