06 · Usability research, two rounds
ManyChat
Quick Automation usability research
Accelerating success on Quick Automations for new users
- Status
- Research delivered
- Service
- Usability research
- Scope
- Quick Automations onboarding flow
- Method
- Moderated usability, 2 rounds of 5
- Studio
- THEFT Studio
ManyChat needed to know whether Quick Automation, the flow that carries new users from signup to a first working bot, was clear enough to convert and fast enough to keep momentum into more complex builds.
The studio ran a two-round usability program with five participants per round across low, medium, and high tech-savviness tiers, testing intuitiveness, time-to-complete, and willingness to keep building after a first win.
Participants rated speed 5 / 5 and complexity 4 / 5, with clarity at 3+ / 5, and the readout fed clarity-fix microcopy and prioritization tags directly into the backlog between rounds.
Method · effort by phase
01 · Study design
Framed four research questions and a recruitment frame spanning low, medium, and high tech-savviness.
02 · Round 01
Five moderated sessions with new users running the Quick Automations flow end to end, capturing pain points, delighters, and time-on-task.
03 · Iterate
Content and product iterated the flow between rounds, scoped to microcopy, data clarity, and step pacing.
04 · Round 02
Five additional sessions on the iterated build validated whether changes closed the round-one gaps without introducing new ones.
05 · Readout + backlog
Synthesis organized by theme and by Quick Win, High Priority, Backlog tags so engineering could route findings directly into the sprint.
What the work surfaced
Speed is a delighter, clarity is the pain
Participants rated the flow five out of five on speed and four out of five on complexity, with clarity at three or slightly above, which is where the backlog work concentrated.
Value clicks early when the first action pays off
Users who got a visible result in their first bite-size step kept going, lowering the barrier to attempting more complex automations afterward.
Language ambiguity is the biggest clarity cost
Friction concentrated on terms where it was unclear what could be edited and where bot replies felt inauthentic; microcopy rewrites closed most gaps between rounds.
Tech-savviness changes the shape of the pain, not the themes
All three tiers hit the same three themes (Clarity, Complexity, Speed) at different intensities, sharpening prioritization without changing the framework.
Prioritization tags route research directly into work
Every finding carried a Quick Win, High Priority, or Backlog tag, turning the readout into a product-ready input and compressing the loop between research and shipping.
Delivered
- Two-round usability readout on Quick Automations
- Theme framework · Clarity, Complexity, Speed
- Pain point and delighter register
- Prioritization tags · Quick Win, High Priority, Backlog
- Microcopy recommendations for clarity-cost moments
- Tech-savviness segmentation of findings
Outcome
A backlog-ready readout that accelerates Quick Automation work between rounds.
The two-round shape and the Clarity / Complexity / Speed theme framework let product act on round-one findings before round two confirms the fixes. Prioritization tags compress the loop between research and shipping, with speed and complexity already working in the users favor and clarity as the backlog focus.
- Sample
- 2 rounds · 5 participants each
- Speed
- Rated 5 / 5 by participants
- Complexity
- Rated 4 / 5 by participants
- Clarity
- Rated 3+ / 5 · backlog focus