Skip to content

5-Star Review Analysis — Executive Summary

Covering 2026-04-01 to 2026-05-21 · 199 conversations · 200 reviews

At a glance

This analysis covers 200 app store reviews linked to support conversations. 191 are 5-star, 6 are 4-star, and 3 are 1-star — it is not a sample of all support conversations.

  • 200 reviews analysed

    191 five-star · 6 four-star · 3 one-star. 199 were preceded by a support conversation; 1 was organic. Period: 2026-04-01 → 2026-05-21.

  • 199 unique shops

    Every single review came from a different Shopify merchant. No shop appears more than once — no cross-app overlap found.

  • 68% issues resolved in-conversation

    The LLM assessed whether the specific issue raised in each conversation was resolved before the conversation closed. This is independent of the review — a merchant can still leave 5 stars even if a feature request wasn't fulfilled.

  • 1h 32m median install age

    Median time between app install and first support conversation. Median wait before first human agent joined: 1m 36s.

Apps covered

  • Notify Me! — 135 conversations (68%)
  • Discounty — 47 conversations (24%)
  • Subi — 16 conversations (8%)
  • Convi — 1 conversations (1%)

Top issue categories

608 issues extracted across 199 conversations (avg 3.1 per conversation).

How-To / Setup (319) · Technical Bug (163) · Feature Request (59)

How-To / Setup accounts for 52% of all issues. Most are resolved in the same conversation — see Full Analysis for the resolution rate breakdown.

Key findings

  1. Review origin — 99.5% of 5-star reviews are directly traceable to a support interaction. Only 1 review was submitted without a prior conversation.

  2. Install timing — The majority of conversations happen within the first 24 hours after install. Merchants reaching out immediately are your most likely reviewers.

  3. Fin AI — 44% of conversations involved the Fin AI bot. In most cases Fin attempted to resolve but escalated to a human agent — who then asked for the review.

  4. Geography — United States leads with 69 conversations (35%). Reviews come from 35 distinct regions.

  5. Shop uniqueness — Every single review came from a different Shopify domain. No shop reviewed multiple apps during this period.

  6. Email type — 29% of merchants used a personal business domain, 30% a personal free email (Gmail etc.), 36% a team mailbox. Broad mix of merchant sizes.

Section What you'll find
Full Analysis All 15 sections — timing, geography, agent patterns, Fin AI, issue deep-dives
All Conversations Index of all 199 conversations with links to individual pages
Data Downloads master.csv (199 × 89) and issues.csv (608 rows) for Google Sheets

Generated 2026-05-25 · Partnerz Support Analytics