asopilot

Experiments

Stop guessing which screenshots sell.

Amelia runs Apple's product page tests one at a time, declares the hypothesis up front, and waits for a real answer before calling a winner.

Get your free auditSee the demo

At a glance

  • Hypothesis first

    Every test states what it expects and the smallest lift worth finding before it starts.

  • Apple runs the test

    Tests use Apple's own product page optimization, so traffic splits and results come from the App Store itself.

  • A playbook that grows

    Every result is saved with its effect size and shapes the next test.

won14 days

Search asset: benefit headline vs logo

+18% taps from search

5%9%Day 1: treatment 6.8% vs control 6.1%Day 2: treatment 7.1% vs control 6%Day 3: treatment 7.2% vs control 6.3%Day 4: treatment 7% vs control 6.2%Day 5: treatment 7.3% vs control 6%Day 6: treatment 7.2% vs control 6.1%Day 7: treatment 7.4% vs control 6.2%Day 8: treatment 7.1% vs control 6.1%Day 9: treatment 7.3% vs control 6.3%Day 10: treatment 7.2% vs control 6%Day 11: treatment 7.4% vs control 6.2%Day 12: treatment 7.3% vs control 6.1%Day 13: treatment 7.1% vs control 6.2%Day 14: treatment 7.2% vs control 6.1%AB
A · controlB · treatment

The problem

Most screenshot changes are a guess nobody checks.

Teams redesign screenshots or the icon on instinct, ship them to everyone and never find out if it helped. Apple's product page tests answer the question properly, but setting them up, waiting long enough and remembering what you learned is easy to skip.

How Amelia handles it, every week

She does the work. You make the call.

  1. 01Checks

    Is a test running?

    If none is, the page is not learning anything, so Amelia proposes one.

  2. 02Drafts

    One change, one hypothesis

    Icon, first screenshots or screenshot order, with the hypothesis and metric written down first.

  3. 03You approve

    Set the split

    Choose the traffic share, up to 3 treatments and the languages to test in.

  4. 04Ships

    Apple runs it

    The test is created in App Store Connect. Apple reviews the treatments and splits the traffic.

  5. 05Measured

    Record and learn

    When it ends, record the winner and lift, plus a one-line learning that shapes the next test.

What you get

Everything in Experiments, in one line each.

Example

A finished test

A sample result for a made-up app. Numbers come from App Store Connect and are entered by you. Your own drafts come from your own approved copy.

Plan

  • TestLead with the map screenshot28/64 characters
  • HypothesisShowing listings on a map first will lift page conversion, because buyers care about distance.
  • Split30% of visitors, 1 treatment, English (US) and English (UK)

Result

  • WinnerMap first
  • Lift in conversion+6.2%
  • What we learnedDistance sells. Lead with location in every market.

Getting started

Three steps. Then it runs every week.

  1. 01

    Amelia proposes a test

    Based on your audit and what has worked for similar apps.

  2. 02

    You approve

    See both versions and the traffic split.

  3. 03

    Learn and repeat

    Record the result, keep the learning, and Amelia suggests the next test from what you learned.

Questions

How long does a test run?

Usually one to three weeks, depending on your traffic. Amelia tells you up front.

Does asopilot calculate the statistics?

No. Apple runs the test and reports results in App Store Connect. You record the winner and lift in asopilot so the learning is kept.

How many treatments can a test have?

Up to 3, as Apple allows. The test share is split evenly between them, and everyone else sees your live page.

Can I test a new icon?

Yes, as long as the alternate icons are included in your app build, which Apple requires for icon tests.

Does Apple review the test?

Yes. Treatments go through Apple's review before the test starts.

What is the longest a test can run?

90 days. Apple ends the test after that, and asopilot shows the days left on every running test.

Works with

Screenshots

Design screenshots once, render them in every language at Apple's sizes, and upload them for you.

Audit

Every language, field, screenshot and purchase scored every week, with the fix for each one.

Listings

Names, subtitles, keywords and promotional text in 50 languages, kept fresh every week.

See what your page is missing.

Paste your App Store or Google Play link for a free audit in seconds, no signup needed. Or look around the demo workspace first.

Or see the demo