Test a Price Change with a Small Group
Added 2026-11-01
Try it on new customers or one channel before changing every price.
We want to change pricing. Design a small test: 1) which customer segment to try first and why; 2) how to set the control group; 3) which three metrics to watch — conversion, order value, refunds or complaints; 4) a minimum sample size and duration; 5) how to read the result — what counts as success, what means stop; 6) three factors most likely to contaminate the test. Do not change packaging or features at the same time.
Site original
Chinese original
How to use
价格测试一次只动价格，否则读不出原因。
Try tweaking it
- Have it state how the hypothesis could be falsified before discussing execution.
- Split the plan into a one-week testable experiment.
What you should get
- A small testable experiment with a failure threshold
- Costs, risks, and what needs outside confirmation
Common mistakes
- Asking for a "full business plan" and getting unverifiable optimistic assumptions.
- No failure threshold, so you never know whether to continue.
How to check the output
- There is a clear failure threshold, testable within a week.
- Costs, assumptions and risks are listed separately.
Where it works
- Good for: turning business assumptions into a small testable experiment with a failure threshold first.
- Watch out: for pricing, contracts and legal points, treat output as a draft needing professional review.