Skip to main content

Pricing A/B Test Design Planner

Design statistically valid pricing experiments with sample size calculations. Enter values for instant results with step-by-step formulas.

Share this calculator

Worked Examples

Example 1: SaaS Monthly Plan

Problem: Current: $99/month, 3.5% conversion. Testing $119/month. 50,000 monthly visitors. Want 95% confidence.

Solution: Price increase: about 20.2%\nExpected conversion using the calculator's elasticity model:\n3.5% × (1 - 0.303) ≈ 2.44%\n\nRequired sample size:\nAbout 4,017 visitors per variant\n\nAt 50,000 monthly visitors, the calculator estimates enough traffic in about 1 week.\n\nRevenue per visitor:\nControl = 3.5% × $99 = $3.47\nTest = 2.44% × $119 ≈ $2.90\n\nThis scenario reduces revenue per visitor.

Result: $99→$119 | 3.5%→2.44% expected | Revenue/visitor falls | About 1 week needed

Example 2: E-commerce Product

Problem: Product at $49, 5% conversion. Testing $59 (about a 20.4% increase). 100,000 monthly visitors.

Solution: Expected conversion using the calculator's elasticity model:\n5.0% × (1 - 0.306) ≈ 3.47%\n\nRevenue per visitor:\nControl = 5.0% × $49 = $2.45\nTest = 3.47% × $59 ≈ $2.05\n\nRequired sample size is modest at this traffic level, so the calculator reaches power in about 1 week.\n\nThis test points toward weaker revenue at $59.

Result: $49→$59 | Revenue likely decreases | About 1 week to power | Consider a smaller increase

Example 3: Subscription Annual Plan

Problem: Annual plan $499, 1.2% conversion. Testing $599. Only 10,000 monthly visitors.

Solution: Price increase: about 20.0%\nExpected conversion using the calculator's elasticity model:\n1.2% × (1 - 0.301) ≈ 0.84%\n\nBecause traffic and conversion are both low, required sample size is much larger.\nThe calculator estimates roughly 11 weeks to statistical power at this traffic level.\n\nA smaller price step or longer test window is safer.

Result: Low power situation | About 11 weeks needed | Consider a smaller price change

Frequently Asked Questions

Why A/B test pricing instead of just raising prices?

A/B testing provides data-driven confidence. You learn the actual elasticity of your customers, minimize risk of revenue loss, and can optimize incrementally. Blind price changes may lose significant revenue or leave money on the table.

How long should a pricing A/B test run?

Long enough for statistical significance—typically 2-8 weeks depending on traffic. Must cover full business cycles (weekday/weekend, pay periods). Stopping early for positive results inflates false positives. Plan duration before starting.

What's a good minimum detectable effect for pricing tests?

Typically 10-20% relative change in conversion or revenue. Smaller effects require huge sample sizes. If a 5% revenue change doesn't matter to your business, don't design tests to detect it—you'll wait forever.

Should I test multiple prices simultaneously?

A/B/C or A/B/n tests can be valuable for finding optimal price points. However, they require more traffic and complexity. Start with A/B for simplicity, then iterate. Each additional variant increases sample size requirements.

Can I test pricing on existing customers?

Testing on existing customers is risky—they may notice price changes and feel unfairly treated. Better to test on new customers or be transparent about testing. Grandfather existing customers if raising prices significantly.

What metrics should I track in pricing tests?

Primary: revenue per visitor (combines conversion and price). Secondary: conversion rate, average order value, churn (for subscriptions), customer lifetime value. Don't optimize conversion at expense of revenue.

Background & Theory

The Pricing Experiment A/B Test Design Planner applies the following established principles and formulas. Break-even analysis identifies the sales volume at which total revenue equals total costs, producing neither profit nor loss. The formula divides total fixed costs by the contribution margin per unit, where contribution margin equals selling price minus variable cost per unit. If a software product has $50,000 in monthly fixed costs and each licence generates $20 above its variable cost, break-even requires 2,500 unit sales per month. Above that threshold, each additional unit contributes directly to profit. Gross margin expresses the percentage of revenue remaining after direct cost of goods sold: gross margin equals revenue minus COGS, divided by revenue. A SaaS company with 80 percent gross margins retains $0.80 of every revenue dollar to cover operating expenses, while a manufacturer with 30 percent gross margins faces much tighter operating leverage. Customer acquisition cost (CAC) divides total sales and marketing expenditure in a period by the number of new customers acquired in that same period. Customer lifetime value (LTV) estimates the total profit attributable to a customer relationship. The standard formula multiplies average revenue per user (ARPU) by gross margin and divides by the monthly churn rate. A business with $50 ARPU, 75 percent gross margin, and 2 percent monthly churn has an LTV of $1,875. The LTV:CAC ratio benchmarks unit economics health; a ratio above 3:1 is generally considered sustainable, while ratios below 1:1 indicate the business is acquiring customers at a loss. Burn rate measures monthly cash expenditure net of revenue. Cash runway equals current cash reserves divided by net monthly burn. A company with $1.2 million in the bank burning $100,000 per month has twelve months of runway. The Rule of 40 is a benchmark for SaaS health: the sum of annual revenue growth rate (as a percentage) and profit margin (as a percentage) should equal or exceed 40. High-growth companies burning cash can still pass this rule if their growth rate compensates.

History

The history behind the Pricing Experiment A/B Test Design Planner traces back through the following developments. Early economic thought centred on mercantilism, the 16th and 17th century doctrine that national wealth derived from accumulating precious metals through export surpluses and colonial extraction. Adam Smith's "Wealth of Nations" in 1776 dismantled this framework, arguing that genuine prosperity arose from specialisation, division of labour, and freely operating markets. David Ricardo extended Smith's work with the theory of comparative advantage in 1817, demonstrating mathematically that mutually beneficial trade was possible even when one country was less productive in every industry. Alfred Marshall's "Principles of Economics" published in 1890 provided the modern framework of supply and demand curves, consumer surplus, price elasticity, and marginal analysis, establishing neoclassical economics as the dominant academic paradigm for decades. The Great Depression exposed the limits of laissez-faire assumptions, and John Maynard Keynes's "General Theory of Employment, Interest and Money" in 1936 argued that private-sector aggregate demand failures required countercyclical government fiscal intervention to restore full employment, shifting the policy consensus toward active macroeconomic management. The post-World War II decades constructed mixed-economy models combining market allocation with expanded welfare states and Keynesian demand management. Milton Friedman and the Chicago School challenged this consensus from the 1960s onward, championing monetarism and arguing that stable money supply growth was superior to discretionary fiscal policy. Their influence shaped the deregulatory and privatisation policies of the Reagan and Thatcher eras in the 1980s. Behavioural economics emerged through the work of Daniel Kahneman and Amos Tversky in the 1970s and Richard Thaler in the 1980s, using psychology to demonstrate that real human decision-making deviates systematically from rational-actor models through heuristics and biases. The rise of the internet and mobile platforms in the 2000s and 2010s created a new category of platform economics, where network effects, near-zero marginal cost of digital goods, and two-sided market dynamics generated winner-take-most competitive outcomes requiring new analytical frameworks for business valuation.

References