By the end of this guide, you'll know how to create A/B tests for sequence steps, follow best practices for meaningful testing, analyze results to determine winners, and apply winning variations to future leads, all to maximize your campaign performance through data-driven optimization.

The benefits:

Before setting up an A/B test:

A/B testing (also called split testing) means creating two versions of the same email:

lemlist randomly sends Version A to 50% of your leads and Version B to the other 50%. You then compare performance metrics (open rates, reply rates, click rates) to determine which version performs better.

Test one element at a time

Only change ONE thing between Version A and Version B. If you change the subject line AND the email body AND the CTA, you won't know which change caused the performance difference.

Good test:

Bad test:

Test each step of your sequence

Don't just A/B test Step 1. Test every step in your sequence to optimize the entire flow. Each step serves a different purpose and may respond differently to various approaches.

Example sequence testing:

Ensure sufficient sample size

Small sample sizes produce unreliable results. Aim for at least 50-100 leads per variation (100-200 total) before drawing conclusions.

If Version A gets 2 replies from 10 leads (20% reply rate) and Version B gets 1 reply from 10 leads (10% reply rate), the difference could be random chance. With 100 leads each, patterns become clearer.

Let the test run its full course

Don't call a winner after the first day. Wait until most leads have progressed through the step and had a chance to respond. For email steps, wait at least 5-7 days after the last send before analyzing results.

Step 1: Open your campaign sequence

Go to Campaigns and select the campaign you want to edit. This opens the campaign in sequence view.

Step 2: Choose the step to test

Decide which step you want to A/B test. This is usually your first email step, but you can test any email step in the sequence.

Step 3: Open the step menu and create the A/B test

On the step you want to test, click the three dots (⋮) menu and select A/B test this step.

lemlist will then create two versions of that step: Version A and Version B.

Step 4: Choose how to create Version B

When prompted, choose how you want to start Version B:

Option 1: Duplicate Variant A

Version B starts as a copy of Version A, so you can change only the specific element you want to test.

💡 Best for: Testing small changes like subject lines, one paragraph, or CTAs.

Option 2: Start from scratch

Version B starts empty, and you build it yourself.

💡 Best for: Testing a completely different message or structure.

Choose the option that fits your test.

Step 5: Edit Version A and Version B

After the A/B test is created, you'll see both Version A and Version B under the step. Review Version A, then edit Version B and change only one element so your results stay meaningful.

Common elements to test:

Subject lines:

Email length:

Call-to-action:

Personalization level:

Email tone:

Step 6: Save your test

Once both versions are configured, save the step. lemlist will randomly split your leads 50/50 between Version A and Version B when this step sends.

Step 7: Launch your campaign

Go to the Launch section and launch your leads as usual.

lemlist automatically splits leads between the two versions. You don't need to do anything manually—the system handles distribution.

Step 8: Monitor early performance (optional)

While the test is running, you can check preliminary results in the campaign Performance view. Look for metrics like:

💡 Don't jump to conclusions early: Wait for statistically significant data before deciding on a winner.

Step 9: Review A/B test performance

Once most leads have received the step, open the campaign Performance view and review the A/B breakdown for the tested step. Each version is shown separately so you can compare results side by side.

Step 10: Compare key metrics

Focus on the metric that matters most for your test:

Testing subject lines? → Compare open rates

Testing email copy or CTA? → Compare reply rates

Testing link placement? → Compare click rates

Example results:

Winner: Version B (higher open and reply rates)

Step 11: Determine if the difference is significant

A small difference (e.g., 8% vs. 9% reply rate) might be random variation. A large difference (e.g., 8% vs. 15% reply rate) is likely meaningful.

Rule of thumb:

Step 12: Select the winning version

After you've identified the winner, go back to the tested step in your sequence. Open the three dots (⋮) menu for the version you want to keep and click Select as winner.

Step 13: Apply to newly imported leads

When you select a winner, lemlist automatically uses that version for all leads imported to the campaign after this point.

Leads who already received Version A or Version B are not affected. They keep their original version in the campaign history.

After selecting a winner:

✅ Future leads receive only the winning version – No more 50/50 split

✅ Past leads remain unchanged – Their history and analytics stay intact

✅ The losing version is archived – You can still view it but it won't send

✅ The decision is permanent – You cannot switch back or re-enable the losing version

Example 1: SaaS Company Tests Subject Lines

A SaaS company targeting marketing directors ran an A/B test on Step 1 subject lines.

Version A: "Quick question about [Company]" Version B: "Your [Department]'s biggest challenge?"

Results (200 leads, 100 per version):

Winner: Version B

Why it worked: Version B created curiosity by mentioning a "challenge," making recipients more likely to open and engage.

Application: They applied Version B to all future leads and tested variations of the "challenge" angle in Step 2.

Issue: Both versions have nearly identical performance

Root cause: The element you tested may not significantly impact performance, or your sample size is too small

Fix:

Issue: I accidentally selected the wrong winner

Root cause: Once a winner is selected, the decision is permanent

Fix:

Issue: My A/B test results don't show in analytics

Root cause: Analytics may not have loaded yet, or the test hasn't collected enough data

Fix:

Issue: I want to test more than two variations (A/B/C testing)

Root cause: lemlist's A/B testing currently supports two variations only

Fix:

Issue: One version is getting way more sends than the other

Root cause: Distribution should be 50/50, but technical issues or campaign pauses can skew it

Fix:

Start with high-impact elements: Test subject lines first (biggest impact on open rates), then test email copy (biggest impact on reply rates), then test smaller elements like CTAs.

Test throughout your sequence: Don't just optimize Step 1. Test each step independently to maximize the entire sequence's performance.

Document your learnings: Keep a spreadsheet of all A/B tests run, what you tested, and what won. Over time, you'll build a playbook of what works for your audience.

Use insights across campaigns: If Version B wins in one campaign, apply that insight to similar campaigns immediately. Don't re-test the same thing repeatedly.

Test bold differences: Small tweaks (e.g., "Hi" vs. "Hey") rarely produce meaningful results. Test significantly different approaches (formal vs. casual, long vs. short) for clearer winners.

Prioritize reply rate over open rate: Opens are good, but replies drive business. If testing email content, focus on reply rate as your success metric.

Test one step at a time: Don't A/B test multiple steps simultaneously in the same campaign—it complicates analysis. Finish one test, apply the winner, then move to the next step.

Combine winners for compound impact: If Step 1 Version B gets 30% better results and Step 2 Version B gets 25% better results, applying both winners compounds your overall campaign performance significantly.