article thumbnail

7 common problems that derail A/B/n email testing success

Martech

The open rate, for example, has been a popular success metric ever since we learned how to use it back in the early days of HTML email. But it’s a flawed and unreliable metric, especially now that Apple’s Mail Privacy Protection feature masks a campaign’s true open rate. Are you ready?

article thumbnail

The Entrepreneurs’ Guide to A/B Testing on Shopify Stores (+ 9 Shopify Entrepreneurs Share Their A/B Testing Stories With Results)

Convert

In fact, Carreri’s pulse analysis for different industries reveals a common theme—people don’t tend to share insights about their on-site experience. Your open rates are skewed Email numbers are no longer accurate. Mail Privacy Protection (MPP) has made sure of that. A/B Testing vs. Multivariate Testing.

article thumbnail

The Entrepreneurs’ Guide to A/B Testing on Shopify Stores (+ 9 Shopify Entrepreneurs Share Their A/B Testing Stories With Results)

Convert

In fact, Carreri’s pulse analysis for different industries reveals a common theme—people don’t tend to share insights about their on-site experience. Your open rates are skewed Email numbers are no longer accurate. Mail Privacy Protection (MPP) has made sure of that. A/B Testing vs. Multivariate Testing.