SwipeFile Signup A/B Split Test
So this is an A/B Split test we did 3 weeks ago on SwipeFile.com to test a totally different style of signup form.
I was trying to make a better version of this signup form that was converting at a site-wide 1.1% (it would shoot up to 3.5% on certain days):
The contenders for overtaking the control were these four:
We ran the tests over 3 weeks and here's what came back:
So all four variations performed WORSE than the control.
So the winner was....the exact same thing we had already:
So we are going to test this again...I actually think we might even use some wild ChatGPT remixes of this to see if it works, like this 1980's looking version of the same form, like this!
Image Description
The image showcases the A/B test data for signup forms on SwipeFile.com. It includes a performance table and four variations of signup forms (A, B, C, D), each with their respective conversion rate changes compared to the control. The control form is marked as the winner with a conversion rate of 1.11%.
Positive Aspects
The image effectively illustrates the results of the A/B test, clearly showing how each variant performed against the control. The use of bold colors and simple layout makes it easy to quickly grasp the key data points, emphasizing the unexpected outcome where the original design outperformed all new variations.
Key Takeaways
- The original signup form, despite attempts to improve it, outperformed all new variations with a conversion rate of 1.11%.
- All four tested variations (A, B, C, D) resulted in lower conversion rates, with D performing the worst at -50.64%.
- The experiment highlights the importance of testing assumptions, as sometimes the existing solution is more effective than new ideas.
Additional Insights
Experimentation is crucial, but it doesn’t always lead to the expected results. This test serves as a reminder that improvements are not always linear or predictable. Embracing creativity, like trying out a "1980's looking version," can lead to surprising insights or uncover new opportunities for engagement. Sometimes, the best ideas come from unexpected places, even if they don't initially seem viable.
