As it’s going to be the real time test but in controlled environment, one needs to select the subscriber segment mindfully. The idea is to make it sure that the sufficient number of subscribers has received the test, and you have observed enough evidence to evaluate the better performing campaign. If you have tested it across a smaller segment of subscribers, you may not be able to achieve the optimum results, when sending it to large scale list.
Marketers believe that one should be having a clear target to achieve from the A/B test, and the experiment should end up with a clear conclusion. And for that the key is you need to avoid testing the heap of multiple variables in one test. Like, if you want to test which subject line can guarantee more open rates, stick to the subject line only, don’t try to test other variables in one go, like time, welcome note, content from name etc.
Split testing tool within Mumara has introduced some really great functionality to conduct more controlled test, and easily select the percentage of subscribers to receive the test email. Moreover, after Mumara concludes the test and evaluates the results, you can direct the system to automatically send the better performing campaign to the remaining number of subscribers in your list.
Like keeping the above mentioned example of 25% out of 100,000 subscribers in mind, if majority of the subscribers who received the tests have opened the “A” version of campaign more than the “B” version, system will automatically send the better performing version to the rest of your list (75%). However, it isn’t the only way to conduct the test and send to better performing campaign. If you want to manually send the better performing camping after the evaluation, select the option to show the results.