{"id":322,"date":"2022-09-01T17:27:06","date_gmt":"2022-09-01T15:27:06","guid":{"rendered":"https:\/\/support.botnation.ai\/a-b-testing-and-machine-learning\/"},"modified":"2026-01-02T15:27:22","modified_gmt":"2026-01-02T14:27:22","slug":"a-b-testing-and-machine-learning","status":"publish","type":"support","link":"https:\/\/botnation.ai\/en\/support\/a-b-testing-and-machine-learning\/","title":{"rendered":"A\/B Testing and Machine Learning"},"content":{"rendered":"<p>With A\/B Testing, measure and optimize your chatbot\u2019s actions<\/p>\n\n\n\n\n\n<h2 class=\"wp-block-heading\">1. What is A\/B Testing<\/h2>\n\n\n\n<p>A\/B testing consists in comparing several versions of an image, a video, a text, a button label in order to verify which one is the most efficient. These variations are presented in linear or random ways to your chatbot users.  <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/08\/Texte_05_UK-1024x604.png.webp\" alt=\"AB Testing\" class=\"wp-image-125\"><\/figure>\n\n\n\n<p>Botnation offers 3 rotation modes:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Linear: <\/strong> the elements rotate in a loop always in the same order. Recommended from 2 elements.<\/li>\n\n\n\n<li><strong>Random<\/strong>: the elements are displayed randomly. Recommended from 3 elements.<\/li>\n\n\n\n<li><strong>AI Optimized<\/strong>: Botnation\u2019s Machine Learning automatically displays the best performing element based on its powerful learning algorithm to maximize your button actions.<\/li>\n<\/ul>\n\n\n\n<p>A real-time statistical analysis allows you to see the effectiveness of the different versions according to the rate of clicks on actions (buttons). In other words, you can check which version triggers the most clicks, subscriptions, purchases, etc. The results then help determine the best strategy to adopt.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/09\/image-33.png.webp\" alt=\"\" class=\"wp-image-326\"><\/figure>\n<\/div>\n\n\n<p>In this example we see that :  <\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>the menu has been displayed 10 times in your chatbot<\/li>\n\n\n\n<li>the buttons were clicked 6 times (so in 60% of the cases)<\/li>\n\n\n\n<li>the \u201cChoice 1\u201d button was clicked in 10% of the cases<\/li>\n\n\n\n<li>the \u201cChoice 2\u201d button was clicked in 50% of the cases<\/li>\n<\/ul>\n\n\n\n<p>So we can easily deduce that the \u201cChoice 2\u201d button has a much better performance than the first button, it would deserve to be more prominent or the first button would deserve a new and more \u201ccatchy\u201d title.<br><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">2. Which elements to use in A\/B testing?<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The texts<\/li>\n\n\n\n<li>The images<\/li>\n\n\n\n<li>The videos<\/li>\n\n\n\n<li>and especially the wording of the buttons and quick replies, because these are the ones that allow you to measure the action rate.<\/li>\n<\/ul>\n\n\n\n<p>However, Botnation\u2019s A\/B testing allows you to test a much larger number of combinations, for which you need to couple the AB testing statistics to the rotations.<br><br>Rotations allow you to add several elements of the same type (text, image, video, etc.) in alternation. Depending on the type of rotation (linear, random or automatically optimized), Botnation will choose one of the elements to send to the user of your chatbot.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/09\/image-35.png.webp\" alt=\"\" class=\"wp-image-331\"><figcaption class=\"wp-element-caption\">Example of statistics of a linear rotation on 2 versions of a menu<\/figcaption><\/figure>\n<\/div>\n\n\n<p>In this example we see that:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Botnation will display every second version of this menu linearly<\/li>\n\n\n\n<li>That the first version always generates 60% of actions (clicks) on the buttons<\/li>\n\n\n\n<li>That the second version generates 75% of shares!<\/li>\n\n\n\n<li>That the wording \u201cThis way\u201d of the first button of the second version also generates 50 actions<\/li>\n<\/ul>\n\n\n\n<p>We can therefore conclude that a 3rd version integrating the wording \u201cThis way\u201d on the first button and the wording \u201cChoice 2\u201d on the second button would eventually generate many more actions.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/09\/image-36.png.webp\" alt=\"\" class=\"wp-image-333\"><\/figure>\n<\/div>\n\n\n<p>And indeed it is confirmed this 3rd version of the menu now generates 88% of actions on the buttons thanks to an optimization linked to Botnation\u2019s real time A\/B testing statistics and the possibility to rotate several elements.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">3. Take advantage of Machine Learning on your A\/B Testing<\/h2>\n\n\n\n<p>Botnation\u2019s Machine Learning automatically displays the best performing item based on its powerful learning algorithm to maximize your button actions.<br><br>The AI Optimizer will <strong>prioritize<\/strong> the version that triggers the most clicks, subscriptions, purchases, etc\u2026 The Optimizer determines in real time the <strong>best strategy<\/strong> to adopt instead of selecting an element at random.<\/p>\n\n\n\n<p>To do this, simply activate the \u201cOptimized\u201d option in the rotation of your elements.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/09\/image-192.png.webp\" alt=\"\" class=\"wp-image-6349\"><\/figure>\n<\/div>\n\n\n<p> <strong>BOTNATION<\/strong> \u2018s goal is to help you make your chatbot more efficient. The<strong>AI Optimizer<\/strong> will be efficient from the first second because it has already trained on the most popular chatbots made on Botnation having generated more than 50 Million clicks on action buttons!<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"300\" height=\"204\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/09\/image-39.png.webp\" alt=\"\" class=\"wp-image-344\"><\/figure>\n<\/div>\n\n\n<p>So feel free to create many variations of your Buttons, Quickreplies, and Carousels elements.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">4. Reset A\/B Testing<\/h2>\n\n\n\n<p>Once your measurements are saved, you may need to reset them. For example, if you completely change your chatbot after the first few returns, the old results may no longer be relevant.<\/p>\n\n\n\n<p>In this case, go to Settings then Advanced Settings, at the bottom right, the block \u201cReset AB testing\u201d allows you to reset the counters to zero. To do this, click on \u201cPermanently delete AB Testing data\u201d.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/botnation.ai\/wp-content\/uploads\/2022\/09\/image-37-1024x310.png.webp\" alt=\"\" class=\"wp-image-335\" style=\"width:617px;height:186px\"><\/figure>\n<\/div>\n\n\n<p>\u26a0\ufe0f Beware, this is irreversible!<\/p>\n\n\n\n<p><strong>We wish you good optimizations of your chatbot on Botnation!  <\/strong><\/p>\n\n\n","protected":false},"featured_media":0,"template":"","meta":{"_acf_changed":false},"categorie-support":[194,221],"class_list":["post-322","support","type-support","status-publish","hentry","categorie-support-features","categorie-support-web-chatbot-en"],"acf":[],"_links":{"self":[{"href":"https:\/\/botnation.ai\/en\/wp-json\/wp\/v2\/support\/322","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/botnation.ai\/en\/wp-json\/wp\/v2\/support"}],"about":[{"href":"https:\/\/botnation.ai\/en\/wp-json\/wp\/v2\/types\/support"}],"wp:attachment":[{"href":"https:\/\/botnation.ai\/en\/wp-json\/wp\/v2\/media?parent=322"}],"wp:term":[{"taxonomy":"categorie-support","embeddable":true,"href":"https:\/\/botnation.ai\/en\/wp-json\/wp\/v2\/categorie-support?post=322"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}