The recent volcanic engine Data Tester, which drew on the MAB’s intelligent experimental function, is expected to help the business team maximize the benefits through smart, automated A/B experiments.

On the R&D road of the A/B Experimental Platform, Volcanic engine Data Tester has been at the forefront of the industry and has been exploring intelligent experiments in practice outside the conventional A/B experiment. This new functional MAB smart transfer experiment (Multi-Armed Bandit) is a type of experiment that can adjust the distribution of flows among the different pilot groups in the experiment in the light of current empirical data.

Traditional A/B experiments rely on a statistically significant classical hypothetical test, distributing the corresponding flow for the comparison and the experimental version, but during the experiment it was not possible to alter the flow of each sub-text. This type of experiment would therefore require a dedicated pre-retention cycle (at least seven days), with sufficient samples to enter the experiment and without any change after the commencement of the experiment, in order to arrive at a significant result. In contrast, MAB’s intelligent experiments on volcanic engine Data Tester have overcome the above-mentioned limitations of traditional A/B experiments with special application advantages in several scenarios.

The MAB experiment can also serve as an advantage of the A/B experiment in the light of a cold-start and low-flow scenario. A major problem for the start-up company, or during the cold start-up of the product, activity, is that there is insufficient flow for experimentation. However, the MAB experiment, which is based on the movement of performance of the current indicator, enables maximization of benefits through A/B experiment in the form of a modest overall flow.

With the data Tester MAB experiment, short-cycle activities can be optimized on the same basis as A/B experiment. A large part of the operation of the activity is a shorter activity, for example, the duration of many of the telecommuting activities is only 1-3 days, and if restricted to traditional A/B experiments, only seven days of experimental traffic can be used in short-cycle activities. Data Tester MAB experiment, on the other hand, because the core objective of the experiment is to maximize the benefits of the activity as a whole rather than to help users find the best data sets, does not require a time frame for the experiment and short-cycle activities can be optimized by A/B experiment.

In promoting the transformation of high-value flows, MAB smart transfer experiments can be accelerated. The cost of each conversion opportunity is high for some high-price commodities, such as vehicles, diamonds, etc. If the traditional A/B experiment is used, a portion of the pre-test flow will be lost in the course of obtaining a statistically significant programme, but the MAB experiment will be able to make a dynamic shift based on real-time data in the process and reduce the opportunity for transformation in the experiment.

In addition, some specific scenarios, such as A/B experiment optimization tests involving the title of App, abbreviations, video content, etc., require that they receive the largest number of hits during short window periods, but are limited to the weak real-time nature of traditional A/B experiments and are difficult to apply for optimization. Volcanic engine Data Tester MAB, on the other hand, can search for the transformative effects of the various versions in a short cycle, with half an hour receiving updated data feedback.

Data Tester is a product under the guise of volcano engines, which provides a scientific basis for decision-making for various sectors, such as demand for proposals, advertisements, search, UI, product functions, etc., for business growth, transformation, product healing and operational effectiveness.

It is understood that the volcanic engine Data Tester is currently carrying out a 30-day free-of-charge experiment, and that the user is open without business certification as long as it applies for a probationary appointment on the volcanic engine A/B network.