We have our own A/B test software which works this way:
- Every time a user visits a page with a test, he gets a cookie marker.
- For variant A in test one it may look like this: test1_a
- For test 2 and variant b: test2_b etc.
- Once a user makes a purchase, it is written to the A/B panel for the test connected to the marker. For example, if user had the "test1_a" marker, the Variant A in the test 1 will get +1 conversion once a user purchases something.
If we run different tests on a website at once, a user gets multiple markers if he visits different test pages, like:
test1_a, test2_b, etc
After that if user makes a purchase, our A/B software will make +1 sale to EACH test, so
- +1 sale for varian A in Test 1
- +1 sale for varian B in Test 2 etc
Is it correct to provide A/B testing using this way?
Note: this is different from providing a multivariative testing on the same page- it is about testing completely different pages of the website at once, taking into account a user may visit all of them.