A/B Testing API

Every test, with its results so far and its languages, and the tests started this month against the plan's limit

A new test, as a draft. Without versions: the original and one copy, half each; without a goal: a form sent

Name, page, versions, goal. While it runs only the name: anything else would mix results

Starts the test; a stopped one starts a new run that counts from zero

The winner: the test stops and every visitor gets this version from now on

The test's texts per language (#1056): ab-testing/{slug}/i18n/{lang}.json, the only place they live. A visitor gets their language's value of a change, else the project's language's (fallback_language), else the one in test.json

One language's texts, written whole and committed: versions {key: [{selector, set, value}]}, each the value of that version's change with the same selector and set. Not while the test runs (the results would mix)

Removes one language: its visitors get the project's language again. Not while the test runs

The edit link of the visual editor: the test's page on its website with #wm-ab-edit=<token>. The tracking code there opens the editor; the token (signed, 2 hours, not stored) lets it read and save this test only. page: a path on the WEMASY website (default: the test's page), or a full link to a page of another website that may run the tests

Which elements selectors find on a page (the AI's page check): for the onboarding's quick starts, the page's main heading and button. page: a path on the WEMASY website, or a full link to a website that may run the tests. Reads the HTML as the server sends it

The websites that may run the tests (ab-testing/settings.json); [] = any website with the code

The tests for a page: running ones with their versions and weights (the visitor's browser picks one and keeps it), and finished ones with a winner (everyone gets the winner, nothing is counted)

`language`: the visitor's (the tracking code's window.wemasy.language: the signed-in user's, data-lang, <html lang>). Each change comes with its value in that language when the test has one (ab-testing/{slug}/i18n/, #1056), else in the project's language, else as in test.json; a test that used such texts says which language (`language`). A language that is not a language code counts as none (never a refusal: the tests run).

A visitor saw a version (exposure) or reached the goal (conversion). Once per visitor and run; a conversion counts for the version the visitor saw, and only after an exposure

The visual editor on the website (#wm-ab-edit=<token> in the page's address): the test to edit, the dashboard language and the way back. The token is the login here: signed, short-lived, for this one test

The visual editor saves: the versions and the goal, validated and written like the dashboard's edit (the test file, committed). A running test cannot change