Editing Active Tests

Running an A/B test doesn’t mean you’re locked in. Shogun enables you to make changes safely while your test is live, with features designed to maintain data quality while providing your team with flexibility and visibility.

Editing active tests

If you spot a mistake or need to make a minor tweak, you can edit a test while it’s running. However, avoid making significant layout changes during the test, as this can compromise the validity of your results. If a change is substantial, consider restarting the test for cleaner data.

Timeline view for team visibility

To support teams with multiple collaborators, the test dashboard includes a timeline view that shows key actions over time, including who created, published, paused, resumed, or completed a test, along with the corresponding timestamps. This makes it easier to diagnose changes, track ownership, and understand the sequence of events throughout a test’s lifecycle.

Pause and resume functionality

You can now pause a running test without ending it entirely. This is useful if you want to stop data collection during sales events, make edits, or temporarily hold the test due to campaign changes. When you’re ready, resume the test; all data collected before the pause is preserved, and no new test needs to be created.

Tips for test duration and frequency

Run tests long enough to reach statistical significance, but avoid overlapping too many tests at once, especially on the same pages or templates.

If you're testing frequently, keep notes or use consistent naming conventions so you can easily track what has been tried and what has worked.