Starting Your First Test

Launching your first A/B test is designed to be simple, even if you’ve never run one before. Within the app, you’ll choose a page or template you want to experiment with, which might be a product page, a collection page, or even your homepage. When you create a test, Shogun will automatically generate a copy of that page as Variant B, so you can start making changes without affecting the original.

With Split URL tests and theme tests, you pair two existing assets against each other.

How to create variants in the Shopify editor

You’ll use Shopify’s native visual editor to modify Variant B. This might involve tweaking copy, changing the layout, updating images, or adjusting sections. The editing experience will feel familiar if you’ve built or customized pages in Shopify before, and you can preview your changes at any time before launching the test.

Naming tests and setting goals

Each test can be given a custom name to help you stay organized, especially when running multiple tests simultaneously. You’ll also define a test goal, such as increasing add-to-cart clicks, boosting sales, or enhancing the average order value. Shogun uses this goal to measure performance and recommend a winner when the test concludes.

Defining traffic splits and audience segments

Before going live, you’ll decide how to split traffic between your variants. Many users start with a 50/50 split, but you can adjust this as needed. If you want to get more specific, you can also set up audience segments to target certain device types, countries, or traffic sources. Once everything is set, you’re ready to publish your test and start collecting results.