Advanced Features
Shogun’s A/B testing toolkit includes powerful features for more experienced teams, whether you're scaling experimentation across a growing storefront or want more control over how tests are run, interpreted, and shared. These advanced tools help deepen insights, streamline teamwork, and enhance internal communication.
Add notes to tests
You can now leave freeform notes directly within your test dashboard, whether you want to log your hypothesis, jot down early observations, or leave context for a teammate. Notes live with the test for easy visibility across your team and can be updated at any time.
It’s a simple way to keep track of what you’re testing and why, especially helpful if you're running many experiments in parallel or revisiting older tests during quarterly reviews.
Advanced analytics
To help you learn more from your results, we've expanded analytics beyond just revenue and conversion rate. In addition to total sales per variant, you can now see which specific products were purchased during a test. This provides you with a deeper insight into how your variant is influencing shopper behavior, not just whether it's converting more, but also what customers are choosing to buy.
It’s a helpful way to understand second-order effects. For example, did the layout change lead customers to explore other product categories? Did a trust badge increase confidence in higher-ticket items? Advanced analytics enable you to move beyond surface-level metrics and gain actionable insights.
Advanced goals
Shogun supports tracking multiple types of goals beyond simple conversions. You can set goals such as form submissions, revenue per visitor, and average order value to measure different aspects of how your variants perform.
This flexibility lets you choose the best metric for your test’s purpose. For example, a lead generation page might focus on form submissions, while a product page could track revenue per visitor or average order value. You still select a primary goal to determine the test winner, but having these advanced goals available provides richer insights into customer behavior and business impact.
Custom event
Some brands want to optimize for goals that aren’t supported by default, like clicks on specific buttons or form submissions from third-party tools. The Custom Event feature lets you track any interaction on your page by adding custom JavaScript to your Shopify theme.
For further details on setting up a test for this, please refer to the article linked below.
Audiences
Targeting the right shoppers can be just as important as the test itself. With Shogun, you can define audiences based on device type, country, traffic source, or UTM parameters, giving you tighter control over who sees your variants.
Use this when running campaign-specific tests, experimenting with mobile-first designs, or segmenting by acquisition channel. For instance, you might test a new landing page that only shows to visitors from paid ads, or try out a different navigation for mobile users without affecting desktop traffic.
Access to a shared Slack channel
For teams on enhanced support plans, we offer a private, shared Slack channel where you can chat directly with Shogun’s product and support team. This space is ideal for asking implementation questions, discussing strategy, or flagging unusual test behavior in real-time, without needing to create tickets or start email threads.
Something missing that you need? You can reach out to us at any time via email or live chat by using the prompts located at the bottom of the dashboard in-app.