Shogun ‑ AB Testing
Maximize Profits with Smarter A/B Testing: Themes, Templates, Pages, Prices, Shipping and More.
#618 of 1,236 in Marketing and conversion · Site Optimization
- Rating
- 4.3 from 42 reviews
- Rating from stores in the top 100k
- 4.5
- On Shopify since
- 2025
- Seen on
- 2,082+ stores
What merchants say
Read all 49 with sourcesEvery review carries the store that wrote it and how big that store is, and 7 of them are complaints you can read in full.
- 5★2026-08-13
Very quickly responded and helped in a great way. Also the app improvements show every KPI you need, with a lot of filters to filter on what actually works.
HeatHoody · outside the top 100k
- 5★2026-08-04
Amazing app, good to do A/B test. Very easy to understand the metrics and setup tests
Mirlux · outside the top 100k
- 5★2026-08-04
This app has been super useful for theme & template testing for us! The support team is very responsive and helpful when troubleshooting issues, a great team to work with!
Skipper · top 100k store
- 5★2026-07-30
We've had a great experience using Shogun's A/B Testing app as part of a major website refresh and optimization initiative for IGK Hair. Rather than relying on assumptions, we were able to test multiple PDP layouts, content hierarchies, and merchandising strategies with real customer traffic to understand what truly resonated with our shoppers. The insights we gained were instrumental in shaping our rebuild and gave us the confidence to make data-driven decisions throughout the redesign process. The platform was easy to implement, the testing experience was seamless, and the reporting made it simple to identify winning experiences. If you're planning a website redesign or looking to optimize your PDPs, we highly recommend Shogun A/B Testing. It's been a valuable part of our CRO toolkit and helped us launch a stronger, more customer-centric shopping experience.
IGK Hair · top 10k store
- 5★2026-07-24
This app already helped us a lot with optimizing our CRO! The dashboard works easy and intuitive and gives us insights we didn't have before.
Tiny Library · outside the top 100k
- 1★2026-07-07
WORST APP EVER - MY PRODUCT PHOTOS LAGGED AND DID NOT WORK / THE PRICE EVEN AFTER UN INSTALLING KEPT CHANGING . Subject: Re: Toothy - pricing test issue Hi Sweetan, Thanks for looking into this. Before reinstalling or sharing collaborator access, I want to share what I've found on my end, because I think it points to the actual cause. After uninstalling Shogun, I found that Shogun had written code directly into my theme files rather than only using app embeds/blocks. Specifically: 1. A snippet called `snippets/product-media-gallery.liquid` had Shogun-authored Liquid code reading from metafields under the `app--214825828353` namespace (`product-pricing`, `product-variant-pricing`, `test-media-1` through `test-media-4`). This code used `{% paginate %}` on values that aren't valid paginateable objects, which caused a "Liquid error: Array is not paginateable" on my live product pages. 2. Separately, I found a file called `snippets/shogun-optimizer.liquid`, labeled in its own comments as "Auto-generated by Shogun-AB." This file contains embedded, minified JavaScript that appears to run content-type detection across templates and includes a `cartCreate` GraphQL mutation. This file was still present and apparently still active on my storefront after I had already uninstalled the app. 3. The pricing metafields under `app--214825828353` also still exist on my products, since metafields persist independently of whether the app is installed. This is very likely why the price kept changing even after uninstall — the leftover Liquid/JS was still reading that stored data. Given this, before I reinstall anything or share collaborator access, I'd like to understand: - Does reinstalling the app actually remove or replace `shogun-optimizer.liquid` and the leftover metafields, or does it just resume using them? - Is there a clean uninstall process that removes all injected snippets and metafields, rather than leaving them orphaned in the theme? - Can you confirm whether the `cartCreate` mutation in that script ever affects the price actually charged at checkout, separate from what's displayed on the page? I want to be sure no customers were charged incorrectly during the test. I'd rather resolve this by removing the leftover code and metafields directly, since I already have a good picture of what was left behind. If there's a specific reason full collaborator access is necessary beyond what I've described above, let me know and I'm happy to discuss it further. Thanks,
Toothy · outside the top 100k
- 1★2026-06-23
it f*cked up a live theme. Now I have to figure out what to do in the middle of the day while traffic enter the broken theme.
Overlott · outside the top 100k
- 5★2026-05-25
AMAZING
Purify Detox · outside the top 100k
- 1★2026-05-24
Shogun A/B testing is really poor and full of bugs. My store theme got unpublished without notice. It publish duplicated theme that created month ago. Now my entire store is messed up. This kind of sneaky conduct has caused me order losses. I paid $119 for the service, but the product detail testing function fails to work. I cannot even edit and adjust product descriptions normally.
BlueV8 · outside the top 100k
- 1★2026-05-18
Doesnt allocate traffic evenly, sending 3/4 bos to A, leading to unusable test results. Support team published a theme without our approval
Snakehive · top 100k store
Read all 49 with sources – and filter them to the complaints, the recent ones, or the stores big enough to matter.
Work on Shogun ‑ AB Testing?
Any amount puts this listing above the review-data order, on the board and in Marketing and conversion. Every amount and every click is printed in public. Paying also opens a private page for this listing – that is where the badge for your site, the share card and your deal live. Everything you can do here, including what money cannot buy and how to get this listing corrected or taken down.
Not ready to pay for anything? Take the badge – it shows this listing’s live rank on your own site, it is free, and it always was.
Claiming is free and it shows: the listing turns gold in every list – the same highlight a paid card carries – with a Claimed badge, in the exact place its reviews put it. It also earns the only followed link on this site: a claimed listing that has paid nothing links to its own website dofollow – a paid placement never does, because a link that was paid for is an ad. Claiming moves nothing.
See the whole board · How ranking works · Rules – we remove listings on request, paid or not.