SearchPilot: promoting an H2 to H1 lifted organic traffic 4.5%

Whether an H1 outranks the same words wrapped in an H2 is one of the oldest arguments in on-page SEO, and most of it is opinion. SearchPilot, a controlled SEO A/B-testing company, ran an actual split test that changed only the tag: a travel company’s listing pages had their top heading promoted from an H2 to an H1, with the visible text, position and everything else on the page held constant. SearchPilot’s own published case study, not our analysis, is the source here.

What was tested and what SearchPilot found#

The client’s listing pages had no true H1: the top heading on the page was marked up as an H2. SearchPilot’s variant group had that heading promoted to an H1; the control group kept it as an H2. The hypothesis, per SearchPilot’s own case study, was that “updating the first heading to an H1 would help search engines better understand the page structure, align with SEO best practices, and improve organic traffic by boosting relevance and rankings.”

An earlier run of this same test, on a small subset of the client’s pages, did not produce a clear enough result to act on. SearchPilot reran it on roughly four times as many pages in the same template, and that second test came back as a statistically significant positive result: a 4.5% increase in organic traffic, which SearchPilot estimated at around 3,000 additional monthly sessions once the change was rolled out site-wide. The case study does not publish a confidence level, credible interval or the calendar dates either run of the test covered.

Why the heading tag itself is not a documented ranking factor#

Google’s own SEO Starter Guide addresses this directly, and it does not agree with the hypothesis SearchPilot’s client set out to test. On heading order and count, Google states plainly that “having your headings in semantic order is fantastic for screen readers, but from Google Search perspective, it doesn’t matter if you’re using them out of order.” That is Google’s documented position on heading structure and rankings: a matter of accessibility and readability, not a signal search ranks pages on.

That leaves a real gap between what SearchPilot measured and why it happened. The 4.5% traffic increase is a controlled, statistically significant result; the mechanism behind it is not established by either SearchPilot’s case study or Google’s own documentation. A page that gains a correctly-tagged H1 also stops having a heading-structure defect, a missing top-level heading, that could plausibly affect how templates, snippets or other on-page elements render, independent of any ranking algorithm reading the tag name itself. SearchPilot does not make that claim either; this piece is not filling in a mechanism neither of them has stated.

Why a controlled split test outweighs a tag-name opinion#

Every other split test we’ve covered from SearchPilot shares the same design: a control group and a variant group running at the same time, on the same site, so the comparison isolates one change from the seasonal and algorithmic noise a before-and-after read cannot separate out. Our coverage of SearchPilot’s breadcrumb link test found a markup mismatch that cost traffic; our coverage of SearchPilot’s FAQ content test found a content addition that gained traffic while a schema-only change did nothing. This test adds a third data point in the same series: a single tag change, isolated from everything else on the page, moved traffic in a travel client’s real production environment.

Why we care#

An H2-to-H1 swap is one of the cheapest changes a site can make, and this case study gives it a real, measured result rather than a plausible-sounding rule. What it does not give is a reason to treat H1 as a ranking lever in general: Google’s own documentation says heading order doesn’t matter to Search, and SearchPilot’s case study describes one page template that lacked a true H1 in the first place. The honest takeaway is narrower than “always use H1”: check whether your top-level heading is actually marked up as one, and treat a missing H1 as a structural defect worth fixing, not because the tag name itself ranks, but because SearchPilot has now measured a real site where fixing it correlated with a real traffic gain.