Enterprise E-commerce Brand Recovers 45% Lost Crawl Budget
Forensic log file analysis and Core Web Vitals remediation eliminated indexation waste across 2.4M URLs, reclaiming 45% of crawl budget and lifting revenue 28%.
The complex problem.
A 2.4M-URL catalogue was producing severe crawl waste: Googlebot was spending 45% of daily crawl on faceted filter URLs, internal search pages, and parameter variants that should never have been indexable.
Core Web Vitals were failing across 71% of templates — LCP averaging 4.8s on category pages — driving both ranking decay and conversion drop after the March CWV core update.
Three competing agencies had layered noindex tags, robots.txt rules, and rel=canonical patches on top of each other, leaving Google with contradictory signals and indexation oscillating week to week.
The execution framework.
Log File Forensics
Parsed 180M server log lines across 90 days to map exactly how Googlebot allocated crawl. Identified 1.1M low-value URLs absorbing 45% of crawl with zero ranking contribution.
Faceted Navigation Engineering
Replaced the patchwork of noindex/canonical signals with a code-level solution: parameter handling at the routing layer, indexable facets defined by business value, and dead facets returning a clean 410.
Core Web Vitals Remediation
Edge-level image optimisation, render-blocking resource removal, and layout-shift fixes shipped via dev-ready tickets. LCP P75 moved from 4.8s to 1.9s across category templates.
Schema & Internal Linking
Product, breadcrumb, and aggregate-rating schema rebuilt for rich-result eligibility. Internal linking restructured to flow authority to commercial taxonomy nodes.
Hard metrics, measured.
"We had three years of patched-over technical debt. They diagnosed it in two weeks, shipped fixes our engineers could actually merge, and the revenue lift hit before the contract did."
Build your version of this result.
Book a strategy call — we'll scope the exact engineering and authority plan your business needs.