What is Googlebot?
Definition
Googlebot is Google's automated web crawling program (spider/bot). It follows links across the web to discover and revisit pages, feeding new content into Google's index. There are multiple Googlebot variants: Googlebot for desktop, Googlebot Smartphone (primary crawler since mobile-first indexing), and specialist bots for images, videos, and news.
Why Googlebot matters for Shopify stores
Since Google uses mobile-first indexing, Googlebot Smartphone is the primary crawler — it renders your Shopify store as a mobile browser would. If your mobile site hides content that's visible on desktop, Googlebot won't see it. All SEO improvements must be visible on mobile to count.
Shopify example
A Shopify store uses an accordion to hide product specifications on mobile (collapsed by default). Googlebot Smartphone renders the page and sees the collapsed content — but since the text isn't visible, it receives lower weighting in Google's quality assessment.
How Sauron handles Googlebot
Sauron runs Lighthouse in mobile mode by default (matching Googlebot Smartphone's perspective) — so performance scores reflect what actually matters for rankings, not just desktop experience.
See Product SEO on Autopilot feature →Common mistakes
- ✕ Blocking Googlebot in robots.txt to 'control' crawling — this blocks indexation entirely
- ✕ Assuming desktop experience is what Google crawls — it's mobile-first since 2019
- ✕ Using dynamic rendering to show different content to Googlebot vs real users — cloaking violation
- ✕ Not checking if JavaScript-rendered content is visible to Googlebot via URL Inspection
Related terms
Automate your Shopify SEO
Understanding Googlebot is step one. Sauron handles the implementation — automatically, for your entire Shopify store.