What is Googlebot?
Definition
Googlebot is Google's automated web crawling program (spider/bot). It follows links across the web to discover and revisit pages, feeding new content into Google's index. There are multiple Googlebot variants: Googlebot for desktop, Googlebot Smartphone (primary crawler since mobile-first indexing), and specialist bots for images, videos, and news.
Why Googlebot matters for Shopify stores
Since Google uses mobile-first indexing, Googlebot Smartphone is the primary crawler: it renders your Shopify store as a mobile browser would. If your mobile site hides content that's visible on desktop, Googlebot won't see it. All SEO improvements must be visible on mobile to count.
Shopify example
A Shopify store uses an accordion to hide product specifications on mobile (collapsed by default). Googlebot Smartphone renders the page and sees the collapsed content, but since the text isn't visible, it receives lower weighting in Google's quality assessment.
How Sauron handles Googlebot
Sauron runs Lighthouse in mobile mode by default (matching Googlebot Smartphone's perspective), so performance scores reflect what actually matters for rankings, not just desktop experience.
Common mistakes
- ✕ Blocking Googlebot in robots.txt to 'control' crawling: this blocks indexation entirely
- ✕ Assuming desktop experience is what Google crawls: it's mobile-first since 2019
- ✕ Using dynamic rendering to show different content to Googlebot vs real users: cloaking violation
- ✕ Not checking if JavaScript-rendered content is visible to Googlebot via URL Inspection
Related terms
Automate your Shopify SEO
Understanding Googlebot is step one. Sauron handles the implementation, automatically, for your entire Shopify store.