INGDG

Googlebot (Google)

Classic search · Current version 2.1

What it is

Googlebot is the crawler behind Google Search, with a smartphone and a desktop variant. Blocking it stops Google Search from crawling your pages. Using your content for Gemini training is controlled separately, with the Google-Extended token.

Official documentation: developers.google.com · checked 13 Nov 2026

Googlebot user agent

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Googlebot/2.1 (+http://www.google.com/bot.html)

Official documentation: developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers · checked 13 Nov 2026

Block or allow Googlebot in robots.txt

Put these lines at the top of the robots.txt file in your site’s root (example.com/robots.txt). Each subdomain needs its own file.

Block Googlebot from the whole site
User-agent: Googlebot
Disallow: /
Block Google’s training, stay in its search
User-agent: Google-Extended
Disallow: /

Closes Google-Extended. Googlebot stay under your general rules, so your pages can still appear in answers and results.

Allow Googlebot
User-agent: Googlebot
Allow: /
# repeat here the Disallow lines of your User-agent: * group

If Googlebot is not named in robots.txt, it already follows your User-agent: * rules, so you don’t need anything. A group of its own replaces the * group for this bot entirely: if you add one, repeat your general Disallow lines in it.

Googlebot IP ranges

developers.google.com/static/crawling/ipranges/common-crawlers.json

Official list: 317 ranges · published by the owner 12 Nov 2026 · we checked it 13 Nov 2026

Google publishes one list for all its common crawlers, Googlebot included.

Check an IP from your logs

The owner also documents a DNS check: the reverse lookup of the IP must give a host name ending in googlebot.com, and the forward lookup of that name must return the same IP. Official documentation

Show all 317
  • 34.22.85.0/27
  • 34.64.82.64/28
  • 34.65.242.112/28
  • 34.80.50.80/28
  • 34.88.194.0/28
  • 34.89.10.80/28
  • 34.89.198.80/28
  • 34.96.162.48/28
  • 34.100.182.96/28
  • 34.101.50.144/28
  • 34.118.66.0/28
  • 34.118.254.0/28
  • 34.126.178.96/28
  • 34.146.150.144/28
  • 34.147.110.144/28
  • 34.151.74.144/28
  • 34.152.50.64/28
  • 34.154.114.144/28
  • 34.155.98.32/28
  • 34.165.18.176/28
  • 34.175.160.64/28
  • 34.176.130.16/28
  • 35.247.243.240/28
  • 66.249.64.0/27
  • 66.249.64.32/27
  • 66.249.64.64/27
  • 66.249.64.96/27
  • 66.249.64.128/27
  • 66.249.64.160/27
  • 66.249.64.192/27
  • 66.249.64.224/27
  • 66.249.65.0/27
  • 66.249.65.32/27
  • 66.249.65.64/27
  • 66.249.65.96/27
  • 66.249.65.128/27
  • 66.249.65.160/27
  • 66.249.65.192/27
  • 66.249.65.224/27
  • 66.249.66.0/27
  • 66.249.66.32/27
  • 66.249.66.64/27
  • 66.249.66.96/27
  • 66.249.66.128/27
  • 66.249.66.160/27
  • 66.249.66.192/27
  • 66.249.66.224/27
  • 66.249.67.0/27
  • 66.249.67.32/27
  • 66.249.67.64/27
  • 66.249.68.0/27
  • 66.249.68.32/27
  • 66.249.68.64/27
  • 66.249.68.96/27
  • 66.249.68.128/27
  • 66.249.68.160/27
  • 66.249.68.192/27
  • 66.249.68.224/27
  • 66.249.69.0/27
  • 66.249.69.32/27
  • 66.249.69.64/27
  • 66.249.69.96/27
  • 66.249.69.128/27
  • 66.249.69.160/27
  • 66.249.69.192/27
  • 66.249.69.224/27
  • 66.249.70.0/27
  • 66.249.70.32/27
  • 66.249.70.64/27
  • 66.249.70.96/27
  • 66.249.70.128/27
  • 66.249.70.160/27
  • 66.249.70.192/27
  • 66.249.70.224/27
  • 66.249.71.0/27
  • 66.249.71.32/27
  • 66.249.71.64/27
  • 66.249.71.96/27
  • 66.249.71.128/27
  • 66.249.71.160/27
  • 66.249.71.192/27
  • 66.249.71.224/27
  • 66.249.72.0/27
  • 66.249.72.32/27
  • 66.249.72.64/27
  • 66.249.72.96/27
  • 66.249.72.128/27
  • 66.249.72.160/27
  • 66.249.72.192/27
  • 66.249.72.224/27
  • 66.249.73.0/27
  • 66.249.73.32/27
  • 66.249.73.64/27
  • 66.249.73.96/27
  • 66.249.73.128/27
  • 66.249.73.160/27
  • 66.249.73.192/27
  • 66.249.73.224/27
  • 66.249.74.0/27
  • 66.249.74.32/27
  • 66.249.74.64/27
  • 66.249.74.96/27
  • 66.249.74.128/27
  • 66.249.74.160/27
  • 66.249.74.192/27
  • 66.249.74.224/27
  • 66.249.75.0/27
  • 66.249.75.32/27
  • 66.249.75.64/27
  • 66.249.75.96/27
  • 66.249.75.128/27
  • 66.249.75.160/27
  • 66.249.75.192/27
  • 66.249.75.224/27
  • 66.249.76.0/27
  • 66.249.76.32/27
  • 66.249.76.64/27
  • 66.249.76.96/27
  • 66.249.76.128/27
  • 66.249.76.160/27
  • 66.249.76.192/27
  • 66.249.76.224/27
  • 66.249.77.0/27
  • 66.249.77.32/27
  • 66.249.77.64/27
  • 66.249.77.96/27
  • 66.249.77.128/27
  • 66.249.77.160/27
  • 66.249.77.192/27
  • 66.249.77.224/27
  • 66.249.78.0/27
  • 66.249.78.32/27
  • 66.249.78.64/27
  • 66.249.78.96/27
  • 66.249.78.128/27
  • 66.249.78.160/27
  • 66.249.78.192/27
  • 66.249.78.224/27
  • 66.249.79.0/27
  • 66.249.79.32/27
  • 66.249.79.64/27
  • 66.249.79.128/27
  • 66.249.79.160/27
  • 66.249.79.192/27
  • 66.249.79.224/27
  • 192.178.4.0/27
  • 192.178.4.32/27
  • 192.178.4.64/27
  • 192.178.4.96/27
  • 192.178.4.128/27
  • 192.178.4.160/27
  • 192.178.4.192/27
  • 192.178.4.224/27
  • 192.178.5.0/27
  • 192.178.6.0/27
  • 192.178.6.32/27
  • 192.178.6.64/27
  • 192.178.6.96/27
  • 192.178.6.128/27
  • 192.178.6.160/27
  • 192.178.6.192/27
  • 192.178.6.224/27
  • 192.178.7.0/27
  • 192.178.7.32/27
  • 192.178.7.64/27
  • 192.178.7.96/27
  • 192.178.7.128/27
  • 192.178.7.160/27
  • 192.178.7.192/27
  • 192.178.7.224/27
  • 2001:4860:4801:1a::/64
  • 2001:4860:4801:1b::/64
  • 2001:4860:4801:1c::/64
  • 2001:4860:4801:1d::/64
  • 2001:4860:4801:1e::/64
  • 2001:4860:4801:1f::/64
  • 2001:4860:4801:2::/64
  • 2001:4860:4801:2a::/64
  • 2001:4860:4801:2b::/64
  • 2001:4860:4801:2c::/64
  • 2001:4860:4801:2d::/64
  • 2001:4860:4801:2e::/64
  • 2001:4860:4801:2f::/64
  • 2001:4860:4801:3a::/64
  • 2001:4860:4801:3b::/64
  • 2001:4860:4801:3c::/64
  • 2001:4860:4801:3d::/64
  • 2001:4860:4801:3e::/64
  • 2001:4860:4801:3f::/64
  • 2001:4860:4801:4a::/64
  • 2001:4860:4801:4b::/64
  • 2001:4860:4801:4c::/64
  • 2001:4860:4801:4d::/64
  • 2001:4860:4801:4e::/64
  • 2001:4860:4801:6a::/64
  • 2001:4860:4801:6b::/64
  • 2001:4860:4801:6c::/64
  • 2001:4860:4801:6d::/64
  • 2001:4860:4801:6e::/64
  • 2001:4860:4801:6f::/64
  • 2001:4860:4801:7a::/64
  • 2001:4860:4801:7b::/64
  • 2001:4860:4801:7c::/64
  • 2001:4860:4801:7d::/64
  • 2001:4860:4801:7e::/64
  • 2001:4860:4801:7f::/64
  • 2001:4860:4801:10::/64
  • 2001:4860:4801:11::/64
  • 2001:4860:4801:12::/64
  • 2001:4860:4801:13::/64
  • 2001:4860:4801:14::/64
  • 2001:4860:4801:15::/64
  • 2001:4860:4801:16::/64
  • 2001:4860:4801:17::/64
  • 2001:4860:4801:18::/64
  • 2001:4860:4801:19::/64
  • 2001:4860:4801:20::/64
  • 2001:4860:4801:21::/64
  • 2001:4860:4801:22::/64
  • 2001:4860:4801:23::/64
  • 2001:4860:4801:24::/64
  • 2001:4860:4801:25::/64
  • 2001:4860:4801:26::/64
  • 2001:4860:4801:27::/64
  • 2001:4860:4801:28::/64
  • 2001:4860:4801:29::/64
  • 2001:4860:4801:30::/64
  • 2001:4860:4801:31::/64
  • 2001:4860:4801:32::/64
  • 2001:4860:4801:33::/64
  • 2001:4860:4801:34::/64
  • 2001:4860:4801:35::/64
  • 2001:4860:4801:36::/64
  • 2001:4860:4801:37::/64
  • 2001:4860:4801:38::/64
  • 2001:4860:4801:39::/64
  • 2001:4860:4801:40::/64
  • 2001:4860:4801:41::/64
  • 2001:4860:4801:42::/64
  • 2001:4860:4801:43::/64
  • 2001:4860:4801:44::/64
  • 2001:4860:4801:45::/64
  • 2001:4860:4801:46::/64
  • 2001:4860:4801:47::/64
  • 2001:4860:4801:48::/64
  • 2001:4860:4801:49::/64
  • 2001:4860:4801:50::/64
  • 2001:4860:4801:51::/64
  • 2001:4860:4801:52::/64
  • 2001:4860:4801:53::/64
  • 2001:4860:4801:54::/64
  • 2001:4860:4801:55::/64
  • 2001:4860:4801:56::/64
  • 2001:4860:4801:57::/64
  • 2001:4860:4801:58::/64
  • 2001:4860:4801:59::/64
  • 2001:4860:4801:60::/64
  • 2001:4860:4801:61::/64
  • 2001:4860:4801:62::/64
  • 2001:4860:4801:63::/64
  • 2001:4860:4801:64::/64
  • 2001:4860:4801:65::/64
  • 2001:4860:4801:66::/64
  • 2001:4860:4801:67::/64
  • 2001:4860:4801:68::/64
  • 2001:4860:4801:69::/64
  • 2001:4860:4801:70::/64
  • 2001:4860:4801:71::/64
  • 2001:4860:4801:72::/64
  • 2001:4860:4801:73::/64
  • 2001:4860:4801:74::/64
  • 2001:4860:4801:75::/64
  • 2001:4860:4801:76::/64
  • 2001:4860:4801:77::/64
  • 2001:4860:4801:78::/64
  • 2001:4860:4801:79::/64
  • 2001:4860:4801:80::/64
  • 2001:4860:4801:81::/64
  • 2001:4860:4801:82::/64
  • 2001:4860:4801:83::/64
  • 2001:4860:4801:84::/64
  • 2001:4860:4801:85::/64
  • 2001:4860:4801:86::/64
  • 2001:4860:4801:87::/64
  • 2001:4860:4801:88::/64
  • 2001:4860:4801:90::/64
  • 2001:4860:4801:91::/64
  • 2001:4860:4801:92::/64
  • 2001:4860:4801:93::/64
  • 2001:4860:4801:94::/64
  • 2001:4860:4801:95::/64
  • 2001:4860:4801:96::/64
  • 2001:4860:4801:97::/64
  • 2001:4860:4801:a0::/64
  • 2001:4860:4801:a1::/64
  • 2001:4860:4801:a2::/64
  • 2001:4860:4801:a3::/64
  • 2001:4860:4801:a4::/64
  • 2001:4860:4801:a5::/64
  • 2001:4860:4801:a6::/64
  • 2001:4860:4801:a7::/64
  • 2001:4860:4801:a8::/64
  • 2001:4860:4801:a9::/64
  • 2001:4860:4801:aa::/64
  • 2001:4860:4801:ab::/64
  • 2001:4860:4801:ac::/64
  • 2001:4860:4801:ad::/64
  • 2001:4860:4801:ae::/64
  • 2001:4860:4801:b0::/64
  • 2001:4860:4801:b1::/64
  • 2001:4860:4801:b2::/64
  • 2001:4860:4801:b3::/64
  • 2001:4860:4801:b4::/64
  • 2001:4860:4801:b5::/64
  • 2001:4860:4801:b6::/64
  • 2001:4860:4801:c::/64
  • 2001:4860:4801:f::/64

Does it respect robots.txt and Crawl-delay?

robots.txt: yes, Googlebot follows it according to its owner.

“They always respect robots.txt rules for automatic crawls.” — Google documentation

Crawl-delay: not supported for Googlebot.

“other fields such as crawl-delay aren't supported” — Google documentation

Should you block Googlebot?

Almost never. Blocking Googlebot takes your site out of that search engine. To limit only AI uses of your content, use the AI tokens and crawlers listed in this directory.

Check your site

See whether your robots.txt and firewall let Googlebot in — together with every other AI bot in this directory. Free, no sign-up.

Other Google bots

Questions

What is the Googlebot user agent string?+

Google documents it as: Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

How do I block Googlebot in robots.txt?+

Add a group for it to robots.txt in your site’s root: “User-agent: Googlebot” followed by “Disallow: /”.

What IP addresses does Googlebot use?+

Google publishes 317 ranges at https://developers.google.com/static/crawling/ipranges/common-crawlers.json. Requests that call themselves Googlebot from other addresses are most likely fake.

Does Googlebot respect robots.txt?+

robots.txt: yes, Googlebot follows it according to its owner.

← All AI bots