Google has explained crawl budget to us several months ago and truth is, the topic has kind of slowed down recently – which I am grateful for. But every now and then, it sparks back up.
Gary Illyes from Google was questioned about an instance where Google is not doing the right thing in terms of optimizing for their crawl budget on their own properties. So Gary responded simply that Google doesn’t care to worry about how crawl budget is impacting how GoogleBot crawls their own pages.
Gary said on Twitter “we don’t care about crawl budget at all.”
Yeah, no. We don’t care about crawl budget at all.
â” Gary “é¯¨ç” Illyes (@methode) July 17, 2017
If you want to follow the specific trail, go to that tweet and scroll up.
But I love how Google doesn’t care about it. Gary knows Google can handle what it needs to handle to rank the pages that people want. Optimizing crawl budget, while a good thing to do, isn’t the most critical SEO thing one should worry about. Of course for really large sites, it will help but how much?
Forum discussion at Twitter.