Connect with us

SEARCHENGINES

Google Says Adding Individual Pages Does Not Impact Crawl Budget

Published

on

Google Says Adding Individual Pages Does Not Impact Crawl Budget


Google’s John Mueller said that simply adding individual pages won’t impact how Google crawls your site. Crawl budget generally is only impacted by hundreds of thousands, if not millions of pages – not individual pages here or there.

If you have a site in the low hundreds of thousands of pages, I doubt you need to worry much about crawl budget. In fact, I think most sites on the internet do not need to worry about crawl budget. If you run Amazon, sure, you should – but I site like this, the one you are reading, with less than a 100,000 pages, I don’t lose sleep over crawl budget.

John said this on Twitter, saying “Adding individual pages isn’t going to affect how we crawl your site.” He then linked to Google’s help document on crawl budget management for large sites. That help document was introduced in December 2020.

Here are those tweets:

Forum discussion at Twitter.

Advertisement





Source link

See also  Google URL Inspection Tool Referring Page Not Important

SEARCHENGINES

The Google Supplemental Index Has Not Existed In A Dozen Years

Published

on

The Google Supplemental Index Has Not Existed In A Dozen Years

Over the past several days I have noticed a bunch of SEOs sharing information about the Google supplemental index and talking SEO strategies related to it. Just as a PSA, the Google supplemental index has not been in existence for a dozen or so years now.

Today, in 2022, there is no such thing as the Google Supplemental Index.

Yes, pre-2010, Google maintained two indexes for technical reasons. The main index was updated more frequently and faster and the supplemental index was for pages of lower importance that didn’t need to be updated as quickly. Generally, pages in the main index would rank higher in Google Search than pages in the supplemental index. And Google would generally only rank pages in the supplemental index if it couldn’t find good matches in the main index.

In fact, Google use to label search results that came from the supplemental index, as such. Here is a screenshot I posted back in 2007 with this label:

click for full size

In December 2007, Google started to hide the supplemental index label, stating “We improved the crawl frequency and decoupled it from which index a document was stored in, and once these “supplementalization effects” were gone, the “supplemental result” tag itself—which only served to suggest that otherwise good documents were somehow suspect— was eliminated a few months ago. Now we’re coming to the next major milestone in the elimination of the artificial difference between indices: rather than searching some part of our index in more depth for obscure queries, we’re now searching the whole index for every query.”

See also  Daily Search Forum Recap: May 24, 2022

Then in 2009 Google started testing a new indexing method called Caffeine and in 2010, Google launched Caffeine fully. With that launch, Google stopped using the supplemental index all together. Heck, Google still uses Caffeine today

In any event, John Mueller of Google was asked to confirm that the supplemental index is not longer and he said on Twitter it’s safe to say that index from 2003 is now enjoying the great bit-bucket in the sky.”

So don’t let anyone confuse you or set you off in the wrong direction – Google’s index works differently than it did pre-2010 than it does post-2010 and there is no supplemental index anymore.

Forum discussion at Twitter.



Source: www.seroundtable.com

Continue Reading

DON'T MISS ANY IMPORTANT NEWS!
Subscribe To our Newsletter
We promise not to spam you. Unsubscribe at any time.
Invalid email address

Trending

en_USEnglish