Connect with us

SEO

Google Has Two Types Of Crawling

Published

on

Google Has Two Types Of Crawling


Google utilizes two types of crawling methods when it goes through webpages — one to discover new content and one to refresh existing content.

This is explained by Google’s Search Advocate John Mueller during the Google Search Central SEO office-hours hangout recorded on January 7.

An SEO professional named Swyamdipta Chakraborty joins the livestream to ask Mueller a series of questions, one of which has to do with how often Googlebot crawls his site.

He notes that Googlebot used to crawl his site daily when he published more regularly, but doesn’t crawl as much when fewer articles are published.

Perhaps out of concern that a reduction in crawl frequency is a bad sign, he asks Mueller if this is normal.

Advertisement

Continue Reading Below

Advertisement

Mueller assures him this is fine, and goes on to explain the two types of crawling Googlebot engages in.

Learn more about how Google crawls websites in the section below.

Two Types Of Googlebot Crawling

You can find out how often Googlebot crawls your site via a report in Search Console, and there may be periods when your site is crawled more than others.

When questioned about the report, Mueller confirms the fluctuations are normal and discusses the two types of crawling:

“That can happen. It’s not so much that we crawl a website, but we crawl individual pages of a website. And when it comes to crawling, we have two types of crawling roughly.

One is a discovery crawl where we try to discover new pages on your website. And the other is a refresh crawl where we update existing pages that we know about.”

Advertisement

Continue Reading Below

Not only can crawl frequency vary for the whole site, it can vary by individual webpages.

Advertisement

If your homepage is updated more regularly than other pages, for example, then you’ll see more Googlebot activity on that page.

Mueller continues:

“So for the most part, for example, we would refresh crawl the homepage, I don’t know, once a day, or every couple of hours, or something like that.

And if we find new links on their home page then we’ll go off and crawl those with the discovery crawl as well. And because of that you will always see a mix of discover and refresh happening with regard to crawling. And you’ll see some baseline of crawling happening every day.

But if we recognize that individual pages change very rarely, then we realize we don’t have to crawl them all the time.”

Certain types of websites are likely to be crawled more than others.

A news websites that’s updated multiple times a day will be crawled more than a site that’s updated once a month.

Googlebot is capable of recognizing these patterns and adjusting its crawl frequency accordingly.

“For example, if you have a news website and you update it hourly, then we should learn that we need to crawl it hourly. Whereas if it’s a news website that updates once a month, then we should learn that we don’t need to crawl every hour.

And that’s not a sign of quality, or a sign of ranking, or anything like that. It’s really just purely from a technical point of view we’ve learned we can crawl this once a day, or once a week, and that’s ok.”

Advertisement

Advertisement

Continue Reading Below

So don’t be alarmed if you notice Googlebot is visiting your site more or less often.

Further, don’t be concerned if Googlebot recently crawled your site and updates to existing content aren’t reflected in search results.

That could be a case where Google crawled your site to discover new content, not to refresh existing content.

If your site rarely makes changes to published content, then Googlebot may crawl more for discovery that refreshes.

Again, it doesn’t necessarily have anything to do with content quality.

Hear the full discussion below:

Advertisement


Featured Image: Diyajyoti/Shutterstock

Advertisement

Continue Reading Below

fbq('trackSingle', '1321385257908563', 'ViewContent', { content_name: 'google-has-two-types-of-crawling-discovery-refresh', content_category: 'news seo ' });



Source link

SEO

Build Trust & Boost Conversions With 6 Key Principles [Webinar]

Published

on

Build Trust & Boost Conversions With 6 Key Principles [Webinar]

The digital landscape is highly competitive and wildly oversaturated.

And when it comes to digital marketing, how can you set your business apart from the competition and capture the attention of your target audience?

What are some effective tactics to create compelling campaigns that are sure to stand out?

The answer: Understanding the levels of trust that help a build strong marketing foundation.

Building trust with your chosen marketing agency or team and establishing a strong marketing foundation is critical to the success of your business.

Register for our webinar, 6 Keys Your Business Needs To Win With Your Marketing Agency, and discover how to forge relationships and create effective campaigns that generate genuine interest and transform consideration into conversions.

1. Align Your Goals

In this live session, you’ll learn the key areas where your agency should align with your goals:

Advertisement
  • Transparency: How to have 100% transparency into every dollar you invest with only one goal in mind: delivering a true return on investment (ROI).
  • Investments: How to respect your digital media investments the same as traditional financial investments.
  • Investment Models: Understanding that the math always needs to make sense to ensure the investment models being implemented set programs up for success.
  • Expectations: How to work together to set realistic expectations in terms of investment level and ROI.
  • Tracking: Learning to track everything – the data always tells the real story.
  • Results: Mutual understanding that if your business wins, your agency/team wins, too!

The most impactful digital strategies are those which focus on transparency with your marketing team and value creation for users.

In this webinar, Eric and Erin Wilder, Co-Founders of 81 & Sunny, go in depth on these principles and how they can help you drive results.

The key to online success with an agency comes from understanding the delicate balance of your goals, setting realistic expectations, and ensuring the investment models being implemented will help you achieve your goals.

“It’s not about following the traditional marketing funnel (awareness → consideration → conversion), as that is common knowledge amongst all marketers and advertisers. It is all about how a marketer executes within the marketing funnel, given their client’s goals and available resources, that makes a partnership scalable and successful.”

– 81 & Sunny

2. Understand Your Business

When implementing a digital marketing strategy for your business, ask yourself:

  • Which platforms should I invest in to achieve company goals?
  • Which platforms produce the highest quality leads from a conversion-to-sale ratio or drive the most online sales?
  • Which platform is most efficient or is the most profitable for my business?
  • Is lead quantity or quality a better fit for my business model?
  • Can I afford a multi-channel strategy and still be profitable?
  • Am I investing enough to compete with or beat out my competition?

Getting ahead in this oversaturated market starts with aligning goals with your agency and building value for your audience.

Looking to outperform your competition and boost organic conversions?

Join us and our special guests on October 12 at 2 PM, and learn what it takes to develop a winning digital strategy for your business.

You’ll have the opportunity to ask about your unique situation, too, in a live Q&A session.

Can’t make the webinar live? Register now and we’ll send you the on-demand version after the event.

Advertisement

fbq('trackSingle', '1321385257908563', 'ViewContent', { content_name: '6-key-marketing-principles-webinar', content_category: 'agency-marketing digital strategy-digital webinar' }); } });



Source link

Continue Reading

DON'T MISS ANY IMPORTANT NEWS!
Subscribe To our Newsletter
We promise not to spam you. Unsubscribe at any time.
Invalid email address

Trending

en_USEnglish