Connect with us

NEWS

IndexNow Elicits Mixed Reactions Including Skepticism via @sejournal, @martinibuster

Published

on

While major companies like Wix, Duda and Cloudflare announced enthusiastic adoption of the new open source IndexNow indexing protocol that promises instant indexing, it was also confronted with questions over whether the IndexNow was necessary, worth the trouble adopting and doubt as to whether any of its benefits will be realized.

What is IndexNow?

IndexNow is an open source project that is attempting evolve how search engines discover and index content in a way that benefits both search engines and publishers.

IndexNow also promises to rapidly speed up the process of re-indexing content that has been updated and indexing content that is brand new.

Lastly, IndexNow promises to be more energy efficient because they will be crawling websites less often.

The old way of discovering web pages and indexing content is largely unchanged for decades.

Crawlers check web pages on the Internet over and over, regardless if a web page is unchanged or does not exist.

While search engines employ strategies to reduce how many pages are crawled, crawling an unchanged web page can be seen as a profligate use of electricity, like watering a lawn during a rainstorm.

Advertisement

Continue Reading Below

Advertisement

IndexNow claims to solve that problem by eliminating redundant crawls and focusing just on the pages that are new or updated.

But not everyone is convinced.

Some in the search community have expressed doubts about every single benefit IndexNow claims to provide, including the claim that less pages will be crawled.

Yoast Declines to Adopt IndexNow

Joost de Valk, founder of Yoast WordPress SEO plugin tweeted a series of statements questioning the value offered by IndexNow. He stated that the Yoast plugin would not be adopting the IndexNow standard.

He tweeted why Yoast is not adopting IndexNow

“We’ve not added support to @yoast SEO for it yet, for the simple reason that we don’t see the value yet.”

Yoast: IndexNow is Not Needed

Joost next laid out the case that IndexNow is solving a problem that already has a solution.

He claimed that XML sitemaps already accomplish what IndexNow is trying to do.

Advertisement

He tweeted:

“Ever since XML sitemaps were conceived, URL discovery as far as we’re concerned is a “solved problem”.

For most sites, getting search engines to crawl content is not a problem.

Yoast SEO generates XML sitemaps and it can even ping search engines when those change.”

Advertisement

Continue Reading Below

IndexNow Is Useful for Large Websites

Someone responded to Joost and said that the Bing API for fast indexing provided value for sites they worked on like Groupon and GitHub.

She tweeted:

Joost Acknowledges that IndexNow Benefits Big Sites

He tweeted:

“For large sites like that I definitely see the value.

But to do this and make it a default for 12 million sites, most of which have less than 100 pages, seems overkill.”

Duda Explains Why IndexNow Provides Value

One of the companies that is supporting IndexNow is Duda, a professional site building platform that competes with WordPress and Wix.

Duda is a website building platform that allows web professionals to create a web presence that performs well out of the box.

But it’s also flexible similar to WordPress and allows customers to build custom widgets, embed the website builder within their own software (SaaS) or migrate legacy sites entirely in large scale.

I asked Russ Jeffery, Director of Strategic Integrations at Duda to explain why XML sitemaps are not enough and why IndexNow provides value:

“There is a delay between publishing, crawl, index, and finally showing in search results.

Right now search engines must re-crawl all pages of a site to find new content and not on the update schedule of an actual site update.

Advertisement

The difference here is that you’re telling Bing to only crawl these updated pages and do it now. A push, rather than a pull, approach is a widely accepted best practice of updating data/content between different systems efficiently.”

I pointed out to Russ how Joost insisted that XML sitemaps were good enough and that IndexNow was a better value for large sites.

Russ responded:

“I do agree with Joost that for a lot of websites, it is not the most important capability to have at the moment.

But, I think this approach to indexing is a lot better than the traditional sitemap system and the industry should move towards ‘pushing’ content to search engines for them to crawl.”

Advertisement

Continue Reading Below

Waiting for Google to Adopt IndexNow

I turned to longtime UK search marketing expert Ammon Johns (@Ammon_Johns) for his opinion. Like Joost, he too was not enthusiastic about IndexNow and didn’t feel it offered anything substantial.

Ammon acknowledged the elephant not in the IndexNow room, which was Google.

Advertisement

He said:

“Unless and until Google sign up for a Bing led protocol, it’s not a huge deal.

But if Google do go along for some reason (rather than make their own), we’ll certainly all have to revisit a lot of understanding about crawl prioritization”

Promise of Less Crawling in Doubt

Ammon downplayed any benefit of less crawling, saying that they’d likely use the freed-up resources to go out and crawl lower priority web pages that would not ordinarily be crawled.

He said:

“Even if this were to free up some resource allocated to crawling more than can be crawled (the state of the web currently, and growing exponentially), I can’t see the search engines not simply crawling more of the lower priority, or re-crawling the absolute highest with more frequency.

…Microsoft don’t even actually promise they’ll grab it at once, only that it will be indexed ‘soon’ or ‘quickly’.”

Advertisement

Continue Reading Below

He then pointed out that adopting the IndexNow protocol will eliminate a latent signal of what pages Google or Bing feel are most important.

Advertisement

IndexNow May Remove a Data Point

Ammon noted:

“One of the major reasons I never, EVER, use submission tools is that seeing when content gets crawled on its own is far too useful.

There’s no other way to see ‘importance’”

There are multiple things that influence how often a web page is crawled, links being one of them. How often a page or section of a website changes can also influence how often a web page is crawled.

Whether fast indexing is worth it to give up seeing which pages a search engine feels are more “important” is up to the individual and their priorities. Ammon feels it’s not worth it for him.

Will the Web Adopt IndexNow?

Joost’s initial post stated that they haven’t decided to adopt IndexNow yet because they don’t see the value in it.

Advertisement

Continue Reading Below

One of the important features of the Yoast SEO plugin is the ability to automatically create XML sitemaps, something that Joost feels is sufficient for most websites.

Should Google adopt the IndexNow protocol, which at the moment seems remote, XML sitemaps might lose a fair bit of their importance, which might dampen the shine on what is currently an important feature of the Yoast plugin.

Should Google adopt IndexNow it raises the odds that WordPress might follow through and include it into the core, eliminating the need for Yoast to turn it into a plugin feature.

So it seems for Yoast there is relatively little to any value from IndexNow.

It’s up to the search community to decide for themselves. There is some opposition and skepticism of IndexNow.

But there are also many big companies like Cloudflare who are integrating IndexNow enthusiastically.

Advertisement

Advertisement

Continue Reading Below

Joost acknowledged that IndexNow is useful for big companies but also pointed out that in his opinion there’s less value in it for the smaller sites.

Perhaps as Ammon noted, for some in the search community, particularly the smaller sites, unless Google adopts IndexNow, the decision for them is going to feel like it’s optional and not a necessity.

Searchenginejournal.com

NEWS

Google December Product Reviews Update Affects More Than English Language Sites? via @sejournal, @martinibuster

Published

on

Google’s Product Reviews update was announced to be rolling out to the English language. No mention was made as to if or when it would roll out to other languages. Mueller answered a question as to whether it is rolling out to other languages.

Google December 2021 Product Reviews Update

On December 1, 2021, Google announced on Twitter that a Product Review update would be rolling out that would focus on English language web pages.

The focus of the update was for improving the quality of reviews shown in Google search, specifically targeting review sites.

A Googler tweeted a description of the kinds of sites that would be targeted for demotion in the search rankings:

“Mainly relevant to sites that post articles reviewing products.

Think of sites like “best TVs under $200″.com.

Goal is to improve the quality and usefulness of reviews we show users.”

Advertisement

Advertisement

Continue Reading Below

Google also published a blog post with more guidance on the product review update that introduced two new best practices that Google’s algorithm would be looking for.

The first best practice was a requirement of evidence that a product was actually handled and reviewed.

The second best practice was to provide links to more than one place that a user could purchase the product.

The Twitter announcement stated that it was rolling out to English language websites. The blog post did not mention what languages it was rolling out to nor did the blog post specify that the product review update was limited to the English language.

Google’s Mueller Thinking About Product Reviews Update

Screenshot of Google's John Mueller trying to recall if December Product Review Update affects more than the English language

Screenshot of Google's John Mueller trying to recall if December Product Review Update affects more than the English language

Product Review Update Targets More Languages?

The person asking the question was rightly under the impression that the product review update only affected English language search results.

Advertisement

Advertisement

Continue Reading Below

But he asserted that he was seeing search volatility in the German language that appears to be related to Google’s December 2021 Product Review Update.

This is his question:

“I was seeing some movements in German search as well.

So I was wondering if there could also be an effect on websites in other languages by this product reviews update… because we had lots of movement and volatility in the last weeks.

…My question is, is it possible that the product reviews update affects other sites as well?”

John Mueller answered:

“I don’t know… like other languages?

My assumption was this was global and and across all languages.

But I don’t know what we announced in the blog post specifically.

Advertisement

But usually we try to push the engineering team to make a decision on that so that we can document it properly in the blog post.

I don’t know if that happened with the product reviews update. I don’t recall the complete blog post.

But it’s… from my point of view it seems like something that we could be doing in multiple languages and wouldn’t be tied to English.

And even if it were English initially, it feels like something that is relevant across the board, and we should try to find ways to roll that out to other languages over time as well.

So I’m not particularly surprised that you see changes in Germany.

But I also don’t know what we actually announced with regards to the locations and languages that are involved.”

Does Product Reviews Update Affect More Languages?

While the tweeted announcement specified that the product reviews update was limited to the English language the official blog post did not mention any such limitations.

Google’s John Mueller offered his opinion that the product reviews update is something that Google could do in multiple languages.

Advertisement

One must wonder if the tweet was meant to communicate that the update was rolling out first in English and subsequently to other languages.

It’s unclear if the product reviews update was rolled out globally to more languages. Hopefully Google will clarify this soon.

Citations

Google Blog Post About Product Reviews Update

Product reviews update and your site

Google’s New Product Reviews Guidelines

Write high quality product reviews

John Mueller Discusses If Product Reviews Update Is Global

Watch Mueller answer the question at the 14:00 Minute Mark

[embedded content]

Searchenginejournal.com

Continue Reading

DON'T MISS ANY IMPORTANT NEWS!
Subscribe To our Newsletter
We promise not to spam you. Unsubscribe at any time.
Invalid email address

Trending

en_USEnglish