SEARCHENGINES

Google’s New Robots Tag indexifembedded Let’s You Control Indexing With Embedded Content

Published

2 years ago

January 25, 2022

Google's New Robots Tag indexifembedded Let's You Control Indexing With Embedded Content

Google has announced a brand new robots tag it will obey going forward, it is named indexifembedded. It lets you control if you want Google to index a page with embedded content. This allows Google to index the content of a page if it’s embedded in another page through iframes or similar HTML tags, in spite of a noindex directive. indexifembedded only has an effect if it’s accompanied by noindex.

Gary Illyes and Weizi Wang from Google wrote “we’re introducing a new robots tag, indexifembedded, that brings you more control over when your content is indexed. With the indexifembedded tag, you can tell Google you’d still like your content indexed when it’s embedded through iframes and similar HTML tags in other pages, even when the content page has the noindex tag.”

In short, let’s say I embed a piece of content using an iframe or some type of code embed method. That piece of content often, if it is media, has a directive to be noindexed, but when I embed it on my page that has more context around what I am embedding, it might tell Google that since the embedded content is noindexed, do not index the page I am embedding it on. Here, Google is giving you more control to say, index the page the embed is on despite what the embed page says. It reminds me of Google’s warning around embedding Instagram or other images and the SEO issues that can cause.

Google said that the indexifembedded tag “addresses a common issue that especially affects media publishers: while they may want their content indexed when it’s embedded on third-party pages, they don’t necessarily want their media pages indexed on their own. Because they don’t want the media pages indexed, they currently use a noindex tag in such pages. However, the noindex tag also prevents embedding the content in other pages during indexing.”

The new robots tag, indexifembedded, Google said “works in combination with the noindex tag only when the page with noindex is embedded into another page through an iframe or similar HTML tag, like object.”

The example Google gave was with a podcast, if podcast.host.example/playpage?podcast=12345 has both the noindex and indexifembedded tag, it means Google can embed the content hosted on that page in recipe.site.example/my-recipes.html during indexing. I assume the same would apply to Instagram and other embeds.

So if Instagram would implement this new indexifembedded it might solve that issue, maybe?

Here are the code examples both in meta robots and x-robots form:

I did ask Google for a bit more clarification:

I read it as controlling indexing the embedded page, not the page embedding it on
— Pascal Birchler (@swissspidy) January 21, 2022

I just don’t see why Instagram would care to implement this – why do they care how embedding their content on my site impacts if my pages are indexed? They want the traffic directly, they do not want me to rank above them.

A “common” (it’s new, so there’s nothing common yet :)) use-case would be widgets or embedded content, where you have a special URL for the embed that you don’t want indexed, but you still want to allow the embedding page to use it for indexing. Eg, video embeds.
— 🐄 John 🐄 (@JohnMu) January 21, 2022
Advertisement

Forum discussion at Twitter.

Up Next

Google Ads Officially Testing Emojis In Some Ads

Don't Miss

Google On Redirect Pull Backs & Signal Consolidation

Click to comment

You must be logged in to post a comment Login

SEARCHENGINES

Daily Search Forum Recap: May 3, 2024

Published

16 hours ago

May 4, 2024

Entireweb News Bot

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Google got their cost down to generate AI answers in search by 80%. Google is interested in alternatives to hreflang. Google may recrawl URLs multiple times per day or per month. Google is testing custom search filter templates in search. Google AdSense removed its privacy policy as a placement for withdrawal of consent. And I posted the weekly SEO video recap. And deeply sad to report that passing of Mark Irvine.

Search Engine Roundtable Stories:

Search News Buzz Video Recap: Google March Core Update Done, HCU Recoveries, Site Reputation Abuse & AI Topics

This week, we covered how the Google March 2024 core update finished back on April 19th, and Google forgot to tell us. I also posted the May 2024 Google webmaster report. Google said it’s still possible for sites to recover…

Google SGE AI Answers Now Cost 80% Less To Generate

One of the big worries for Google investors was the cost of running AI to show within its search results. The AI overviews, now AI answers are costly to run. But as expected, Google was able to reduce the cost to generate these AI Answers.

Google Search Tests Custom Filters & Templates

Google Search is testing custom filters and pre-define search filter templates. It appears you can save your custom filters and reuse those filters for future searches. This is showing up for a limited number of searchers.

Google Open To Alternative Ideas For Hreflang

Gary Illyes from Google said he has heard from the SEO industry that hreflang can be “annoying” and complex and confusing. So he is open to ideas on how to replace it and make it work for both small and really large websites.

Google Recrawls URLs At Different Rates: Multiple Times Per Day To Every Few Months

Google has to crawl the web to build its index for it to provide search results. And since webpages and documents get updated, Google needs to recrawl those URLs from time to time. Google will recrawl URLs at different rates, said John Mueller of Google.

Google AdSense Has Removed Privacy Policy As Place To Withdraw Consent

Google AdSense has removed reference to your privacy policy as a place to withdraw consent. AdSense now has clarified that the revocation link at the bottom of the page should say “Privacy and cookie settings”.

The Industry Mourns The Loss Of Mark Irvine – Brilliant & Giving Search Marketer

I am deeply sad to report that Mark Irvine passed away unexpectedly last night. Mark was deeply involved in the search marketing community, known as being a brilliant paid search specialist who always spent his time helping others over his long career in the space.

Google Gradient Canopy Signage

I honestly did not know the new Google office, or one of them at least, was named the Gradient Canopy. I mean, I guess it makes sense. Here is a sign in front of that building with that name.

Other Great Search Threads:

I like to think of these (artificial, impossible, philosophical) questions as “if I added X to a page, would it be better for Y?” Would adding SD to a page make it rank higher? No. Might it rank differently? Maybe – SD enables some search features, but th, John Mueller on X

Small Google doc change, they restructured the Product structured data documentation, Barry Schwartz on X

AdSense Earnings and Observations – May 2024, WebmasterWorld

I hope it’s not just technically well-made :-). There have been some interesting takes in the space, I’m sure someone will find a model that works for clients, users, search & is profitable., John Mueller on X

Once you launch a new campaign (and you already have a Conversion Tracking in place) Google will always re-direct you towards the Google Tag Setup with instructions how to implement it. Have you seen it too?, Thomas Eccel on X

We’ve added Salesforce as a data source for data import! You can now import data directly from Salesforce to Google Analytics as offline-event data. Schedule daily or hourly imports, and select any existing Salesforce mil, Google Analytics on X

Search Engine Land Stories:

Feedback:

Have feedback on this daily recap; let me know on Twitter @rustybrick or @seroundtable, on Threads, Mastodon and Bluesky and you can follow us on Facebook and on Google News and make sure to subscribe to the YouTube channel, Apple Podcasts, Spotify, Google Podcasts or just contact us the old fashion way.

SEARCHENGINES

Google Interested In Hreflang Alternatives

Published

2 days ago

May 3, 2024

Entireweb News Bot

Gary Illyes from Google said he has heard from the SEO industry that hreflang can be “annoying” and complex and confusing. So he is open to ideas on how to replace it and make it work for both small and really large websites.

He wrote this on LinkedIn saying, “Things I’ve learned and heard in Sofia at the SERPConf event.” He said one of those is that “hreflang is annoying.”

Gary wrote, “I don’t disagree,” that I guess he understands why SEOs and creators find it annoying.

So he said that he open to new ideas. He wrote, “I’m still very open to coming up with something less annoying, but it needs to work for small sites and mammoths as well, while delivering at least the same amount of information.”

So if you have ideas, let Gary know, he wrote, “Ping if you have ideas.”

You can use hreflang to tell Google about the variations of your content. This helps Google understand the various pages and how they are localized variations of the same content. But the implementation can be confusing and detailed, why he said it can be annoying. Several years ago, John Mueller said hreflang can be the most complex aspect in SEO.

Forum discussion at LinkedIn.

SEARCHENGINES

Daily Search Forum Recap: May 1, 2024

Published

3 days ago

May 2, 2024

Entireweb News Bot

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Google Ads posted its first feature announcement in over two months, it is on PMax updates. Bing Webmaster Tools fixed a notification bug. Google SGE renamed its AI overviews to AI Answer. Most SEOs have not filled in the Google March 2024 core update feedback form. A Google search for flag GIFs can lead to Nazi flags.

Search Engine Roundtable Stories:

Google Ads Posts First New Feature Announcement In Two Months – PMax Updates

Google Ads has posted its first new features announcement in its help section in over two months. This was to announce several Performance Max campaigns features, which we will get into below. But like I reported earlier, Google has not posted anything in this section for two months prior to posting this new announcement.

Googling “Flag GIF” Leads To Nazi Flags In Google Search

If you search for [flag GIF] on Google, click on the “waiving” refinement, you are taken to images of Nazi flags. I waited a full week to report on this, a full week from when Google acknowledged the issue and it is still an issue.

Bing Webmaster Tools Notifications & Insights Bug Fixed

Fabrice Canel from Microsoft confirmed Microsoft has fixed a bug with Bing Webmaster Tools showing inaccurate and/or irrelevant notifications in the notifications and insights section. Fabrice wrote, “Happy to report that the fix has been implemented and the issue should now be resolved for your site and all sites once data is refreshed.”

Google SGE AI Overviews Has A New Title – AI Answer

Google is now labeling or using the title of its SGE, Search Generative Experience, “AI Answer.” This replaces the title “AI Overviews” and “Al overviews are experimental.” This change happened on Monday, I believe.

Most SEOs Did Not Send Feedback To Google On The March 2024 Core Update

Google opened up its feedback form after it announced the Google March 2024 core update was completed and it seems most SEOs did not send Google feedback. Why? Maybe because many don’t believe Google will use that feedback to help them? Maybe because SEOs don’t want to share specifics with Google?

Sundar Pichai 20 Year Google Anniversary

Google’s CEO, Sunday Pichai, on April 26, 2024, posted on Instagram that he is celebrating him 20 year anniversary of working at Google. He started on April 26, 2004 and is now running the place.