Connect with us

SEARCHENGINES

Google Favicon Crawler Uses Googlebot & Googlebot-Image Token

Published

on

Google Favicon Crawler Uses Googlebot & Googlebot-Image Token

Google has updated its Google crawler help documentation to specific that the Google Favicon crawler now respects the Googlebot and Googlebot-Image robots rules. Previously, it seemed to just respect its own Google Favicon rules but that was changed or updated a few days ago.

The docs from earlier this year show this:

click for full size

The revised document shows this:

click for full size

Dave Smart, where I found this from, said on Twitter “FYI: Looks like the favicon crawler from google now respects Googlebot-Image / Googlebot robots.txt rules, (followed it own, Googlebot favicon, before apparently) so perhaps make sure you’re not blocking it accidentally now.”

Forum discussion at Twitter.

Advertisement




Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address