Google’s John Mueller: Don’t Create a Sitemap Manually
Google’s John Mueller recently advised an SEO not to manually create a sitemap for a large website, and offered more appropriate solutions.
This exchange occurred in a Reddit thread on the r/SEO subreddit. An SEO was looking for advice on creating a sitemap for a website with over 2 million products.
The thread states:
“I have a client in a very technical, industrial niche. They sell industrial parts that are similar, but very specific. They have 2 Million + SKUs in their inventory.
My challenge here is to create a sitemap. Because there are so many pages, I have to create it manually. I have a list of URLs broken up by products and categories that our dev team pulled through API. Since sitemaps can only contain 50,000 URLs, I have 37 excel sheets with 50,000 URLs on them each…”
The SEO went on to describe how they plan to go about tackling this challenge, which is all irrelevant now considering they don’t “have to” create the sitemap manually as they originally thought.
Here’s what Mueller suggests doing instead.
John Mueller’s Response
“Don’t create a sitemap manually like that,” Mueller plainly states in his response.
As the most upvoted comment, Mueller’s advice was obviously echoed by the Reddit SEO community.
Instead of creating the sitemap manually, Mueller says this is what should be done in this situation:
“You need to get [the sitemap] from the CMS or the underlying database directly.”
As another Reddit user points out, getting a sitemap from the API where the dev team originally pulled the list of URLs would be a fine solution as well.
Why is this better than manually creating a sitemap?
When creating a sitemap for a large site, or any site, you have to consider not only how it will be created but how it will be kept up to date.
A site with a product catalog of this magnitude could be adding and removing tens of thousands of products every day.
It would be logistically impossible to manually maintain an updated sitemap like that.
And that’s not even taking into account the considerable amount of work that would go into creating the sitemap in the first place.
Manually creating a sitemap is not a realistic solution when automated options exist.
The SEO Comes to Their Senses
The SEO who started the Reddit thread eventually came to their senses and agreed that manually creating a sitemap is not the right way to go about it.
“Thanks for the wake-up call guys. I agree, this was the plan of action laid out for us and it didn’t sit right with me from the beginning.”
For what it’s worth, the idea apparently came from senior staff members of the company they work for.
More Resources
For more information on creating and optimizing sitemaps, see the resources below:
Google Warns About Misuse of Its Indexing API
Google has updated its Indexing API documentation with a clear warning about spam detection and the possible consequences of misuse.
Warning Against API Misuse The new message in the guide says:
“All submissions through the Indexing API are checked for spam. Any misuse, like using multiple accounts or going over the usage limits, could lead to access being taken away.”
This warning is aimed at people trying to abuse the system by exceeding the API’s limits or breaking Google’s rules.
What Is the Indexing API? The Indexing API allows websites to tell Google when job posting or livestream video pages are added or removed. It helps websites with fast-changing content get their pages crawled and indexed quickly.
But it seems some users have been trying to abuse this by using multiple accounts to get more access.
Impact of the Update Google is now closely watching how people use the Indexing API. If someone breaks the rules, they might lose access to the tool, which could make it harder for them to keep their search results updated for time-sensitive content.
How To Stay Compliant To use the Indexing API properly, follow these rules:
- Don’t go over the usage limits, and if you need more, ask Google instead of using multiple accounts.
- Use the API only for job postings or livestream videos, and make sure your data is correct.
- Follow all of Google’s API guidelines and spam policies.
- Use sitemaps along with the API, not as a replacement.
Remember, the Indexing API isn’t a shortcut to faster indexing. Follow the rules to keep your access.
This Week in Search News: Simple and Easy-to-Read Update
Here’s what happened in the world of Google and search engines this week:
1. Google’s June 2024 Spam Update
Google finished rolling out its June 2024 spam update over a period of seven days. This update aims to reduce spammy content in search results.
2. Changes to Google Search Interface
Google has removed the continuous scroll feature for search results. Instead, it’s back to the old system of pages.
3. New Features and Tests
- Link Cards: Google is testing link cards at the top of AI-generated overviews.
- Health Overviews: There are more AI-generated health overviews showing up in search results.
- Local Panels: Google is testing AI overviews in local information panels.
4. Search Rankings and Quality
- Improving Rankings: Google said it can improve its search ranking system but will only do so on a large scale.
- Measuring Quality: Google’s Elizabeth Tucker shared how they measure search quality.
5. Advice for Content Creators
- Brand Names in Reviews: Google advises not to avoid mentioning brand names in review content.
- Fixing 404 Pages: Google explained when it’s important to fix 404 error pages.
6. New Search Features in Google Chrome
Google Chrome for mobile devices has added several new search features to enhance user experience.
7. New Tests and Features in Google Search
- Credit Card Widget: Google is testing a new widget for credit card information in search results.
- Sliding Search Results: When making a new search query, the results might slide to the right.
8. Bing’s New Feature
Bing is now using AI to write “People Also Ask” questions in search results.
9. Local Search Ranking Factors
Menu items and popular times might be factors that influence local search rankings on Google.
10. Google Ads Updates
- Query Matching and Brand Controls: Google Ads updated its query matching and brand controls, and advertisers are happy with these changes.
- Lead Credits: Google will automate lead credits for Local Service Ads. Google says this is a good change, but some advertisers are worried.
- tROAS Insights Box: Google Ads is testing a new insights box for tROAS (Target Return on Ad Spend) in Performance Max and Standard Shopping campaigns.
- WordPress Tag Code: There is a new conversion code for Google Ads on WordPress sites.
These updates highlight how Google and other search engines are continuously evolving to improve user experience and provide better advertising tools.
AI
Exploring the Evolution of Language Translation: A Comparative Analysis of AI Chatbots and Google Translate
According to an article on PCMag, while Google Translate makes translating sentences into over 100 languages easy, regular users acknowledge that there’s still room for improvement.
In theory, large language models (LLMs) such as ChatGPT are expected to bring about a new era in language translation. These models consume vast amounts of text-based training data and real-time feedback from users worldwide, enabling them to quickly learn to generate coherent, human-like sentences in a wide range of languages.
However, despite the anticipation that ChatGPT would revolutionize translation, previous experiences have shown that such expectations are often inaccurate, posing challenges for translation accuracy. To put these claims to the test, PCMag conducted a blind test, asking fluent speakers of eight non-English languages to evaluate the translation results from various AI services.
The test compared ChatGPT (both the free and paid versions) to Google Translate, as well as to other competing chatbots such as Microsoft Copilot and Google Gemini. The evaluation involved comparing the translation quality for two test paragraphs across different languages, including Polish, French, Korean, Spanish, Arabic, Tagalog, and Amharic.
In the first test conducted in June 2023, participants consistently favored AI chatbots over Google Translate. ChatGPT, Google Bard (now Gemini), and Microsoft Bing outperformed Google Translate, with ChatGPT receiving the highest praise. ChatGPT demonstrated superior performance in converting colloquialisms, while Google Translate often provided literal translations that lacked cultural nuance.
For instance, ChatGPT accurately translated colloquial expressions like “blow off steam,” whereas Google Translate produced more literal translations that failed to resonate across cultures. Participants appreciated ChatGPT’s ability to maintain consistent levels of formality and its consideration of gender options in translations.
The success of AI chatbots like ChatGPT can be attributed to reinforcement learning with human feedback (RLHF), which allows these models to learn from human preferences and produce culturally appropriate translations, particularly for non-native speakers. However, it’s essential to note that while AI chatbots outperformed Google Translate, they still had limitations and occasional inaccuracies.
In a subsequent test, PCMag evaluated different versions of ChatGPT, including the free and paid versions, as well as language-specific AI agents from OpenAI’s GPTStore. The paid version of ChatGPT, known as ChatGPT Plus, consistently delivered the best translations across various languages. However, Google Translate also showed improvement, performing surprisingly well compared to previous tests.
Overall, while ChatGPT Plus emerged as the preferred choice for translation, Google Translate demonstrated notable improvement, challenging the notion that AI chatbots are always superior to traditional translation tools.
Source: https://www.pcmag.com/articles/google-translate-vs-chatgpt-which-is-the-best-language-translator
-
SEARCHENGINES6 days ago
Google August Core Update Done, Google Interview, Google Ads & Merchant Center News & The YouTube Algorithm SEO
-
SEO7 days ago
Plot Up To Five Metrics At Once
-
SEO6 days ago
Google’s Guidance About The Recent Ranking Update
-
SEARCHENGINES5 days ago
Google Search Volatility Still Heated After August Core Update Rollout
-
AFFILIATE MARKETING7 days ago
Best US Cities to Start a Business, Entrepreneurship: Report
-
SEARCHENGINES4 days ago
Daily Search Forum Recap: September 9, 2024
-
SEO5 days ago
Mediavine Bans Publisher For Overuse Of AI-Generated Content
-
AFFILIATE MARKETING6 days ago
Invest in Yourself with a Lifetime of StackSkills Courses for $29.97