Connect with us

GOOGLE

Google: It’s Normal for 20% of a Site to Not Be Indexed

Published

on

Google: It’s Normal for 20% of a Site to Not Be Indexed

Google’s John Mueller answered a question about indexing, offering insights into how overall site quality influences indexing patterns. He also offered the insight that it’s within the bounds of normal that 20% of a site’s content is not indexed.

Pages Discovered But Not Crawled

The person asking the question offered background information about their site.

Of particular concern was the stated fact that the server was overloaded and if that might affect how many pages Google indexes.

When a server is overloaded the request for a web page may result in a 500 error response. This is because when a server cannot serve a web page the standard response is a 500 Internal Server Error message.

The person asking the question did not mention that Google Search Console was reporting that Googlebot was receiving 500 error response codes.

So if it’s the case that Googlebot did not receive a 500 error response then the server overload issue is probably not the reason why 20% of the pages are not getting indexed.

The person asked the following question:

“20% of my pages are not getting indexed.

It says they’re discovered but not crawled.

Does this have anything to do with the fact that it’s not crawled because of potential overload of my server?

Or does it have to do with the quality of the page?”

Crawl Budget Not Generally Why Small Sites Have Non-indexed Pages

Google’s John Mueller offered an interesting explanation of how overall site quality is an important factor that determines whether Googlebot will index more web pages.

But first he discussed how the crawl budget isn’t usually a reason why pages remain non-indexed for a small site.

John Mueller answered:

“Probably a little of both.

So usually if we’re talking about a smaller site then it’s mostly not a case that we’re limited by the crawling capacity, which is the crawl budget side of things.

If we’re talking about a site that has millions of pages, then that’s something where I would consider looking at the crawl budget side of things.

But smaller sites probably less so.”

Overall Site Quality Determines Indexing

John next went into detail about how overall site quality can affect how much of a website is crawled and indexed.

This part is especially interesting because it gives a peek at how Google evaluates a site in terms of quality and how the overall impression influences indexing.

Mueller continued his answer:

“With regards to the quality, when it comes to understanding the quality of the website, that is something that we take into account quite strongly with regards to crawling and indexing of the rest of the website.

But that’s not something that’s necessarily related to the individual URL.

So if you have five pages that are not indexed at the moment, it’s not that those five pages are the ones we would consider low quality.

It’s more that …overall, we consider this website maybe to be a little bit lower quality. And therefore we won’t go off and index everything on this site.

Because if we don’t have that page indexed, then we’re not really going to know if that’s high quality or low quality.

So that’s the direction I would head there …if you have a smaller site and you’re seeing a significant part of your pages are not being indexed, then I would take a step back and try to reconsider the overall quality of the website and not focus so much on technical issues for those pages.”

Technical Factors and Indexing

Mueller next mentions technical factors and how easy it is for modern sites to get that part right so that it doesn’t get in the way of indexing.

Mueller observed:

“Because I think, for the most part, sites nowadays are technically reasonable.

If you’re using a common CMS then it’s really hard to do something really wrong.

And it’s often more a matter of the overall quality.”

It’s Normal for 20% of a Site to Not Be Indexed

This next part is also interesting in that Mueller downplays 20% of a site not indexed as something that is within the bounds of normal.

Mueller has more access to information about how much of sites are typically not indexed so I take him at his word because he speaking from the perspective of Google.

Mueller explains why it’s normal for pages to not be indexed:

“The other thing to keep in mind with regards to indexing, is it’s completely normal that we don’t index everything off of the website.

So if you look at any larger website or any even midsize or smaller website, you’ll see fluctuations in indexing.

It’ll go up and down and it’s never going to be the case that we index 100% of everything that’s on a website.

So if you have a hundred pages and (I don’t know) 80 of them are being indexed, then I wouldn’t see that as being a problem that you need to fix.

That’s sometimes just how it is for the moment.

And over time, when you get to like 200 pages on your website and we index 180 of them, then that percentage gets a little bit smaller.

But it’s always going to be the case that we don’t index 100% of everything that we know about.”

Don’t Panic if Pages Aren’t Indexed

There’s quite a lot of information Mueller shared about indexing to take in.

  • It’s within the bounds of normal for 20% of a site to not be indexed.
  • Technical issues probably won’t impeded indexing.
  • Overall site quality can determine how much of a site gets indexed.
  • How much of a site gets indexed fluctuates.
  • Small sites generally don’t have to worry about crawl budget.

Citation

It’s Normal for 20% of a Site to be Non-indexed
Watch Mueller discussing what is normal indexing from about the 27:26 minute mark.

Searchenginejournal.com

GOOGLE

Google to pay $391.5 million settlement over location tracking, state AGs say

Published

on

Google to pay $391.5 million settlement over location tracking, state AGs say

Google has agreed to pay a $391.5 million settlement to 40 states to resolve accusations that it tracked people’s locations in violation of state laws, including snooping on consumers’ whereabouts even after they told the tech behemoth to bug off.

Louisiana Attorney General Jeff Landry said it is time for Big Tech to recognize state laws that limit data collection efforts.

“I have been ringing the alarm bell on big tech for years, and this is why,” Mr. Landry, a Republican, said in a statement Monday. “Citizens must be able to make informed decisions about what information they release to big tech.”

The attorneys general said the investigation resulted in the largest-ever multistate privacy settlement. Connecticut Attorney General William Tong, a Democrat, said Google’s penalty is a “historic win for consumers.”

“Location data is among the most sensitive and valuable personal information Google collects, and there are so many reasons why a consumer may opt out of tracking,” Mr. Tong said. “Our investigation found that Google continued to collect this personal information even after consumers told them not to. That is an unacceptable invasion of consumer privacy, and a violation of state law.”

Location tracking can help tech companies sell digital ads to marketers looking to connect with consumers within their vicinity. It’s another tool in a data-gathering toolkit that generates more than $200 billion in annual ad revenue for Google, accounting for most of the profits pouring into the coffers of its corporate parent, Alphabet, which has a market value of $1.2 trillion.

The settlement is part of a series of legal challenges to Big Tech in the U.S. and around the world, which include consumer protection and antitrust lawsuits.

Though Google, based in Mountain View, California, said it fixed the problems several years ago, the company’s critics remained skeptical. State attorneys general who also have tussled with Google have questioned whether the tech company will follow through on its commitments.

The states aren’t dialing back their scrutiny of Google’s empire.

Last month, Texas Attorney General Ken Paxton said he was filing a lawsuit over reports that Google unlawfully collected millions of Texans’ biometric data such as “voiceprints and records of face geometry.”

The states began investigating Google’s location tracking after The Associated Press reported in 2018 that Android devices and iPhones were storing location data despite the activation of privacy settings intended to prevent the company from following along.

Arizona Attorney General Mark Brnovich went after the company in May 2020. The state’s lawsuit charged that the company had defrauded its users by misleading them into believing they could keep their whereabouts private by turning off location tracking in the settings of their software.

Arizona settled its case with Google for $85 million last month. By then, attorneys general in several other states and the District of Columbia had pounced with their own lawsuits seeking to hold Google accountable.

Along with the hefty penalty, the state attorneys general said, Google must not hide key information about location tracking, must give users detailed information about the types of location tracking information Google collects, and must show additional information to people when users turn location-related account settings to “off.”

States will receive differing sums from the settlement. Mr. Landry’s office said Louisiana would receive more than $12.7 million, and Mr. Tong’s office said Connecticut would collect more than $6.5 million.

The financial penalty will not cripple Google’s business. The company raked in $69 billion in revenue for the third quarter of 2022, according to reports, yielding about $13.9 billion in profit.

Google downplayed its location-tracking tools Monday and said it changed the products at issue long ago.

“Consistent with improvements we’ve made in recent years, we have settled this investigation which was based on outdated product policies that we changed years ago,” Google spokesman Jose Castaneda said in a statement.

Google product managers Marlo McGriff and David Monsees defended their company’s Search and Maps products’ usage of location information.

“Location information lets us offer you a more helpful experience when you use our products,” the two men wrote on Google’s blog. “From Google Maps’ driving directions that show you how to avoid traffic to Google Search surfacing local restaurants and letting you know how busy they are, location information helps connect experiences across Google to what’s most relevant and useful.”

The blog post touted transparency tools and auto-delete controls that Google has developed in recent years and said the private browsing Incognito mode prevents Google Maps from saving an account’s search history.

Mr. McGriff and Mr. Monsees said Google would make changes to its products as part of the settlement. The changes include simplifying the process for deleting location data, updating the method to set up an account and revamping information hubs.

“We’ll provide a new control that allows users to easily turn off their Location History and Web & App Activity settings and delete their past data in one simple flow,” Mr. McGriff and Mr. Monsees wrote. “We’ll also continue deleting Location History data for users who have not recently contributed new Location History data to their account.”

• This article is based in part on wire service reports.

Source link

Continue Reading

GOOGLE

5 Tips to Boost Your Holiday Search Strategy

Published

on

Student writing on computer

With the global economic downturn, inflation, ongoing supply chain challenges, and uncertainty due to the Ukraine war, this year’s holiday shopping season promises to be very challenging. Will people be in the mood to spend despite the gloom? Or will they rein in their enthusiasm and save for the year ahead?

With these issues in mind, here are five considerations to support your search engine optimization strategy this holiday shopping season:

1. Start early.

Rising prices are likely to mean shoppers will start researching their holiday spending earlier than ever to nab the best bargains. Therefore, retailers must roll out their holiday product and category pages — and launch any promotions — sooner to ensure their pages get crawled and indexed by search engines in good time.

Some e-commerce stores manage to get their pages ranking early by updating and reusing the same section of the website for holiday content and promotions, rotating between content for Christmas, Mother’s Day, Valentine gifts, Fourth of July sales, etc. This approach can help you retain the momentum, links and authority you build up with Google and get your holiday pages visible and ranking quickly.

2. Make research an even bigger priority.

With all the uncertainty this year, it’s vital to use SEO research to identify the trending seasonal keywords and search phrases in your retail vertical — and then optimize content accordingly.

With tools such as Google Trends you can extract helpful insights based on the types of searches people are making. For example, with many fashion retailers now charging for product returns, will prioritizing keywords such as “free returns” get more search traction? And with money being tighter, will consumers stick with brands they trust rather than anything new — meaning brand searches might be higher?

3. Make greater use of Google Shopping.

To get the most out of their holiday spending, consumers are more likely to turn to online marketplaces such as Google Shopping as they make it easier to compare products, features and prices, as well as to identify the best deals both online and in nearby stores.

Therefore, take a combined approach which includes listing in Google Shopping and at the same time optimizing product detail pages on your e-commerce site to ensure they’re unique and provide more value than competitors’ pages. Be precise with product names on Google Shopping (e.g., do the names contain the words people are searching for?); ensure you provide all the must-have information Google requires; and set a price that’s not too far from the competition. 

4. Give other search sources the attention they deserve.

Earlier this year Google itself acknowledged that consumers — especially younger consumers — are starting to use TikTok, Instagram and other social media sites for search. In fact, research suggests 11 percent of product searches now start on TikTok and 15 percent on Instagram. Younger consumers in particular are more engaged by visual content, which may explain why they’re embracing visually focused social sites for search. So, as part of your search strategy, create and share content on popular social media sites that your target customers visit.

Similarly, with people starting their shopping searches on marketplaces such as Amazon.com, optimizing any listings you have on the site should be part of your strategy. And thankfully, the better optimized your product detail pages are for Amazon (with unique, useful content), the better they will rank on Google as well!

5. Hold paid budget for late opportunities.

The greater uncertainty and volatility this holiday season mean you must keep a close eye on shopper behavior and be ready to embrace opportunities that emerge later on. Getting high organic rankings for late promotions is always more challenging, so hold some paid search budget back to help drive traffic to those pages — via Google Ads, for example. Important keywords to include in late season search ad campaigns include “delivery before Christmas” and “same-day-delivery.” For locally targeted search ads, consider “pick up any time before Christmas.”

The prospect of a tough, unpredictable holiday shopping season means search teams must roll out seasonal SEO plans early, closely track shoppers’ behavior, and be ready to adapt as things change.

Marcus Pentzek is chief SEO consultant at Searchmetrics, the global provider of search data, software and consulting solutions.

Source link

Continue Reading

GOOGLE

Google Home App Gets an Overhaul, Rolling Out Soon

Published

on

Google Home app

Google refreshes its Home app with a slew of new features after launching a new Nest gear. This makes it faster and easier to pair smart devices with Matter, adds customization and personalization options, an enhanced Nest camera experience, and better intercommunication between devices.

This revamped Home app utilizes Google’s Matter smart home standard – launching later this year – especially the Fast Pair functionality. On an Android phone, it will instantly recognize a Matter device and allow you to easily set it up, bypassing the current procedure that is often slow and difficult. Google is also updating its Nest speakers, displays, and routers – to control Matter devices better.

Google Home App New Features

  • Spaces: This feature allows you to control multiple devices in different rooms. Google has listed a few things by room: kitchen, bedroom, living room, etc., although it’s pretty limited right now. Spaces let you organize devices how you see fit. For instance, you can set up a baby monitor in one room and set a different room’s camera to focus on an area the baby often plays. With Spaces, you can categorize these two devices into one Space category called ‘Baby.’

Google Home app Spaces

  • Favorites: This one is pretty self-explanatory. It allows you to make certain gears as a favorite that you frequently use. Doing so will bring those devices into the limelight within the Google Home app for easier access. 

Google Home app

  • Media: Google adds a new media widget at the bottom of your Home feed. This will automatically determine what media is playing in your home and provide you with the appropriate controls as and when needed. There will be song controls if you listen to music on your speakers. There will be television remote controls if you’re watching TV. 

Google probably won’t roll out this Home app makeover anytime soon. But you can try it for yourself in the coming week by enrolling in the public preview, available in select areas.

Source link

Continue Reading

Trending

en_USEnglish