Connect with us

SEO

Google Ranking Dropped Dramatically? (Here’s What to Check)

Published

on

Google Ranking Dropped Dramatically? (Here's What to Check)

It can be alarming if your website’s Google rankings drop suddenly.

But before you make any changes, it’s important to check certain things first.

1. Check for any Google algorithm updates

Google’s algorithm updates are among the most common ways your website’s rankings can be negatively impacted.

Advertisement

Google doesn’t like low-quality or misleading results appearing at the top of its organic search results, so it runs regular algorithm updates to preserve the quality of its search index. 

Updates are announced on Google’s status page. So it’s worth checking if any dates align with your website’s ranking drops. 

Google ranking updates, via Google

It takes time to align these dates against your organic traffic data, so a faster way to understand the impact is to use a tool like Ahrefs. 

To do this, head to Ahrefs’ Site Explorer, plug in your domain, and scan the Ⓖ updates at the bottom of the Overview 2.0 organic traffic chart. 

Advertisement
Google ranking updates highlighted in Overview 2.0, via Ahrefs' Site Explorer
The highlighted Ⓖ symbol indicates that there was a Google update at each of these points. 

Hovering over the Ⓖ symbols will give you more detailed information about the updates. 

2. Check your organic traffic in Ahrefs’ Site Explorer

Once you’ve established there’s been a Google update, you’ll need to check its date against your total organic traffic to see if there’s been a drop at the same time. 

To check your organic traffic in Site Explorer, you can:

  1. Plug in your domain and scroll down to the Overview 2.0 chart.
  2. Uncheck everything apart from “Avg. organic traffic.” 
  3. Set the timeline to “All” and “Weekly.” This helps you to see the complete timeline for the organic traffic, giving you a better idea of how significant the drop is.
Avg. organic traffic filter with drop highlighted, via Ahrefs' Site Explorer

I’ve highlighted the most recent traffic drop for this website. Let’s see if we can work out why this happened. Let’s zoom in and change the timeline to “1Y,” hovering our cursor around the time of the drop.

March 2023 Core Update detail, via Ahrefs' Site Explorer

The March 2023 Core Update roughly aligns here. 

It may have contributed to the loss of traffic, but we can also see that the exact date of the organic traffic drop doesn’t align with the release of this update.

So we can’t say that this algorithm update caused the drop. In this situation, it’s usually best to keep investigating.

Advertisement

If your website’s organic traffic drop does align exactly with an update, then a Google update has likely impacted you.

3. Check your top traffic-driving keywords

Once you’ve established a significant drop in organic traffic, you’ll want to know which of your website’s keywords have lost rankings.

To do this, head to the Organic keywords report in Site Explorer. I like to compare keywords year on year (YoY), so let’s add a YoY “Compare” filter.

Drop in traffic change, via Ahrefs' Site Explorer

We can see that in the “Change” column, there’s been a significant drop for this website’s top keyword, “yamaha motorcycles.” 

Keyword closeup, via Ahrefs' Site Explorer

Let’s head over to Ahrefs’ Keywords Explorer by clicking on the keyword “yamaha motorcycles.”

Scrolling down to the SERP overview, we can see what happened if we make a year-on-year (YoY) comparison. 

Advertisement
SERP overview with highlight on YoY comparison, via Ahrefs' Keywords Explorer

Google has switched the /motorcycle page for the homepage. So there may be an issue with the /motorcycle page.

For reference, in Site Explorer, we can see the exact date of the drop is March 14.

March 14, 2023, traffic drop, via Ahrefs' Site Explorer

Let’s remove the comparison and plug this date into the SERP overview in Keywords Explorer.

404 page, via Ahrefs' Keywords Explorer

Using the SERP overview, we can see that this page was a 404 page on that date. If we change the date to March 16, 2023, we can see that this page disappears from the SERPs.

SERP overview for "yamaha motorcycles," via Ahrefs' Keywords Explorer

As this date matches up, it’s likely to be the reason for the significant drop in traffic for this website.

Using Site Explorer and Keywords Explorer in conjunction is a great way to diagnose the reasons for ranking drops.

4. Check any recent technical changes to the site

Technical issues can impact your Google rankings. You’ll need to run a website crawl to determine these issues.

In my opinion, the easiest way to identify technical issues with your site is to run a crawl using Ahrefs’ Site Audit.

Advertisement

To set one up, head to Site Audit, click “+ New project,” and follow the prompts.

Navigating to Ahrefs' Site Audit

Once you’ve completed the crawl, you’ll see an “Overview” screen similar to the screenshot below.

Overview example, via Ahrefs' Site Audit

This page gives a bird’s-eye view of technical issues and monitors your website’s health score.

Once you’ve clicked on a specific issue, click “Why and how to fix.” A sidebar will then appear, explaining the problem and how to fix it—this information is critical to helping you solve your technical issues.

"Why and how to fix" closeup, via Ahrefs' Site Audit

If your website crawl reveals that you’ve got many technical issues, it’s worth spending time fixing each problem until your overall health score improves. 

Once you’ve done this, you’ll be able to eliminate the possibility of any technical issues impacting your site’s Google rankings.

Tip

Technical issues can occur any time but often happen during a website migration. Running Site Audit before and after your migration allows you to compare crawls to see if there’s been an increase in technical issues following the migration.

Now we know how to set up and analyze a Site Audit, let’s look at some specific technical issues that often result in lost rankings and organic traffic.

4XX Pages

Ahrefs 404 page, via ahrefs.com

4XX pages are error pages. You’ll probably be most familiar with the classic “404 page not found.” When these types of pages occur, it can result in lost traffic.

If we return to our earlier website (/motorcycle page) example in Keywords Explorer and scroll down to the SERP overview, we can see it’s a 404 page. 

Advertisement
404 page, via Ahrefs' Keywords Explorer

But are there any more 404 pages on this site? Let’s return to the Organic keywords report and click through other top keywords, such as “r7” and “yamaha r1.”

List of keywords, via Ahrefs' Keywords Explorer

If we click through on the keyword “r7” to Keywords Explorer, scroll to the SERP overview, and set the date to March 14, 2023, we can see that this keyword also has a 404 status code.

404 page shown in SERP overview, via Ahrefs' Keywords Explorer

Repeating the process with the “yamaha r1” keyword, we can see this page is also a 404 page on March 14, 2023.

404 page shown in SERP overview, via Ahrefs' Keywords Explorer

It seems fair to conclude that this website’s top traffic-driving pages were dead pages.

Although we have quickly used Keywords Explorer and Site Explorer to find this information, the same information can be found using Site Audit.

This is what it will look like once your crawl has been completed and where you can identify the 404 or 4XX pages in the report.

4XX issues, via Ahrefs' Site Audit

Canonicals

Canonical tag illustration, via Ahrefs Blog

Lack of or poorly implemented canonical tags is another technical issue that can cause problems for your site. 

When it comes to identifying them, you can spot-check them on a page-by-page basis using Ahrefs’ SEO Toolbar, or you can run a Site Audit crawl to get a full view.

I’ve highlighted below the types of issues that can be flagged by the Overview report.

Canonical tag issues, via Ahrefs' Site Audit

For more tips, check our “canonical tags” beginner’s guide to learn more.

Redirects

Forgetting to add or poorly implementing redirects is one of the most common reasons for a drop in rankings and organic traffic. 

There are a couple of simple points to remember with redirects:

Advertisement

Detecting these redirect issues is best done using Ahrefs’ Site Audit. Simply run a crawl of your website and then check the Redirects report to get a view of the issues.

Redirects report, via Ahrefs' Site Audit

Check out our redirects for SEO guide to learn more.

Robots.txt

Changes to a website’s robots.txt file can also impact how Google crawls your website. Sometimes you, or another stakeholder, can accidentally block some essential pages. 

You can keep track of your robots.txt file changes if you run a regular crawl of your site using Ahrefs’ Site Audit. 

For each crawl, Page Explorer stores the details of your robots.txt file, making it easy to understand if any changes have been made to the file that could negatively affect the website.

Disavow store, via Ahrefs' Site Audit

If you’ve seen a ranking drop while migrating your site, it’s worth heading to your robots.txt file to see if you are blocking the crawling of any search engine bots or essential pages of your website. 

Check our robots.txt beginner’s guide to learn more.

Advertisement

5. Check your competitors’ rankings

If you’re confident your website’s technical SEO is in order, it’s worth checking to see if your competitors have outranked your website on some of its keywords. 

It may sound obvious, but this is another common reason a website loses rankings. Unfortunately, sometimes your competitors are better at SEO than you are.

The quickest way to monitor a competitor’s rankings is by plugging its domain in Site Explorer and heading to the Organic keywords report.

In this example, I’ve entered Backlinko’s domain.

Organic keywords report with positions highlighted, via Ahrefs' Site Explorer

Here, you can see the rankings of your competitor’s website and performance week on week, month on month, or any other custom date comparisons.

Check your tracked keywords against theirs

Another way to check your competitors’ recent activities is with Ahrefs’ Rank Tracker.

Advertisement
Competitors overview report, via Ahrefs' Rank Tracker

The great thing about this tool is that you can compare the rankings of your competitors and your website side by side.

Here’s an example of me looking at three different competitors’ rankings.

Competitors' and ahrefs' rankings for "google discover," via Ahrefs' Rank Tracker

Once you’ve established that a competitor performs better than you on specific keywords, you might want to learn more about their total strategy. It’s worth checking out our guide to keyword competitor analysis to learn more about this topic.

As links are a confirmed Google ranking factor (yes, they still matter), here’s what you should check:

Check for broken links

Keeping track of all broken links to your website can be a time-consuming task. Many websites rarely check broken links that point to them.

Using Site Explorer, we can look at any website’s broken links by plugging in a domain and heading to the Broken backlinks report. 

Here’s an example of the broken backlinks for the website we looked at earlier. 

Broken backlinks report, via Ahrefs' Site Explorer

There are 3,442 groups of follow links that we can fix here.

If you can’t see anything else wrong with your site, looking at this report is an excellent place to start.

Advertisement

The report shows this website has lost three high Domain Rating (DR) links from high-profile sites.

Broken backlinks examples, via Ahrefs' Site Explorer

Do a backlink audit (and if you need to, disavow)

Once you’ve checked your broken links, it’s a good idea to run a backlink audit on your site if you believe there is an issue with the overall quality of your website’s links.

In some instances, you may see unnatural links pointing to your site that may impact your rankings. Here are some examples of what Google may classify as “bad links”:

If you believe you have some links that negatively impact your site, you may want to consider using Google Search Console’s disavow tool

But remember to use the disavow tool with caution:

We said multiple times that the disavow tool is a very heavy gun. And if you don’t know what you are doing, you can shoot yourself in the foot with it.

Gary Illyes

If your site has a lot of low-quality content and you lost rankings during a content-focused Google update, you’ll need to improve it.

But how exactly can you improve your content? The first step is to do a content audit of your website. Here’s a visual representation of the process we use to audit content at Ahrefs.

Flowchart showing how to do a content audit, via Ahrefs Blog

Google also offers some self-assessment questions that you can use to further audit and improve your content:

  • Does the content provide original information, reporting, research, or analysis?
  • Does the content provide a substantial, complete, or comprehensive description of the topic?
  • Does the content provide insightful analysis or interesting information beyond the obvious?
  • If the content draws on other sources, does it avoid simply copying or rewriting those sources and instead provide substantial additional value and originality?
  • Does the main heading or page title provide a descriptive, helpful summary of the content?
  • Does the main heading or page title avoid exaggerating or being shocking in nature?
  • Is this the sort of page you’d want to bookmark, share with a friend, or recommend?
  • Would you expect to see this content in or referenced by a printed magazine, encyclopedia, or book?
  • Does the content provide substantial value when compared to other pages in search results?

Although there is no guarantee that improving content will immediately impact your rankings, ensuring your content is the best for your visitors is a good idea.

Google SERPs are constantly changing. And yes, it’s another factor that can impact rankings and organic traffic to your site—one that you have little control over.

Advertisement

To explain this concept, let’s look at a historical example of a dramatic SERP intent shift by plugging the keyword “corona” into Keywords Explorer

We’ll set the date to March 31, 2020, and compare it to the SERP pre-pandemic on January 3, 2020.

SERP overview and comparison for "corona," via Ahrefs' Keywords Explorer

In this example, we can see Corona beer–related websites on the left-hand side were displaced by websites covering COVID-19 and “Top stories” in the space of a few months.

If we set the date to something more recent, we can see that Corona, the beer, has regained its number #1 position. Why? Well, the search intent has reverted.

Corona beer SERP overview, via Ahrefs' Keywords Explorer

If you think a SERP intent shift may have impacted your website, then it’s worth using the “SERP overview” tool in Keywords Explorer to see how the historical SERP has changed.

9. Check Google Search Console for a manual action

If your website has lost all organic search traffic, you should check Google Search Console’s “Manual actions” report.

Advertisement

To do this, click on the tab on the left-hand side:

"Manual actions" tab highlighted, via Google Search Console

If there’s no issue, you’ll see a “No issues detected” notice in Google Search Console that looks like this:

"No issues detected" under "Manual actions" tab, via Google Search Console

If there is a problem, it will look similar to this. This is a “Pure spam” manual action. 

Example of manual action identified, via @rainprofit's Twitter page

If your site gets a manual action, a human reviewer at Google believes you have violated the search quality guidelines severely. Google will then generally remove your website and its pages from the search index.

Here’s a list of the different types of manual actions you can receive:

  • Site abused with third-party spam
  • User-generated spam
  • Spammy free host
  • Structured data issue
  • Unnatural links to your site
  • Unnatural links from your site
  • Thin content with little or no added value
  • Cloaking and/or sneaky redirects
  • Pure spam
  • Cloaked images
  • Hidden text and/or keyword stuffing
  • AMP content mismatch
  • Sneaky mobile redirects
  • News and Discover policy violations

Guidance from Google on how to fix these types of issues can be found here.

It’s usually rare to receive a manual action, but it’s not unheard of. To stay on the right side of Google, remember to take our SEO training course and follow the Google Search Essentials.

Final thoughts

It’s never easy working out why your website’s rankings have dropped dramatically. It involves investigating, analyzing, and finding data you can rely on to make decisions.

Tools like Ahrefs can help, as they enable you to look behind the curtain to see what’s going on.

Got more questions? Ping me on Twitter. 🙂

Advertisement



Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address

SEO

How to Revive an Old Blog Article for SEO

Published

on

Step-by-Step: How to Optimize Old Blog Posts for SEO

Quick question: What do you typically do with your old blog posts? Most likely, the answer is: Not much.

If that’s the case, you’re not alone. Many of us in SEO and content marketing tend to focus on continuously creating new content, rather than leveraging our existing blog posts.

However, here’s the reality—Google is becoming increasingly sophisticated in evaluating content quality, and we need to adapt accordingly. Just as it’s easier to encourage existing customers to make repeat purchases, updating old content on your website is a more efficient and sustainable strategy in the long run.

Ways to Optimize Older Content 

Some of your old content might not be optimized for SEO very well, rank for irrelevant keywords, or drive no traffic at all. If the quality is still decent, however, you should be able to optimize it properly with little effort. 

Advertisement

Refresh Content 

If your blog post contains a specific year or mentions current events, it may become outdated over time. If the rest of the content is still relevant (like if it’s targeting an evergreen topic), simply updating the date might be all you need to do.

Rewrite Old Blog Posts 

When the content quality is low (you might have greatly improved your writing skills since you’ve written the post) but the potential is still there, there’s not much you can do apart from rewriting an old blog post completely. 

This is not a waste—you’re saving time on brainstorming since the basic structure is already in place. Now, focus on improving the quality.

Delete Old Blog Posts 

You might find a blog post that just seems unusable. Should you delete your old content? It depends. If it’s completely outdated, of low quality, and irrelevant to any valuable keywords for your website, it’s better to remove it. 

Once you decide to delete the post, don’t forget to set up a 301 redirect to a related post or page, or to your homepage.

Promote Old Blog Posts 

Sometimes all your content needs is a bit of promotion to start ranking and getting traffic again. Share it on your social media, link to it from a new post – do something to get it discoverable again to your audience. This can give it the boost it needs to attract organic links too.

Advertisement

Which Blog Posts Should You Update?

Deciding when to update or rewrite blog posts is a decision that relies on one important thing: a content audit. 

Use your Google Analytics to find out which blog posts used to drive tons of traffic, but no longer have the same reach. You can also use Google Search Console to find out which of your blog posts have lost visibility in comparison to previous months. I have a guide on website analysis using Google Analytics and Google Search Console you can follow.

If you use keyword tracking tools like SE Ranking, you can also use the data it provides to come up with a list of blog posts that have dropped in the rankings. 

Make data-driven decisions to identify which blog posts would benefit from these updates – i.e., which ones still have the chance to recover their keyword rankings and organic traffic. 

With Google’s helpful content update, which emphasizes better user experiences, it’s crucial to ensure your content remains relevant, valuable, and up-to-date.

How To Update Old Blog Posts for SEO

Updating articles can be an involved process. Here are some tips and tactics to help you get it right.

Advertisement

Author’s Note: I have a Comprehensive On-Page SEO Checklist you might also be interested in following while you’re doing your content audit.

Conduct New Keyword Research

Updating your post without any guide won’t get you far. Always do your keyword research to understand how users are searching for your given topic. 

Proper research can also show you relevant questions and sections that can be added to the blog post you’re updating or rewriting. Make sure to take a look at the People Also Ask (PAA) section that shows up when you search for your target keyword. Check out other websites like Answer The Public, Reddit, and Quora to see what users are looking for too. 

Look for New Ranking Opportunities

When trying to revive an old blog post for SEO, keep an eye out for new SEO opportunities (e.g., AI Overview, featured snippets, and related search terms) that didn’t exist when you first wrote your blog post. Some of these features can be targeted by the new content you will add to your post, if you write with the aim to be eligible for it. 

Rewrite Headlines and Meta Tags

If you want to attract new readers, consider updating your headlines and meta tags. 

Your headlines and meta tags should fulfill these three things:

Advertisement
  1. Reflect the rewritten and new content you’ve added to the blog post.
  2. Be optimized for the new keywords it’s targeting (if any).
  3. Appeal to your target audience – who may have changed tastes from when the blog post was originally made. 

Remember that your meta tags in particular act like a brief advertisement for your blog post, since this is what the user first sees when your blog post is shown in the search results page. 

Take a look at your blog post’s click-through rate on Google Search Console – if it falls below 2%, it’s definitely time for new meta tags. 

Replace Outdated Information and Statistics

Updating blog content with current studies and statistics enhances the relevance and credibility of your post. By providing up-to-date information, you help your audience make better, well-informed decisions, while also showing that your content is trustworthy.

Tighten or Expand Ideas

Your old content might be too short to provide real value to users – or you might have rambled on and on in your post. It’s important to evaluate whether you need to make your content more concise, or if you need to elaborate more. 

Keep the following tips in mind as you refine your blog post’s ideas:

  • Evaluate Helpfulness: Measure how well your content addresses your readers’ pain points. Aim to follow the E-E-A-T model (Experience, Expertise, Authoritativeness, Trustworthiness).
  • Identify Missing Context: Consider whether your content needs more detail or clarification. View it from your audience’s perspective and ask if the information is complete, or if more information is needed.
  • Interview Experts: Speak with industry experts or thought leaders to get fresh insights. This will help support your writing, and provide unique points that enhance the value of your content.
  • Use Better Examples: Examples help simplify complex concepts. Add new examples or improve existing ones to strengthen your points.
  • Add New Sections if Needed: If your content lacks depth or misses a key point, add new sections to cover these areas more thoroughly.
  • Remove Fluff: Every sentence should contribute to the overall narrative. Eliminate unnecessary content to make your post more concise.
  • Revise Listicles: Update listicle items based on SEO recommendations and content quality. Add or remove headings to stay competitive with higher-ranking posts.

Improve Visuals and Other Media

No doubt that there are tons of old graphics and photos in your blog posts that can be improved with the tools we have today. Make sure all of the visuals used in your content are appealing and high quality. 

Update Internal and External Links

Are your internal and external links up to date? They need to be for your SEO and user experience. Outdated links can lead to broken pages or irrelevant content, frustrating readers and hurting your site’s performance.

You need to check for any broken links on your old blog posts, and update them ASAP. Updating your old blog posts can also lead to new opportunities to link internally to other blog posts and pages, which may not have been available when the post was originally published.

Optimize for Conversions

When updating content, the ultimate goal is often to increase conversions. However, your conversion goals may have changed over the years. 

Advertisement

So here’s what you need to check in your updated blog post. First, does the call-to-action (CTA) still link to the products or services you want to promote? If not, update it to direct readers to the current solution or offer.

Second, consider where you can use different conversion strategies. Don’t just add a CTA at the end of the post. 

Last, make sure that the blog post leverages product-led content. It’s going to help you mention your products and services in a way that feels natural, without being too pushy. Being subtle can be a high ROI tactic for updated posts.

Key Takeaway

Reviving old blog articles for SEO is a powerful strategy that can breathe new life into your content and boost your website’s visibility. Instead of solely focusing on creating new posts, taking the time to refresh existing content can yield impressive results, both in terms of traffic and conversions. 

By implementing these strategies, you can transform old blog posts into valuable resources that attract new readers and retain existing ones. So, roll up your sleeves, dive into your archives, and start updating your content today—your audience and search rankings will thank you!

Advertisement

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

SEO

How Compression Can Be Used To Detect Low Quality Pages

Published

on

By

Compression can be used by search engines to detect low-quality pages. Although not widely known, it's useful foundational knowledge for SEO.

The concept of Compressibility as a quality signal is not widely known, but SEOs should be aware of it. Search engines can use web page compressibility to identify duplicate pages, doorway pages with similar content, and pages with repetitive keywords, making it useful knowledge for SEO.

Although the following research paper demonstrates a successful use of on-page features for detecting spam, the deliberate lack of transparency by search engines makes it difficult to say with certainty if search engines are applying this or similar techniques.

What Is Compressibility?

In computing, compressibility refers to how much a file (data) can be reduced in size while retaining essential information, typically to maximize storage space or to allow more data to be transmitted over the Internet.

TL/DR Of Compression

Compression replaces repeated words and phrases with shorter references, reducing the file size by significant margins. Search engines typically compress indexed web pages to maximize storage space, reduce bandwidth, and improve retrieval speed, among other reasons.

This is a simplified explanation of how compression works:

  • Identify Patterns:
    A compression algorithm scans the text to find repeated words, patterns and phrases
  • Shorter Codes Take Up Less Space:
    The codes and symbols use less storage space then the original words and phrases, which results in a smaller file size.
  • Shorter References Use Less Bits:
    The “code” that essentially symbolizes the replaced words and phrases uses less data than the originals.

A bonus effect of using compression is that it can also be used to identify duplicate pages, doorway pages with similar content, and pages with repetitive keywords.

Research Paper About Detecting Spam

This research paper is significant because it was authored by distinguished computer scientists known for breakthroughs in AI, distributed computing, information retrieval, and other fields.

Advertisement

Marc Najork

One of the co-authors of the research paper is Marc Najork, a prominent research scientist who currently holds the title of Distinguished Research Scientist at Google DeepMind. He’s a co-author of the papers for TW-BERT, has contributed research for increasing the accuracy of using implicit user feedback like clicks, and worked on creating improved AI-based information retrieval (DSI++: Updating Transformer Memory with New Documents), among many other major breakthroughs in information retrieval.

Dennis Fetterly

Another of the co-authors is Dennis Fetterly, currently a software engineer at Google. He is listed as a co-inventor in a patent for a ranking algorithm that uses links, and is known for his research in distributed computing and information retrieval.

Those are just two of the distinguished researchers listed as co-authors of the 2006 Microsoft research paper about identifying spam through on-page content features. Among the several on-page content features the research paper analyzes is compressibility, which they discovered can be used as a classifier for indicating that a web page is spammy.

Detecting Spam Web Pages Through Content Analysis

Although the research paper was authored in 2006, its findings remain relevant to today.

Then, as now, people attempted to rank hundreds or thousands of location-based web pages that were essentially duplicate content aside from city, region, or state names. Then, as now, SEOs often created web pages for search engines by excessively repeating keywords within titles, meta descriptions, headings, internal anchor text, and within the content to improve rankings.

Section 4.6 of the research paper explains:

Advertisement

“Some search engines give higher weight to pages containing the query keywords several times. For example, for a given query term, a page that contains it ten times may be higher ranked than a page that contains it only once. To take advantage of such engines, some spam pages replicate their content several times in an attempt to rank higher.”

The research paper explains that search engines compress web pages and use the compressed version to reference the original web page. They note that excessive amounts of redundant words results in a higher level of compressibility. So they set about testing if there’s a correlation between a high level of compressibility and spam.

They write:

“Our approach in this section to locating redundant content within a page is to compress the page; to save space and disk time, search engines often compress web pages after indexing them, but before adding them to a page cache.

…We measure the redundancy of web pages by the compression ratio, the size of the uncompressed page divided by the size of the compressed page. We used GZIP …to compress pages, a fast and effective compression algorithm.”

High Compressibility Correlates To Spam

The results of the research showed that web pages with at least a compression ratio of 4.0 tended to be low quality web pages, spam. However, the highest rates of compressibility became less consistent because there were fewer data points, making it harder to interpret.

Figure 9: Prevalence of spam relative to compressibility of page.

The researchers concluded:

Advertisement

“70% of all sampled pages with a compression ratio of at least 4.0 were judged to be spam.”

But they also discovered that using the compression ratio by itself still resulted in false positives, where non-spam pages were incorrectly identified as spam:

“The compression ratio heuristic described in Section 4.6 fared best, correctly identifying 660 (27.9%) of the spam pages in our collection, while misidentifying 2, 068 (12.0%) of all judged pages.

Using all of the aforementioned features, the classification accuracy after the ten-fold cross validation process is encouraging:

95.4% of our judged pages were classified correctly, while 4.6% were classified incorrectly.

More specifically, for the spam class 1, 940 out of the 2, 364 pages, were classified correctly. For the non-spam class, 14, 440 out of the 14,804 pages were classified correctly. Consequently, 788 pages were classified incorrectly.”

The next section describes an interesting discovery about how to increase the accuracy of using on-page signals for identifying spam.

Insight Into Quality Rankings

The research paper examined multiple on-page signals, including compressibility. They discovered that each individual signal (classifier) was able to find some spam but that relying on any one signal on its own resulted in flagging non-spam pages for spam, which are commonly referred to as false positive.

Advertisement

The researchers made an important discovery that everyone interested in SEO should know, which is that using multiple classifiers increased the accuracy of detecting spam and decreased the likelihood of false positives. Just as important, the compressibility signal only identifies one kind of spam but not the full range of spam.

The takeaway is that compressibility is a good way to identify one kind of spam but there are other kinds of spam that aren’t caught with this one signal. Other kinds of spam were not caught with the compressibility signal.

This is the part that every SEO and publisher should be aware of:

“In the previous section, we presented a number of heuristics for assaying spam web pages. That is, we measured several characteristics of web pages, and found ranges of those characteristics which correlated with a page being spam. Nevertheless, when used individually, no technique uncovers most of the spam in our data set without flagging many non-spam pages as spam.

For example, considering the compression ratio heuristic described in Section 4.6, one of our most promising methods, the average probability of spam for ratios of 4.2 and higher is 72%. But only about 1.5% of all pages fall in this range. This number is far below the 13.8% of spam pages that we identified in our data set.”

So, even though compressibility was one of the better signals for identifying spam, it still was unable to uncover the full range of spam within the dataset the researchers used to test the signals.

Combining Multiple Signals

The above results indicated that individual signals of low quality are less accurate. So they tested using multiple signals. What they discovered was that combining multiple on-page signals for detecting spam resulted in a better accuracy rate with less pages misclassified as spam.

Advertisement

The researchers explained that they tested the use of multiple signals:

“One way of combining our heuristic methods is to view the spam detection problem as a classification problem. In this case, we want to create a classification model (or classifier) which, given a web page, will use the page’s features jointly in order to (correctly, we hope) classify it in one of two classes: spam and non-spam.”

These are their conclusions about using multiple signals:

“We have studied various aspects of content-based spam on the web using a real-world data set from the MSNSearch crawler. We have presented a number of heuristic methods for detecting content based spam. Some of our spam detection methods are more effective than others, however when used in isolation our methods may not identify all of the spam pages. For this reason, we combined our spam-detection methods to create a highly accurate C4.5 classifier. Our classifier can correctly identify 86.2% of all spam pages, while flagging very few legitimate pages as spam.”

Key Insight:

Misidentifying “very few legitimate pages as spam” was a significant breakthrough. The important insight that everyone involved with SEO should take away from this is that one signal by itself can result in false positives. Using multiple signals increases the accuracy.

What this means is that SEO tests of isolated ranking or quality signals will not yield reliable results that can be trusted for making strategy or business decisions.

Takeaways

We don’t know for certain if compressibility is used at the search engines but it’s an easy to use signal that combined with others could be used to catch simple kinds of spam like thousands of city name doorway pages with similar content. Yet even if the search engines don’t use this signal, it does show how easy it is to catch that kind of search engine manipulation and that it’s something search engines are well able to handle today.

Here are the key points of this article to keep in mind:

Advertisement
  • Doorway pages with duplicate content is easy to catch because they compress at a higher ratio than normal web pages.
  • Groups of web pages with a compression ratio above 4.0 were predominantly spam.
  • Negative quality signals used by themselves to catch spam can lead to false positives.
  • In this particular test, they discovered that on-page negative quality signals only catch specific types of spam.
  • When used alone, the compressibility signal only catches redundancy-type spam, fails to detect other forms of spam, and leads to false positives.
  • Combing quality signals improves spam detection accuracy and reduces false positives.
  • Search engines today have a higher accuracy of spam detection with the use of AI like Spam Brain.

Read the research paper, which is linked from the Google Scholar page of Marc Najork:

Detecting spam web pages through content analysis

Featured Image by Shutterstock/pathdoc

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

SEO

New Google Trends SEO Documentation

Published

on

By

Google publishes new documentation for how to use Google Trends for search marketing

Google Search Central published new documentation on Google Trends, explaining how to use it for search marketing. This guide serves as an easy to understand introduction for newcomers and a helpful refresher for experienced search marketers and publishers.

The new guide has six sections:

  1. About Google Trends
  2. Tutorial on monitoring trends
  3. How to do keyword research with the tool
  4. How to prioritize content with Trends data
  5. How to use Google Trends for competitor research
  6. How to use Google Trends for analyzing brand awareness and sentiment

The section about monitoring trends advises there are two kinds of rising trends, general and specific trends, which can be useful for developing content to publish on a site.

Using the Explore tool, you can leave the search box empty and view the current rising trends worldwide or use a drop down menu to focus on trends in a specific country. Users can further filter rising trends by time periods, categories and the type of search. The results show rising trends by topic and by keywords.

To search for specific trends users just need to enter the specific queries and then filter them by country, time, categories and type of search.

The section called Content Calendar describes how to use Google Trends to understand which content topics to prioritize.

Advertisement

Google explains:

“Google Trends can be helpful not only to get ideas on what to write, but also to prioritize when to publish it. To help you better prioritize which topics to focus on, try to find seasonal trends in the data. With that information, you can plan ahead to have high quality content available on your site a little before people are searching for it, so that when they do, your content is ready for them.”

Read the new Google Trends documentation:

Get started with Google Trends

Featured Image by Shutterstock/Luis Molinero

Source link

Advertisement
Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

Trending