Connect with us

SEO

Google Discusses Fixing 404 Errors From Inbound Links

Published

on

Google Discusses Fixing 404 Errors From Inbound Links

Google’s John Mueller responded to a thread in Reddit about finding and fixing inbound broken links, offering a nuanced insight that some broken links are worth finding and fixing and others are not.

Reddit Question About Inbound Broken Links

Someone asked on Reddit if there’s a way to find broken links for free.

This is the question:

“Is it possible to locate broken links in a similar manner to identifying expired domain names?”

The person asking the question clarified if this was a question about an inbound broken link from an external site.

John Mueller Explains How To Find 404 Errors To Fix

John Mueller responded:

Advertisement

“If you want to see which links to your website are broken & “relevant”, you can look at the analytics of your 404 page and check the referrers there, filtering out your domain.

This brings up those which actually get traffic, which is probably a good proxy.

If you have access to your server logs, you could get it in a bit more detail + see which ones search engine bots crawl.

It’s a bit of technical work, but no external tools needed, and likely a better estimation of what’s useful to fix/redirect.”

In his response, John Mueller answers the question on how to find 404 responses caused by broken inbound links and identify what’s “useful to fix” or to “redirect.”

Mueller Advises On When Not To “Fix” 404 Pages

John Mueller next offered advice on when it doesn’t make sense to not fix a 404 page.

Mueller explained:

Advertisement

“Keep in mind that you don’t have to fix 404 pages, having things go away is normal & fine.

The SEO ‘value’ of bringing a 404 back is probably less than the work you put into it.”

Some 404s Should Be Fixed And Some Don’t Need Fixing

John Mueller said that there are situations where a 404 error generated from an inbound link is easy to fix and suggested ways to find those errors and fix them.

Mueller also said that there are some cases where it’s basically a waste of time.

What wasn’t mentioned was what the difference was between the two and this may have caused some confusion.

Inbound Broken Links To Existing Webpages

There are times when another sites links into your site but uses the wrong URL. Traffic from the broken link on the outside site will generate a 404 response code on your site.

These kinds of links are easy to find and useful to fix.

Advertisement

There are other situations when an outside site will link to the correct webpage but the webpage URL changed and the 301 redirect is missing.

Those kinds of inbound broken links are also easy to find and useful to fix. If in doubt, read our guide on when to redirect URLs.

In both of those cases the inbound broken links to the existing webpages will generate a 404 response and this will show up in server logs, Google Search Console and in plugins like the Redirection WordPress plugin.

If the site is on WordPress and it’s using the Redirection plugin, identifying the problem is easy because the Redirection plugin offers a report of all 404 responses with all the necessary information for diagnosing and fixing the problem.

In the case where the Redirection plugin isn’t used one can also hand code an .htaccess rule for handling the redirect.

Lastly, one can contact the other website that’s generating the broken link and ask them to fix it. There’s always a small chance that the other site might decide to remove the link altogether. So it might be easier and faster to just fix it on your side.

Advertisement

Whichever approach is taken to fix the external inbound broken link, finding and fixing these issues is relatively simple.

Inbound Broken Links To Removed Pages

There are other situations where an old webpage was removed for a legitimate reason, like an event passed or a service is no longer offered.

In that case it makes sense to just show a 404 response code because that’s one of the reasons why a 404 response should be shown. It’s not a bad thing to show a 404 response.

Some people might want to get some value from the inbound link and create a new webpage to stand in for the missing page.

But that might not be useful because the link is for something that is irrelevant and of no use because the reason for the page no longer exists.

Even if you create a new reason, it’s possible that some of that link equity might flow to the page but it’s useless because the topic of that inbound link is totally irrelevant to anyting but the expired reason.

Advertisement

Redirecting the missing page to the home page is a strategy that some people use to benefit from the link to a page that no longer exists. But Google treats those links as Soft 404s, which then passes no benefit.

These are the cases that John Mueller was probably referring to when he said:

“…you don’t have to fix 404 pages, having things go away is normal & fine.

The SEO ‘value’ of bringing a 404 back is probably less than the work you put into it.”

Mueller is right, there are some pages that should be gone and totally removed from a website and the proper server response for those pages should be a 404 error response.

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address

SEO

10 Completely Free SEO Training Courses

Published

on

10 Completely Free SEO Training Courses

Learning SEO doesn’t have to break the bank. There are plenty of quality free SEO courses teaching everything from the basics to keyword research to link building.

Here are ten that won’t cost a dime.

Course provider: Ahrefs

Duration: 2 hours

Advertisement

Instructor(s): Sam Oh

Level: Beginner

Link: SEO Course for Beginners

What you’ll learn

  • The fundamentals of what search engine optimization is and how it works
  • Why SEO is important
  • How to do keyword research
  • How to optimize web pages for search engines
  • Beginner-friendly link building strategies to get backlinks to your site
  • Technical SEO best practices for beginners

This comprehensive course is ours and covers the fundamentals of SEO, including keyword research, on-page SEO, technical SEO, and link building.

SEO Certification Course by HubSpotSEO Certification Course by HubSpot

Course provider: HubSpot

Duration: 3 hours 51 minutes

Instructor(s): Rachel Sheldon, Matthew Howells-Barby

Advertisement

Level: Beginner

Link: SEO Certification Course

What you’ll learn

  • How to evaluate and improve your website’s SEO
  • How to build backlinks to your website at scale to increase your website’s visibility in organic search
  • How to use insights from keyword research and reporting to improve your search performance

HubSpot’s SEO Training Course is tailored for marketers, content creators, and anyone looking to enhance their website’s visibility. Through practical lessons and real-world examples, the course participants will learn how to build a robust SEO strategy, analyze their website’s performance, and adapt to the changing algorithms of search engines.

Make sure customers find you online by Google SkillshopMake sure customers find you online by Google Skillshop

Course provider: Google

Duration: 3 hours

Instructor(s): Google

Level: Beginner

Advertisement

Link: Make Sure Customers Find You Online

What you’ll learn

  • How to get started with search
  • How to make search work for you
  • How to get discovered with search
  • How to help people nearby find you online

This free course from Google Skillshop helps businesses discover ways to reach and connect with more customers online. It covers improving SEO and using online advertising (SEM) to boost sales and awareness.

Google SEO Fundamentals by UC Davis on CourseraGoogle SEO Fundamentals by UC Davis on Coursera

Course provider: University of California, Davis

Duration: 28 hours

Instructor(s): Rebekah May

Level: Beginner

Link: Google SEO Fundamentals

Advertisement

What you’ll learn

  • How to complete a competitive analysis on a webpage
  • How to interpret brand recognition through social media
  • How to create sitemaps and robot.txt files, plan redirects, and manage site errors
  • How to use a variety of SEO tools to conduct an audience analysis and develop personas of your ideal buyer

Offered by the University of California, Davis, this course on Coursera delves into the fundamental aspects of SEO, including how search engines work and how to implement effective SEO strategies to attract more organic traffic.

However, due to its length (28 hours), it may not be the most suitable if you want to learn SEO fast.

SEO for Beginners Training by YoastSEO for Beginners Training by Yoast

Course provider: Yoast

Duration: 2 hours

Instructor(s): Joost de Valk

Level: Beginner

Link: SEO for Beginners Training

Advertisement

What you’ll learn

  • What SEO is and what Google does
  • Tips for quick wins to improve your site
  • Insights into the content and technical side of SEO

This free course discusses what SEO is and how it works. Some of the important points from the course are how to use keywords to optimize your website, how to write content that Google likes, and how to make your website crawlable by search engines.

Keyword Research Course by AhrefsKeyword Research Course by Ahrefs

Course provider: Ahrefs

Duration: 2 hours

Instructor(s): Sam Oh

Level: Beginner

Link: Keyword Research Course

What you’ll learn

  • How to do keyword research and drive targeted traffic to your website

This is our specialized course that focuses specifically on keyword research. It covers topics such as how to choose keywords, how to analyze search intent, and how to find low-competition keywords.

Technical SEO Course by AhrefsTechnical SEO Course by Ahrefs

Course provider: Ahrefs

Duration: 1 hour 21 minutes

Advertisement

Instructor(s): Sam Oh

Level: Beginner to intermediate

Link: Technical SEO Course

What you’ll learn

  • The fundamentals of technical SEO
  • How to run a technical SEO audit
  • How to optimize your website’s technical SEO

Another specialized course from us, this course is designed for those looking to dive deeper into the technical side of SEO. It covers advanced topics such as site audits, page speed optimization, and how to resolve common technical issues that can impact search rankings.

Technical SEO Certification by Blue ArrayTechnical SEO Certification by Blue Array

Course provider: Blue Array

Duration: 7 hours

Instructor(s): Damion Edwards

Advertisement

Level: Beginner to intermediate

Link: Technical SEO Certification

What you’ll learn

Aimed at professionals seeking to certify their expertise, this course covers a wide range of technical SEO topics, including crawling, indexing, ranking, and on-page optimization. From site architecture to schema markup, it equips learners with the skills to tackle technical challenges and improve website performance.

Local SEO Course by AhrefsLocal SEO Course by Ahrefs

Course provider: Ahrefs

Duration: 44 minutes

Instructor(s): Sam Oh

Level: Beginner

Link: Local SEO Course

Advertisement

What you’ll learn

  • How to do local SEO
  • How to do local keyword research
  • How to do local link building

Ideal for businesses targeting local customers, this course teaches the basics of optimizing for local search. It covers essential tactics for improving local visibility, such as Google Business Profile optimization and local keyword targeting.

Advanced Link Building Course by AhrefsAdvanced Link Building Course by Ahrefs

Course provider: Ahrefs

Duration: 1 hour 48 minutes

Instructor(s): Sam Oh

Level: Intermediate to advanced

Link: Advanced Link Building Course

What you’ll learn

  • How to find prospects with the “seed and lookalike” approach
  • How to validate link building campaigns with a “blitz list”
  • How to craft personalized and benefit-rich outreach emails
  • How to create, structure and manage a link building team
  • How to scale your link building operations

Focusing on one of the most challenging aspects of SEO, Sam shares his years of experience creating campaigns, sending outreach emails, and building teams. This is a must-finish course if you need help building and scaling your link building operations.

Final thoughts

The best way to learn SEO is to do.

Advertisement

So, don’t just go through the courses, take notes, and leave it aside. You need to actually execute to find out what works and what doesn’t. Create a website, implement the ideas you’re learning, and see if you can get more organic traffic to it.

That’s how you become an SEO pro.

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

SEO

Google Answers A Crawl Budget Issue Question

Published

on

By

Google Answers A Crawl Budget Issue Question

Someone on Reddit posted a question about their “crawl budget” issue and asked if a large number of 301 redirects to 410 error responses were causing Googlebot to exhaust their crawl budget. Google’s John Mueller offered a reason to explain why the Redditor may be experiencing a lackluster crawl pattern and clarified a point about crawl budgets in general.

Crawl Budget

It’s a commonly accepted idea that Google has a crawl budget, an idea that SEOs invented to explain why some sites aren’t crawled enough. The idea is that every site is allotted a set number of crawls, a cap on how much crawling a site qualifies for.

It’s important to understand the background of the idea of the crawl budget because it helps understand what it really is. Google has long insisted that there is no one thing at Google that can be called a crawl budget, although how Google crawls a site can give an impression that there is a cap on crawling.

A top Google engineer (at the time) named Matt Cutts alluded to this fact about the crawl budget in a 2010 interview.

Matt answered a question about a Google crawl budget by first explaining that there was no crawl budget in the way that SEOs conceive of it:

Advertisement

“The first thing is that there isn’t really such thing as an indexation cap. A lot of people were thinking that a domain would only get a certain number of pages indexed, and that’s not really the way that it works.

There is also not a hard limit on our crawl.”

In 2017 Google published a crawl budget explainer that brought together numerous crawling-related facts that together resemble what the SEO community was calling a crawl budget. This new explanation is more precise than the vague catch-all phrase “crawl budget” ever was (Google crawl budget document summarized here by Search Engine Journal).

The short list of the main points about a crawl budget are:

  • A crawl rate is the number of URLs Google can crawl based on the ability of the server to supply the requested URLs.
  • A shared server for example can host tens of thousands of websites, resulting in hundreds of thousands if not millions of URLs. So Google has to crawl servers based on the ability to comply with requests for pages.
  • Pages that are essentially duplicates of others (like faceted navigation) and other low-value pages can waste server resources, limiting the amount of pages that a server can give to Googlebot to crawl.
  • Pages that are lightweight are easier to crawl more of.
  • Soft 404 pages can cause Google to focus on those low-value pages instead of the pages that matter.
  • Inbound and internal link patterns can help influence which pages get crawled.

Reddit Question About Crawl Rate

The person on Reddit wanted to know if the perceived low value pages they were creating was influencing Google’s crawl budget. In short, a request for a non-secure URL of a page that no longer exists redirects to the secure version of the missing webpage which serves a 410 error response (it means the page is permanently gone).

It’s a legitimate question.

This is what they asked:

“I’m trying to make Googlebot forget to crawl some very-old non-HTTPS URLs, that are still being crawled after 6 years. And I placed a 410 response, in the HTTPS side, in such very-old URLs.

So Googlebot is finding a 301 redirect (from HTTP to HTTPS), and then a 410.

Advertisement

http://example.com/old-url.php?id=xxxx -301-> https://example.com/old-url.php?id=xxxx (410 response)

Two questions. Is G**** happy with this 301+410?

I’m suffering ‘crawl budget’ issues, and I do not know if this two responses are exhausting Googlebot

Is the 410 effective? I mean, should I return the 410 directly, without a first 301?”

Google’s John Mueller answered:

G*?

301’s are fine, a 301/410 mix is fine.

Advertisement

Crawl budget is really just a problem for massive sites ( https://developers.google.com/search/docs/crawling-indexing/large-site-managing-crawl-budget ). If you’re seeing issues there, and your site isn’t actually massive, then probably Google just doesn’t see much value in crawling more. That’s not a technical issue.”

Reasons For Not Getting Crawled Enough

Mueller responded that “probably” Google isn’t seeing the value in crawling more webpages. That means that the webpages could probably use a review to identify why Google might determine that those pages aren’t worth crawling.

Certain popular SEO tactics tend to create low-value webpages that lack originality. For example, a popular SEO practice is to review the top ranked webpages to understand what factors on those pages explain why those pages are ranking, then taking that information to improve their own pages by replicating what’s working in the search results.

That sounds logical but it’s not creating something of value. If you think of it as a binary One and Zero choice, where zero is what’s already in the search results and One represents something original and different, the popular SEO tactic of emulating what’s already in the search results is doomed to create another Zero, a website that doesn’t offer anything more than what’s already in the SERPs.

Clearly there are technical issues that can affect the crawl rate such as the server health and other factors.

But in terms of what is understood as a crawl budget, that’s something that Google has long maintained is a consideration for massive sites and not for smaller to medium size websites.

Advertisement

Read the Reddit discussion:

Is G**** happy with 301+410 responses for the same URL?

Featured Image by Shutterstock/ViDI Studio

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

SEO

SEOs, Are You Using These 6 Mental Models?

Published

on

SEOs, Are You Using These 6 Mental Models?

People use mental models to comprehend reality, solve problems, and make decisions in everyday life. SEO is not an exception here, yet it’s not a topic you often hear about in this industry.

The thing is, you need to be careful with mental models because they’re sneaky. We tend to develop them during our lives, inherit them from our colleagues and mentors, and rely on them almost instinctively while not fully aware of their influence or the existence of better alternatives.

So, let’s talk about mental models you will find helpful in your SEO work and the ones you should approach with caution.

3 helpful mental models

In the noisy, uncertain world of SEO, these will be your north star.

Advertisement

First principles thinking is a problem-solving approach that involves breaking down complex problems into their most basic elements and reassembling them from the ground up.

It’s about asking oneself what is absolutely true about a situation and then reasoning up from there to create new solutions.

Using first principles thinking to rearrange the same building blocks into a brand new shape. 

Uncertainty is a chronic condition in SEO. And it is so by design because the whole industry is based on Google’s secrets. Access to the truth is extremely limited. We got to the point that we got used to accepting speculation and theories on SEO so much that we started to crave them.

This is where the first principles come in. Whenever you need a brand new solution for a problem or when you feel that you’ve gone too far into speculation, come back to the first principles — things that have the best chance to be true in this industry. For example:

The Pareto Principle (aka the 80/20 rule) is about a disproportionate relationship between inputs and outputs, effort and results, or causes and effects. A small number of causes (20%) often leads to a large number of effects (80%).

The Pareto principleThe Pareto principle
The 80/20 rule: 80% of results come from 20% of the projects.

This concept was named after Vilfredo Pareto, an Italian economist who, in 1906, noticed that 80% of Italy’s land was owned by 20% of the population.

If we use this principle as a mental model in decision-making, we’ll find it easier to prioritize work. It’s ok to ignore some things because they likely won’t matter that much. The result that you’re after will come from focusing on the things that will likely have the biggest impact, and not from spreading yourself too thin.

For example, if you want to build links to your site, pitch your best content. That can be the content that has already proven to earn links in the past.

Advertisement
Best by links report in Ahrefs.Best by links report in Ahrefs.

Or if you need to recover some of that lost traffic, home in on the pages that lost the most traffic.

Top pages report in Ahrefs. Top pages report in Ahrefs.

The key is to treat the 80/20 as an approximation, a heuristic, and not take the numbers literally. To illustrate, roughly 80% of our site’s traffic comes from no more than 6% of pages.

Total organic traffic breakdown in Ahrefs. Total organic traffic breakdown in Ahrefs.

But on the other hand, if we try to find the top 20% pages that contribute to the traffic the most, we’ll find that they bring not 80% but 96.8% traffic. However you look at it, the idea still holds — a small amount of causes led to a large portion of effects.

“It takes all the running you can do, to keep in the same place.”

Sounds very much like SEO already, doesn’t it?

This quote comes from Lewis Carroll’s “Through the Looking-Glass,” and it’s how the Red Queen explains to Alice the nature of her kingdom, where it requires constant effort just to maintain one’s current position.

It was used to name an evolutionary biology theory which posits that each species must adapt and evolve not just for incremental gains but for survival, as their competitors are also evolving. Sorry, we’re in an endless race.

The Red Queen Theory as an endless race.The Red Queen Theory as an endless race.
SEO is like a road with no finish line—the race continues forever.

You can probably already guess how this applies to SEO — rankings. If you want to maintain high rankings, you can’t stop improving your pages. There will always be enough competitors to challenge your position.

But in our world, pressure comes from competitors and the environment. Google keeps evolving too, pushing the bar for content higher, making elements that used to give you an edge a standard.

I’m sure we’ve all been there – even our top backlink-earning, top traffic-generating, most time-consuming content gets pushed down. But if you keep optimizing, you get a chance to come back to the top.

Position history graph in Ahrefs.Position history graph in Ahrefs.

This mental model is another way of saying that SEO works best as an always-on strategy without a set end date or final goal.

3 mental models to watch out for

It’s not so much about avoiding them but being able to spot them when they happen or could happen.

Advertisement

A local maximum (aka local optimum) refers to a solution that is the best solution within a neighboring set of solutions, but not necessarily the best possible solution overall (global optimum).

Local maxima.Local maxima.

So if you’re feeling that you’re spending immense effort just to make marginal improvements, you have to be willing to assume that you’ve hit a local maxima. Then, the question to ask is: what can I do differently?

Here’s an example.

Until November last year, traffic to our site was a series of local optima. Our content marketing was delivering the results, but the growth was relatively slow. Obviously, we were doing the same tried and tested stuff. But then we launched two programmatic SEO projects that instantly elevated us to a level we’d have to work years for — look how fast the yellow line grew (pages) and how that corresponded with the orange line (traffic).

Organic performance graph in Ahrefs.Organic performance graph in Ahrefs.

The sunk cost fallacy is a cognitive bias that occurs when people continue to do something as a result of previously invested resources (time, money, effort) despite new evidence suggesting that the current path will not lead to a beneficial outcome.

Sunk cost fallacy as a graph.Sunk cost fallacy as a graph.
Sunk cost in action: the more you invest in something, the more attached to it you become.

We all know SEO is a long-term game, right? Strategies like these are crowded with long-term projects with big time and money investments. Sometimes, despite the investments, you just can’t go beyond a certain level of traffic, backlinks, etc.

Now, this mental model, this voice in your head, will tell you to keep going down the same path no matter what. Loss aversion kicks in, acting like a defense mechanism for your past selves and actions. And the more aggressive and blind the “hustle” culture is at one’s team, the harder it is to see clearly.

But, overall, it could be better for you and the company to let it go and focus on something else. You can even come back to it later with a fresh mind. But continuing something just because you’ve been doing it for some time is a losing strategy.

Example. Despite several attempts and time counted in years, Ahrefs doesn’t rank for “seo”.

Advertisement
Position history for "seo" via Ahrefs.Position history for "seo" via Ahrefs.

Sad but true. And from our point of view, it’s frustrating. Almost like we’re the only ones not to get invited to the party, the only ones not to graduate from high school… you get the idea.

But not ranking for “SEO” hasn’t hindered our growth, so it’s better to cut losses and deal with unfulfilled ambition than to let that goal hold us back from other projects (like that programmatic project mentioned above).

Confirmation bias is the tendency to give more attention and weight to data that support one’s own beliefs, while simultaneously dismissing or underestimating evidence that contradicts those beliefs.

Confirmation bias - beliefs outweigh the facts. Confirmation bias - beliefs outweigh the facts.

We’re all guilty of this. It’s human nature. And it’s not exclusively a bad thing. I mean, in some situations, this tendency can keep us on “the bright side” and help us go through tough times or keep our motivation up.

So, I think that it’s not something to get out of your system completely. Just be mindful of situations where this can negatively affect your judgment:

  • Selective evidence in ranking factors. You see a page ranking high, and you think it’s because of an aspect you strongly believe in, disregarding all of the evidence against it (e.g., long-form content, social signals).
  • Bias in keyword selection. Your keyword selection runs along the lines of your beliefs about the audience preferences without substantial evidence to back up these beliefs.
  • Bias in strategy development. After developing a new strategy, you encounter a talk or an article advocating a similar approach, which immediately reinforces your confidence in this strategy.
  • Focus on confirmatory data during audits. During a content audit, you find a small piece of data that confirms your belief. As a result, you may prioritize minor findings over more significant but less personally affirming data.
  • Overconfidence in familiar tactics. Leaning on SEO tactics that have worked in the past, you develop a sense of overconfidence in them. You resist trying anything new or the idea that a dip in performance comes from an unfamiliar factor.

Keep learning

If you like what you’re reading, I think you will find other mental models fascinating:

Want to share models you find useful? Ping me on X or LinkedIn.



Source link

Advertisement
Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

Trending

Follow by Email
RSS