Connect with us


How To Automate Ecommerce Category Page Creation With Python



Clustering product inventory and automatically aligning SKUs to search demand is a great way to find opportunities to create new ecommerce categories.

Niche category pages are a proven way for ecommerce sites to align with organic search demand while simultaneously assisting users in purchasing.

If a site stocks a range of products and there is search demand, creating a dedicated landing page is an easy way to align with the demand.

But how can SEO professionals find this opportunity?

Sure, you can eyeball it, but you’ll usually leave a lot of opportunity on the table.

This problem motivated me to script something in Python, which I’m sharing today in a simple to use Streamlit application. (No coding experience required!)

The app linked above created the following output automatically using nothing more than two crawl exports!

Screenshot from Microsoft Excel, May 2022A csv file export showing new subcategories generated automatically using Python

Notice how the suggested categories are automatically tied back to the existing parent category?

A csv export showing that the new subcategories have been tied back to their parent category.Screenshot from Microsoft Excel, May 2022A csv export showing that the new subcategories have been tied back to their parent category.

The app even shows how many products are available to populate the category.

the number of products available to populate the new subcategories have been highlighted.Screenshot from Microsoft Excel, May 2022the number of products available to populate the new subcategories have been highlighted.

Benefits And Uses

  • Improve relevancy to high-demand, competitive queries by creating new landing pages.
  • Increase the chance of relevant site links displaying underneath the parent category.
  • Reduce CPCs to the landing page through increased relevancy.
  • Potential to inform merchandising decisions. (If there is high search demand vs. low product count – there is a potential to widen the range.0
    A mock up image displaying the new categories as sitelinks within the Google search engine.Mock-up Screenshot from Google Chrome, May 2022A mock up image displaying the new categories as sitelinks within the Google search engine.

Creating the suggested subcategories for the parent sofa category would align the site to an additional 3,500 searches per month with relatively little effort.


  • Create subcategory suggestions automatically.
  • Tie subcategories back to the parent category (cuts out a lot of guesswork!).
  • Match to a minimum of X products before recommending a category.
  • Check similarity to an existing category (X % fuzzy match) before recommending a new category.
  • Set minimum search volume/CPC cut-off for category suggestions.
  • Supports search volume and CPC data from multiple countries.

Getting Started/Prepping The Files

To use this app you need two things.

At a high level, the goal is to crawl the target website with two custom extractions.

The internal_html.csv report is exported, along with an inlinks.csv export.

These exports are then uploaded to the Streamlit app, where the opportunities are processed.

Crawl And Extraction Setup

When crawling the site, you’ll need to set two extractions in Screaming Frog – one to uniquely identify product pages and another to uniquely identify category pages.

The Streamlit app understands the difference between the two types of pages when making recommendations for new pages.

The trick is to find a unique element for each page type.

(For a product page, this is usually the price or the returns policy, and for a category page, it’s usually a filter sort element.)

Extracting The Unique Page Elements

Screaming Frog allows for custom extractions of content or code from a web page when crawled.

This section may be daunting if you are unfamiliar with custom extractions, but it’s essential for getting the correct data into the Streamlit app.

The goal is to end up with something looking like the below image.

(A unique extraction for product and category pages with no overlap.)

A screenshot from screaming frog showing two custom extractions to unique identify product and category pagesScreenshot from Screaming Frog SEO Spider, May 2022A screenshot from screaming frog showing two custom extractions to unique identify product and category pages

The steps below walk you through manually extracting the price element for a product page.

Then, repeat for a category page afterward.

If you’re stuck or would like to read more about the web scraper tool in Screaming Frog, the official documentation is worth your time.

Manually Extracting Page Elements

Let’s start by extracting a unique element only found on a product page (usually the price).

Highlight the price element on the page with the mouse, right-click and choose Inspect.

A screenshot demonstrating how to use the inspect element feature of Google Chrome to extract a CSS Selector.Screenshot from Google Chrome, May 2022A screenshot demonstrating how to use the inspect element feature of Google Chrome to extract a CSS Selector.

This will open up the elements window with the correct HTML line already selected.

Right-click the pre-selected line and choose Copy > Copy selector. That’s it!

A screenshot showing how to cop the CSS selector for use in Screaming FrogScreenshot from Google Chrome, May 2022A screenshot showing how to cop the CSS selector for use in Screaming Frog

Open Screaming Frog and paste the copied selector into the custom extraction section. (Configuration > Custom > Extraction).

A screenshot from Screaming Frog showing how to use a custom extractorScreenshot from Screaming Frog SEO Spider, May 2022A screenshot from Screaming Frog showing how to use a custom extractor

Name the extractor as “product,” select the CSSPath drop down and choose Extract Text.

Repeat the process to extract a unique element from a category page. It should look like this once completed for both product and category pages.

A screenshot from Screaming Frog showing the custom extractor correctly populatedScreenshot from Screaming Frog SEO Spider, May 2022A screenshot from Screaming Frog showing the custom extractor correctly populated

Finally, start the crawl.

The crawl should look like this when viewing the Custom Extraction tab.

A screenshot showing unique extractions for product and category pagesScreenshot from Screaming Frog SEO Spider, May 2022A screenshot showing unique extractions for product and category pages

Notice how the extractions are unique to each page type? Perfect.

The script uses the extractor to identify the page type.

Internally the app will convert the extractor to tags.

(I mention this to stress that the extractors can be anything as long as they uniquely identify both page types.)

A screenshot of how the app / script interprets the custom extractions to tag each pageScreenshot from Microsoft Excel, May 2022A screenshot of how the app / script interprets the custom extractions to tag each page

Exporting The Files

Once the crawl has been completed, the last step is to export two types of CSV files.

  • internal_html.csv.
  • inlinks to product pages.

Go to the Custom Extraction tab in Screaming Frog and highlight all URLs that have an extraction for products.

(You will need to sort the column to group it.)

A screenshot showing how to select the inlinks report from Screaming Frog ready for exportingScreenshot from Screaming Frog SEO Spider, May 2022A screenshot showing how to select the inlinks report from Screaming Frog ready for exporting

Lastly, right-click the product URLs, select Export, and then Inlinks.

A screenshot showing how to right click in Screaming Frog to export the inlinks report.Screenshot from Screaming Frog SEO Spider, May 2022A screenshot showing how to right click in Screaming Frog to export the inlinks report.

You should now have a file called inlinks.csv.

Finally, we just need to export the internal_html.csv file.

Click the Internal tab, select HTML from the dropdown menu below and click on the adjacent Export button.

Finally, choose the option to save the file as a .csv

A screenshot in Screaming Frog showing how to export the internal_html.csv reportScreenshot from Screaming Frog SEO Spider, May 2022A screenshot in Screaming Frog showing how to export the internal_html.csv report

Congratulations! You are now ready to use the Streamlit app!

Using The Streamlit App

Using the Streamlit app is relatively simple.

The various options are set to reasonable defaults, but feel free to adjust the cut-offs to better suit your needs.

I would highly recommend using a Keywords Everywhere API key (although it is not strictly necessary as this can be looked up manually later with an existing tool if preferred.

(The script pre-qualifies opportunity by checking for search volume. If the key is missing, the final output will contain more irrelevant words.)

If you want to use a key, this is the section on the left to pay attention to.

A screenshot showing the area to paste in the option Keywords Everywhere API keyScreenshot from, May 2022A screenshot showing the area to paste in the option Keywords Everywhere API key

Once you have entered the API key and adjusted the cut-offs to your links, upload the inlinks.csv crawl.

A screenshot showing how to upload the inlinks.csv report Screenshot from, May 2022A screenshot showing how to upload the inlinks.csv report

Once complete, a new prompt will appear adjacent to it, prompting you to upload the internal_html.csv crawl file.

A screenshot showing how to upload the internal_html.csv reportScreenshot from, May 2022A screenshot showing how to upload the internal_html.csv report

Finally, a new box will appear asking you to select the product and column names from the uploaded crawl file to be mapped correctly.

A screenshot demonstrating how to correct map the column names from the crawlScreenshot from, May 2022A screenshot demonstrating how to correct map the column names from the crawl

Click submit and the script will run. Once complete, you will see the following screen and can download a handy .csv export.

A screenshot showing the Streamlit app after it has successfully run a reportScreenshot from, May 2022A screenshot showing the Streamlit app after it has successfully run a report

How The Script Works

Before we dive into the script’s output, it will help to explain what’s going on under the hood at a high level.

At a glance:

  • Generate thousands of keywords by generating n-grams from product page H1 headings.
  • Qualify keywords by checking whether the word is in an exact or fuzzy match in a product heading.
  • Further qualify keywords by checking for search volume using the Keywords Everywhere API (optional but recommended).
  • Check whether an existing category already exists using a fuzzy match (can find words out of order, different tenses, etc.).
  • Uses the inlinks report to assign suggestions to a parent category automatically.

N-gram Generation

The script creates hundreds of thousands of n-grams from the product page H1s, most of which are completely nonsensical.

In my example for this article, n-grams generated 48,307 words – so this will need to be filtered!

An example of the script generating thousands of nonsensical n-gram combinations.Screenshot from Microsoft Excel, May 2022An example of the script generating thousands of nonsensical n-gram combinations.

The first step in the filtering process is to check whether the keywords generated via n-grams are found at least X times within the product name column.

(This can be in an exact or fuzzy match.)

Anything not found is immediately discarded, which usually removes around 90% of the generated keywords.

The second filtering stage is to check whether the remaining keywords have search demand.

Any keywords without search demand are then discarded too.

(This is why I recommend using the Keywords Everywhere API when running the script, which results in a more refined output.)

It’s worth noting you can do this manually afterward by searching Semrush/Ahrefs etc., discarding any keywords without search volume, and running a VLOOKUP in Microsoft Excel.

Cheaper if you have an existing subscription.

Recommendations Tied To Specific Landing Pages

Once the keyword list has been filtered the script uses the inlinks report to tie the suggested subcategory back to the landing page.

Earlier versions did not do this, but I realized that leveraging the inlinks.csv report meant it was possible.

It really helps understand the context of the suggestion at a glance during QA.

This is the reason the script requires two exports to work correctly.


  • Not checking search volumes will result in more results for QA. (Even if you don’t use the Keywords Everywhere API, I recommend shortlisting by filtering out 0 search volume afterward.)
  • Some irrelevant keywords will have search volume and appear in the final report, even if keyword volume has been checked.
  • Words will typically appear in the singular sense for the final output (because products are singular and categories are pluralized if they sell more than a single product). It’s easy enough to add an “s” to the end of the suggestion though.

User Configurable Variables

I’ve selected what I consider to be sensible default options.

But here is a run down if you’d like to tweak and experiment.

  • Minimum products to match to (exact match) – The minimum number of products that must exist before suggesting the new category in an exact match.
  • Minimum products to match to (fuzzy match) – The minimum number of products that must exist before suggesting the new category in a fuzzy match, (words can be found in any order).
  • Minimum similarity to an existing category – This checks whether a category already exists in a fuzzy match before making the recommendation. The closer to 100 = stricter matching.
  • Minimum CPC in $ – The minimum dollar amount of the suggested category keyword. (Requires the Keywords Everywhere API.)
  • Minimum search volume – The minimum search volume of the suggested category keyword. (Requires Keywords Everywhere API.)
  • Keywords Everywhere API key – Optional, but recommended. Used to pull in CPC/search volume data. (Useful for shortlisting categories.)
  • Set the country to pull search data from – Country-specific search data is available. (Default is the USA.)
  • Set the currency for CPC data – Country-specific CPC data is available. (Default USD.)
  • Keep the longest word suggestion – With similar word suggestions, this option will keep the longest match.
  • Enable fuzzy product matching – This will search for product names in a fuzzy match. (Words can be found out of order, recommended – but slow and CPU intensive.)


With a small amount of preparation, it is possible to tap into a large amount of organic opportunity while improving the user experience.

Although this script was created with an ecommerce focus, according to feedback, it works well for other site types such as job listing sites.

So even if your site isn’t an ecommerce site, it’s still worth a try.

Python enthusiast?

I released the source code for a non-Streamlit version here.

More resources:

Featured Image: patpitchaya/Shutterstock


if( typeof sopp !== “undefined” && sopp === ‘yes’ ){
fbq(‘dataProcessingOptions’, [‘LDU’], 1, 1000);
fbq(‘dataProcessingOptions’, []);

fbq(‘init’, ‘1321385257908563’);

fbq(‘track’, ‘PageView’);

fbq(‘trackSingle’, ‘1321385257908563’, ‘ViewContent’, {
content_name: ‘python-ecommerce-category-pages’,
content_category: ‘ecommerce technical-seo’

Source link


What Are the Benefits of SEO? (And How to Get Started)



What Are the Benefits of SEO? (And How to Get Started)

If you are a business owner, you may have heard about how vital search engine optimization (SEO) is. But how can it help fast-track your business’s growth, get more customers, and make a difference to your bottom line?

In more simple terms: Why do SEO? 

1. It increases your organic share of voice

There are an estimated 3.5 billion searches on Google each day. To tap into this audience, you’ll need to do SEO. 

One of the key benefits of SEO is increasing your organic share of voice (SOV). More organic SOV means more traffic, leads, and revenue for your business.

It also means more market share in your industry. We can see from the graph below that there is a strong relationship between SOV and market share

Relationship between SOV and market share graph

At Ahrefs, we calculate organic SOV by dividing the traffic to the site by the total search traffic for all keywords.

In other words, if you only track one keyword and the top 10 positions are occupied by pages of your website, your SOV is 100%.

So how can you measure organic SOV?

We first need to create a new project in Ahrefs’ Rank Tracker and add our keywords for the website we want to track.

How to add keywords in Ahrefs' Rank Tracker, via Ahrefs' Rank Tracker

Once you have added a new project and added your keywords, you can go to the dashboard and check your SOV.

It should look something like this:

SOV screenshot, via Ahrefs' Rank Tracker

If you click through the SOV on the dashboard, you can look at your competitor’s SOV compared to your SOV.

SOV vs. competitors screenshot, via Ahrefs' Rank Tracker

If no competitors are showing in your dashboard, you can change that by: 

  • Going into Settings.
  • Clicking on the Competitors tab.
  • Clicking on + Add competitor.

Enter your competitors manually or press the + to add them from the list below that shows the keyword intersection.

Adding competitors via settings menu, via Ahrefs' Rank Tracker

Once you are happy, click the Save button and return to the dashboard. You should now be able to compare your competitor’s SOV against your website’s SOV. 


Check out Michal Pecánek’s article on SOV to get a detailed guide on how to measure SOV.

2. It’s less intrusive than other types of marketing

Intrusive marketing is annoying.

It may seem obvious. But when our lives are full of adverts, cold calls, and emails from random people trying to sell you their products all the time, it’s very advantageous to be an inbound marketing channel

Intrusive outreach example, via
An intrusive marketing example sent to me from LinkedIn.

SEO targets people who are actively searching for your services or products. 

Because of this, it’s excellent at converting—all you need to do is focus on what they are searching for.

You can find what your customers are searching for using Ahrefs’ Keywords Explorer.

Enter a relevant topic and go to the Matching terms report. Here, you’ll see many topics your customers are searching for, which you can target.

Matching terms report example, via Ahrefs' Keywords Explorer

You can search, discover, and analyze keywords using our very own Ahrefs’ Keywords Explorer.

SEO is not just for Christmas.

In all, 45.6% of SEOs say SEO takes about three to six months. It may seem like a long time for the channel to work, but SEO is a long-term marketing channel where growth typically compounds over time. In other words, if you put the time and effort into SEO, the results will likely be well worth it. 

Looking at Ahrefs’ organic traffic graph, most of our rapid growth occurred in the last year or so when our traffic started to compound. organic traffic performance

Google’s algorithm updates mean that your website’s traffic will fluctuate. But as you can see from the graph, it’s a positive trend in the long term.

Over time, you should be able to rely on SEO to bring in a constant stream of traffic to your site. 

When we asked ~4,300 SEOs how long SEO takes, they gave a variety of responses. But only 16.2% of SEOs said that SEO takes between one and three months.

Pie chart showing percentage breakdown of SEOs responses to how long SEO takes

I agree with the majority of SEOs here. But I would add a qualifier—that it depends on the type of website you are working on.

For example, if you set up a brand-new website, it will have little to no authority. This is because it will have no links pointing to it and will probably have minimal content on the site. 

These elements are just some indicators or ways in which Google judges your website’s authority and decides which top results should be on its SERPs.


If you are improving the SEO of a website that’s been around for a few years, then the SEO will likely take effect faster. This is based on my experience, but you may get different results with your website.

Unlike paying for PPC, organic search traffic is free. 

If Ahrefs used PPC to pay for its organic traffic, Ahrefs’ Site Explorer estimates it would cost an eye-watering $2.3 million per month or $27.6 million per year.

Monetary value of Ahrefs' organic traffic, via Ahrefs' Site Explorer

You can see from this example why improving SEO and increasing your organic traffic can be a highly valuable investment for your business.

Getting started with SEO doesn’t always mean you have to spend a lot, either. If you are willing to learn about SEO basics, you can do a lot of the work yourself to bring costs down.


When it comes to tools, you don’t have to spend a lot when you are starting out. You can use Ahrefs Webmaster Tools for auditing your site and our free SEO tools to optimize it further.

It’s always on—24/7

Unlike paid marketing, SEO is always on. It continues to work for you while you are asleep. 

You’ll get more overall value from SEO than other marketing channels. It doesn’t cost any extra to have it running all the time.

Another benefit is that once your website is established with good rankings, SEO will maintain them over time and drive consistent traffic to your website. 

The only thing that can stop this is if there is a serious technical issue with your site or you have fallen foul of Google’s search guidelines

Reduce your dependency on PPC 

It’s easy for a business to rely on pay-per-click (PPC) marketing, but it can be expensive to maintain this marketing strategy. 

SEO can help you change this.

Once you have some important keywords ranking number #1 on Google, you can consider turning off some of your PPC marketing, which could result in significant savings for your business.

5. It improves user experience

Many people have high expectations for websites these days. They expect them to be clear, intuitive, and lightning-fast. 

When websites don’t work as people expect, they get frustrated. And if they have a bad experience, this can create a negative perception of the brand. 

To do well in SEO, you’ll need to provide your visitors with the best possible user experience. 

But how can you optimize for user experience in SEO?

SEOs typically divide user experience issues into three categories: 

  • Site speed
  • Core Web Vitals
  • On-site optimization

Let’s take a closer look.

Site speed

Site speed is one of the most critical factors for your visitors. If your website is slow to use, visitors will likely leave your site and probably not return.

A few years ago, Google tested 900,000 websites worldwide. It reported that 53% of people would leave a website if it took three seconds or more to load.

To test your site speed, you can use a tool like Let’s take a look at Ahrefs speed metrics using this tool.

Ahrefs' speed performance

We can see above that the speed index is under three seconds for Ahrefs. If your website loads in more than three seconds, then you may want to consider speeding up your website. 

Core Web Vitals

Core Web Vitals are Google’s quality signals it introduced to quantify the user experience of your website. 

They are:

  • Largest Contentful Paint (LCP) – For load performance.
  • First Input Delay (FID) – For visual stability.
  • Cumulative Layout Shift (CLS) – For interactivity.

Here’s what Google classifies as good and bad scores for these metrics.

Good Needs improvement Poor
LCP <=2.5s <=4s >4s
FID <=100ms <=300ms >300ms
CLS <=0.1 <=0.25 >0.25

Defining metrics for user experience is a benefit, as website owners can know exactly how their websites perform against Google’s expectations. 

Monitoring Core Web Vitals and site performance may sound technical, but you can keep an eye on them using Ahrefs’ Site Audit

For example, here’s a screenshot from the Performance dashboard highlighting two issues with CLS and LCP. 

Pages with poor CLS and poor LCP, via Ahrefs' Site Audit

As you can see from the above, Site Audit automatically identifies all low-performing pages for you.

On-page optimization

On-page optimization is another area of SEO that can help benefit your website. With on-page optimization, SEOs critically examine your website and audit it for any issues that may impact the user experience.

A good example of on-page optimization is adding subheadings, or heading tags, to your articles. Adding subheadings makes your content easier to read by establishing a visual hierarchy.

Subheadings improve readability by creating visual hierarchy

On-page optimization is less quantifiable than Core Web Vitals, but spending time on it will pay dividends for your website in the long run.

Ahrefs’ Site Audit can monitor headings, image alt text, internal linking, and other on-page optimization factors.

Here’s an example of a scheduled report you can get for heading optimization opportunities.

Heading optimization opportunities, via Ahrefs' Site Audit

You can use this report to identify many improvement opportunities for your website.

6. It puts your store online

If your business has a physical store, you can add it to a Google Business Profile for free.

Google My Business local listing example for Google San Francisco

Adding your business to Google’s business listings means you will appear on Google Maps when someone searches for your business or related keywords.

It’s a great way to highlight your business locally. For some businesses focused on local trade, this listing can be one of their most crucial organic search assets.

It also gives you a helpful way to communicate your business hours and opening times to your customers—something they will appreciate.

By having a solid organic presence and utilizing tools such as Google Business Profile, you can be sure that your online business will pick up sales even when you can’t open your physical store. 

So how do you set up your own Google Business Profile listing?

Setting up a Google Business Profile is straightforward and a three-step process.

  1. Claim your business profile 
  2. Add your business hours and details 
  3. Manage your profile, share any business updates, and respond to customer reviews

Once you have done this, you can monitor your business profile’s performance with the built-in analytics.

GMB analytics, via Google My Business

Using a Google Business Profile allows you to discover how people are searching for your website and helps you to understand how your business connects with customers online.

Building trust with customers is just as important online as it is offline. You wouldn’t buy something from a physical shop if the shop was run-down and the service was poor. 

The same applies to websites.

Your website should be fully operational and perform well in search engines. It should be secure and provide a great user experience to your customers. 

Having good SEO on your website shows you’re an authority in your industry. It shows you have the information and expertise customers are looking for.

It also means searchers will click on your website in the results because it is more prominent than your competitors—you will get the customers, and they won’t. 

The bottom line here is that by improving your website’s SEO, more visitors will trust your brand, which will drive more traffic and sales.

Learn more

Now you know the key benefits of SEO, you may want to start learning about it in more detail.

I’ve collected some helpful resources below to help you get started, so you can learn about SEO and start to reap the benefits:

Got more questions? Ping me on Twitter. 🙂

Source link

Continue Reading


How To Get More Traffic By Fixing Keyword Cannibalizations



How To Get More Traffic By Fixing Keyword Cannibalizations

This post was sponsored by DinoRANK. The opinions expressed in this article are the sponsor’s own.

Google is a great source of qualified and recurring traffic for your business – that’s a fact.

Many people say that the key to SEO success is to establish yourself as an authoritative source for all the keywords in your industry, even niche keywords.

Unfortunately, your competition is doing the same thing. In some cases, you may even be competing with yourself.

Everyone is creating the same content to rank high on Google. So, you need to set yourself apart.

Your competition may be using the same niche keywords as you, but are they optimizing their domain’s SEO by cleaning up cannibalized content and keyword cannibalization?

They may not be; so, this is a great way to propel your website to the top of Google.

What Is Keyword Cannibalization In SEO?

As you may know, sometimes two or more URLs on the same domain may rank for the same keyword or group of keywords.

When this happens, Google does not know which piece of content to show on search engine results pages (SERPs).

When these URLs compete for the same search terms, it is called SEO cannibalization.

How Cleaning Up Cannibalization Can Instantly Boost Your Rankings

When you and your competition are ranking for the same keywords, yet your position on SERPs is lower, you may have a cannibalization issue.

If your content is cannibalizing itself, you not only have to fight your competitors for a top position – you also have to fight your own pages.

There’s enough competition out there without having it at home, right?

Cannibalization is a detrimental factor when URLs compete with each other. They can even harm your domain authority if there are too many of them, especially if you haven’t told Google that there is a clear difference between two similar pieces of content.

As you can see, cannibalizations have a negative influence on your domain’s SEO.

To solve the cannibalization problem, we must first know how to find them.

How To Find Cannibalization On Your Website

There are different ways to find cannibalization on your domain:

  • The Manual Way
  • The Easy Way

How To Find Cannibalized Keywords By Hand

There are two ways to locate content and keyword cannibalization without using a tool:

  1. Use a rank tracker or Google Search Console to see which positions your pages are ranking in the search results, as well as the keywords they are ranking for; then, find matching URLs for the same keywords.
  2. Review your site’s content manually to see if there are several pages that address the same topic or include the same keywords. Then, go to Google and search for that keyword you suspect you are cannibalizing and check if you really do it or not; this can also help you prevent it from happening.

How To Locate Keyword Cannibalization With A Single Click

Using DinoRANK, you can simply click one button and instantly see all your cannibalized content.

All you’ll need to do is create a project in the tool, and sync it with your Google Analytics and Google Search Console account. DinoRANK does the rest.

Screenshot from, January 2023

See what content is cannibalized on your website now →

Now, once you have located all the cannibalizations that affect your website, what decision should you make? 

What Is The Best Way To Fix Cannibalization?

Once you have found the cannibalizations on your website, you can take these steps to solve the problem:

  • Join or merge two URLs into one.
  • Make a 301 redirect.
  • Make a shift in focus to one of the two contents and de-optimize or optimize for the word that it cannibalizes.
  • Place a canonical tag in one of the two URLs.
  • Remove one of the two contents if you consider it thin content or duplicate content.

How Do I Pick The Best Method?

What analysis should you do when facing cannibalization to perform the most optimal action?

Let’s say that you have 2 URLs of the same domain that are positioned for the same keyword; 1 URL is in position 5, and the other URL is in position 7 on the SERPs.

In this case, you should:

  1. Check the content of both pages to see if they are addressing the same topic or include the same keywords. If so, they are probably competing with each other and causing cannibalization.
  2. Review the page authority of each page, as measured by the number of inbound links, quality of links, site structure, etc. The page with higher authority will likely perform better in search results.
  3. Check the traffic received by each page to see which one is receiving more visits, and analyze which URL is responding better to the search intention of that or those keywords.
  4. Check the conversion rates of each page to see which is generating more sales or conversion actions.

Once the analysis is done, you will have enough elements to recognize what action you should take in each cannibalization.

Still not sure?

Don’t worry. DinoRANK will show you recommendations on how to proceed, depending on the case.

How To Get More Traffic By Fixing Keyword Cannibalizations Quickly &#038; EffectivelyScreenshot from, January 2023

Usually, content is consolidated into one of the two cannibalized URLs (the one with higher authority or higher traffic), and the discarded URL should become a 301 redirect.

The impact of this repair is usually positive in a very high number of cases. 

Although if both contents fulfill their function (for example, one URL belongs to the product card and the other to a blog post), a better option would be to optimize or de-optimize the content as appropriate or choose to implement a canonical tag to one of the URLs to indicate to search engines which is the main page.

In any case, it is important to continuously monitor the performance of the pages and make adjustments if necessary to avoid cannibalization in the future; with DinoRANK you will have this under control.

How To Optimize Or De-Optimize Content That Is Cannibalizing

Search engines use algorithms to determine the relevance of a web page for a given search query, and one of the ways they do this is by identifying the keywords that appear most frequently on a page, relative to the keywords that appear on other similar pages.

Before optimizing or de-optimizing one of the two contents, it’s important to know all the keywords for each URL being cannibalized.

Then, you’ll need to analyze their semantic content with TF*IDF analysis.

So, analyzing a URL whose content you want to optimize/promote for a specific keyword with TF*IDF will allow you to understand which keywords are relevant to that content.

How To Get More Traffic By Fixing Keyword Cannibalizations Quickly &#038; EffectivelyScreenshot from, January 2023

Expanding and semantically optimizing content that is already ranking highly, whether it is cannibalizing or not, is one of the best ways to gain more relevance for those terms that only received impressions or a few clicks. This is because you are now providing a greater semantic richness to that content.

With DinoRANK, you can use TF*IDF analysis on already published URLs to see how to optimize them.

You can also use this feature when you want to create new content based on a keyword or a group of keywords you want to rank for.

How To Get More Traffic By Fixing Keyword Cannibalizations Quickly &#038; EffectivelyScreenshot from, January 2023

DinoRANK arranges the information visually, separating the graph into three filter layers: one keyword, two keywords, and three keywords.

How To Get More Traffic By Fixing Keyword Cannibalizations Quickly &#038; EffectivelyScreenshot from, January 2023

In addition to the recommendations, you will also be able to quickly see the header structure used by your most direct competitors in Google’s Top 10.

In a very short time, you’ll discover opportunities and content ideas with an optimal heading structure, including the related semantic keywords needed to rank.

If, in addition, this semantic content extension is complemented by some internal links to that optimized URL, and you do it with anchor text of the primary keyword or exact semantic keywords, you will strengthen the authority and the typicality of that URL you want to promote.

With internal links, you derive a greater semantic context and strengthen the authority of that page already optimized, thanks to the semantic prominence analysis TF*IDF.

If you want to use these features to work the SEO of your projects in a simple but effective way, you can try DinoRANK.

All the SEO your website needs can be found in DinoRANK.

Source link

Continue Reading


Microsoft Announces ChatGPT Capabilities Coming To Bing



Microsoft Announces ChatGPT Capabilities Coming To Bing

Microsoft announced today that it is bringing cutting-edge AI capabilities to its Bing search engine, with the addition of a new ChatGPT-like feature.

Microsoft revealed its plans for integrating ChatGPT at a private event held at its Redmond headquarters today, which centered around its partnership with OpenAI.

Unlike recent virtual events, this particular press conference was held in person and not broadcast online.

During the event, Microsoft CEO Satya Nadella highlighted the significance of this new feature and how it will revolutionize the way people interact with search engines.

“I think this technology is going to reshape pretty much every software category,” says Nadella.

Nadella proclaimed, “The race starts today,” and Microsoft is going to “move and move fast.”

The event attendees were given a sneak peek at the latest search experience, which Microsoft refers to as “your AI-powered copilot for the web.”

This new experience combines the all-new Bing search engine and Edge web browser, which are designed to complement each other.

Nadella explained that the new Bing would provide direct answers to questions and encourage users to be more creative.

He also stated that the current search experience is not working as efficiently as it should be, as 40% of the time, people click on search links and then immediately click back.

This clearly indicates that the search experience needs to be updated and improved. Nadella claims that the search engine user experience hasn’t changed in 20 years, and it’s time for Microsoft to adapt.

Introducing The New Bing

The new Bing is powered by a next-generation language model from OpenAI, which has been specifically customized for search purposes. It’s even more powerful than the ChatGPT model.

Microsoft has implemented a new way of working with OpenAI called the “prometheus model,” which enhances the relevancy of answers, annotates them, keeps them up to date, and more.

The search index has also been improved by applying the AI model to the core search algorithm, which Nadella calls the largest jump in relevance ever.

It runs on a new user experience with an expanded search box that accepts up to 1,000 characters. Examples shared during the event look exactly like recent leaks.

The new Bing includes a chatbot that behaves similarly to ChatGPT, allowing users to interact with Bing in a natural language.

Bing’s new ChatGPT-like feature will take it a step further by allowing users to have an actual conversation with the search engine, with the ability to follow up on previous questions and provide more context for their search.

The new Bing is now available for a limited preview on desktop, and anyone can try it out by visiting and performing sample searches.

You can also sign up to be notified when it becomes more widely available.

The preview will be expanded to millions of users in the near future, and a mobile version will be available soon.

The New Edge Browser

The chat interface Microsoft demonstrated in Bing is available as a sidebar feature in Edge, allowing users to access it without navigating to the Bing website. The interface can run alongside any webpage and interact with it.

During a demonstration, the AI assistant in Edge could summarize a 15-page PDF with one click and even translate a code snippet from Stack Overflow into another programming language.

Another benefit of the Edge browser’s “AI co-pilot” is having it complete tasks for you, such as filling out forms and writing emails.

In Summary

Microsoft has made a substantial leap in search engine technology by integrating a ChatGPT-like feature in its Bing search engine.

The new Bing is powered by a next-generation language model from OpenAI, which takes key learnings and advancements from ChatGPT and GPT-3.5.

Bing with the AI co-pilot is now available for a limited preview on desktop, and a mobile version will be available soon.

Additionally, the chat interface will be available as a sidebar feature in the new Edge browser, which has the ability to summarize information, translate code, and even complete tasks.

Source: Microsoft

Featured Image: Poetra.RH/Shutterstock

Source link

Continue Reading