Connect with us

SEO

Keyword Tracking Tools (To Suit All Budgets)

Published

on

Keyword Tracking Tools (To Suit All Budgets)

With so many options for tracking your website’s keywords, it’s hard to know which tools will suit both your business and your budget.

Let’s look at the options.

1. Ahrefs – Best all-around keyword tracker

It’s easy to get started tracking keywords with Ahrefs. We have two core ways to track keywords to suit most budgets and businesses:

Free keyword rank checker (best for spot checks)

Ahrefs' free keyword rank tracker

Ahrefs’ free keyword rank checker is perfect for those who want to check rankings for a few keywords and don’t want to be tied to a monthly subscription.

Here’s how to use it:

  • Enter your keyword(s) in the first box
  • Enter the domain or URL related to the keyword in the box below
  • Select the location (by default, it’s set to the United States)
  • Hit the Check rankings button

Once you have done that, you will get something that looks like the following:

Results from Ahrefs' free keyword rank tracker

The free keyword rank checker gives an overview of the first page of the SERP, enabling you to conduct an analysis of the top results.

It also gives you access to Ahrefs’ data on the following:

  • Domain Rating (DR)
  • URL Rating (UR)
  • How many backlinks the domain has
  • How many domains it has
  • Amount of organic traffic it is receiving
  • Number of keywords that page is ranking for

From this data, you will understand whether you can rank for that keyword.

The tool also allows you to manually check any keyword. But sometimes, you need an automated solution to track more than one keyword. 

That’s where Ahrefs’ Rank Tracker can help.

Rank Tracker (best for most websites)

Ahrefs' Rank Tracker overview

For most businesses, Ahrefs’ Rank Tracker will be the go-to solution for tracking a site’s keywords. 

Unlike our free keyword rank checker, this tool allows you to track multiple keywords in your account, enabling you to monitor the total performance of your organic search campaign.

It also enables you to track and analyze the important elements of your campaign, such as:

  • Share of voice
  • Average position
  • Organic traffic
  • SERP features

You can also compare this data to your competitors’ websites:

Competitors' performance, via Ahrefs' Rank Tracker

And understand your performance across 13 different types of SERP features:

  • Featured snippets
  • Sitelinks
  • Top stories
  • Image packs
  • Thumbnails
  • Top ads
  • Bottom ads
  • Shopping results
  • Knowledge cards
  • Knowledge panels
  • Videos
  • Tweet box
  • People also ask

You can also monitor SERP features against your competitors at a page or domain level.

SERP features tracking against competitors, via Ahrefs' Rank Tracker

This feature shows you where you need to focus your SEO efforts.

Another really useful feature is keyword tags. Tags allow you to group keywords to analyze performance at a group level. 

Here’s an example of a tag group I made that groups the articles I have written for Ahrefs together.

Overview of tag performance, via Ahrefs' Rank Tracker

Using this strategy, you can start understanding which parts of your site are performing well and which parts need improvement.

Keyword tracking tools enable you to understand the performance and effectiveness of your SEO campaigns.

Learn more about Rank Tracker’s features here.

2. Google Search Console – Keyword tracking with Google

Google Search Console homepage

Google Search Console (GSC) allows you to monitor your site’s performance in Google. You can also track your average ranking position as well. 

It tracks this in the Performance tab once you have verified your profile.

GSC average position, via Google Search Console

If you don’t want the hassle of logging in to GSC all the time, you can pull the performance data into Ahrefs by linking your website to your Google Search Console profile

GSC performance, via Ahrefs Webmaster Tools

If you want to take it further, you can use Google Looker Studio (formerly Google Data Studio) to build a keyword-tracking dashboard.

The quickest, no-code way to do this is to use Ahrefs—you can simply click on the button highlighted below in Rank Tracker.

Overview page, via Ahrefs' Rank Tracker

Once you have authorized your account on the next screen:

  • Choose the primary Project that you want to track. 
  • Select the Device type below that.
  • Check all the boxes on the right-hand side (Allow “X” to be modified in reports) all the way down the page.
  • Hit Connect in the top right corner.
Ahrefs' Rank Tracker setup, via Google Looker Studio
  • On the next screen, click on Create Report.
Ahrefs' Rank Tracker setup, via Google Looker Studio
  • You will then get a dashboard that shows an overview of your project.
Ahrefs' Rank Tracker report template, via Google Looker Studio

The screenshot shows the “Overview” page, but there are six other tabs on the left-hand side you can click on that will give you more detailed data on topics such as:

  1. Positions
  2. SERP features
  3. Competitors
  4. Tags
  5. Traffic share
  6. Keyword metrics

One of the main advantages of creating a dashboard is that you can take a periodic snapshot of the report and share it with other stakeholders automatically.

To do this:

  • Click on the downward facing caret next to Share.
  • Click on Schedule email delivery in the drop-down menu.
Ahrefs' Rank Tracker template, via Google Looker Studio

The email delivery screen will then pop up and allow you to schedule the report to be sent as a PDF.

Here’s an example of what the scheduling screen looks like:

Email delivery, via Google Looker Studio
I’ve scheduled the report to be delivered weekly and added members of the team to receive the report.

You can see that this setup can be a powerful and customizable option for SEO reporting.

This combination of tools for keyword tracking is popular with agency SEOs to keep their teams aware of their client’s organic performance.

3. FatRank Keyword Checker – App-based rank tracker

FatRank Checker's app version

FatRank’s Keyword Checker is another way that you can quickly spot-check keywords. The great thing about this keyword checker is its format—you can use it as an app or a Google Chrome extension.

This means it’s great for checking a keyword’s ranking while you’re on the move, even if you don’t have your computer with you.

The Google Chrome extension has also got great feedback: 

Both versions of this tool could be useful for SEOs who are traveling and want to quickly spot-check the rankings of their most important keywords.

The app and the extension are free to use, meaning that you can use them alongside your main keyword tracker if you want.

4. Nozzle – Good for frequent tracking

Nozzle homepage

Nozzle is a keyword tracker with some interesting features and a luminescent-looking dashboard.

Here are a few stand-out features of Nozzle that I like:

  • Ability to track keywords every five minutes – This is frequent. If you work in a fast-paced industry, this may be a useful feature for you.
  • Track unlimited competitors for free – If you work in an industry where you need to keep tabs on a lot of competitors, this could be beneficial.

But what do SEOs think about it? 

The tool has a lot of good reviews. Check out this example from JR Oakes and others below.

Nozzle testimonials, via Nozzle's testimonials page

When it comes to pricing, Nozzle’s plans start at ~$49 and go up to ~$5K, so it has a wide range of pricing options for SMBs all the way up to the enterprise level.

5. ScrapeBox – Fixed cost keyword rank tracker

ScrapeBox rank tracker

If you are happy to run something more technical, check out ScrapeBox. It’s been around since 2009—so quite a while.

As a result, the UI is perhaps a little more “rustic” than some of the options here, but the functionality is all there.

Looking at the features of this keyword tracker, we can see that it:

  • Tracks unlimited sites.
  • Tracks unlimited keywords.
  • Supports Google, Yahoo, and Bing tracking.
  • Has proxy support—using proxies is important to stop your activity from being blocked by search engines.

The basic package of ScrapeBox is $97. To get the rank tracking plugin for Windows, it costs an extra $37. So for under $150, you can get a functional keyword tracker.

If you are tech-savvy and want a fixed-cost, no-frills keyword tracker with no recurring subscription (apart from proxies), this could be a good option.

Pi Datametrics rank tracker, via Pi Datametrics homepage

Pi Datametrics is a visual, client-friendly platform for keyword tracking. It allows you to dissect your organic performance in different ways with various tools.

Some features I like:

  • Build visual business cases quickly within the platform
  • Integrate with Google Analytics and Adobe Analytics 
  • Identify keyword cannibalization issues easily
  • Add unlimited competitors
  • Add unlimited locations
  • Get industry insights into 650 business categories using the Pi Vault

This tool is a good option for enterprise e-commerce businesses or agencies that want to get buy-in for their SEO strategies from senior stakeholders.

7. Nightwatch – Good local tracking

Nightwatch homepage

Nightwatch is a keyword tracker that allows you to “track search rankings from any location on earth.” Its emphasis is on accurate local tracking.

Nightwatch has some good features:

  • Local rank tracking across 107,296 locations
  • SERP feature tracking
  • Custom keyword segmentation
  • Automated reporting
  • GSC and GDS integration
  • White label reports at a higher price point

Prices start from $32 per month for 250 keywords. 

This type of rank tracker may be useful for you if your business relies on local areas or perhaps if you are an agency that works with many local businesses.

8. Mangools SERPwatcher – Easy to use 

Mangools SERPwatcher keyword tracker

Mangools’ SERPwatcher is a clean, minimal-looking keyword tracker that doesn’t overcomplicate things. 

When it comes to features, you get the following:

  • Track desktop and mobile rankings
  • Add keyword tags
  • Daily keyword updates
  • Track specific locations
  • Easy setup—“from setup to daily rankings in 30 seconds”

In terms of pricing, you need to buy the total suite of products, but plans start at under $30 per month.

In my opinion, Mangools is most likely to appeal to solo entrepreneurs or affiliate marketers who are looking for an easy-to-use, cost-effective rank tracker.

Final thoughts

Keyword tracking tools help keep your SEO campaign accountable. They often come at a cost, but there are cheaper and even free options available to suit all budgets and websites.

Ultimately, the keyword tracking tool you choose depends on your business needs, priorities, and budget.

Got more questions? Ping me on Twitter. 🙂



Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address

SEO

14 Ways to Use AI for Better, Faster SEO

Published

on

14 Ways to Use AI for Better, Faster SEO

AI can make your SEO efforts faster, better, and more fun—if you know how to use it.

Here are 14 practical ways to get faster, more efficient SEO results with help from your robot overlords friends.

To use AI in the best way (and avoid the mistakes many people make), it helps to understand what we mean when we talk about “AI”. Here’s everything you need to know about AI, in under 60 seconds:

With those ideas lodged in your brain, let’s look at how you can use AI tools for faster, better SEO.

AI is great for brainstorming keyword ideas and helping you to understand precisely what searchers need when they search for a particular keyword.

Suggest seed keywords

“Seed” keywords are words and phrases related to your business that you can use as the starting point for keyword research.

Pick a starting topic and ask AI to suggest related keywords: sub-topics, questions, similar concepts, you name it.

Take your list of ideas, plug them into a keyword research tool like Ahrefs’ Keywords Explorer, and you can quickly see the estimated traffic potential and Keyword Difficulty for each of these terms:

1715876765 536 14 Ways to Use AI for Better Faster SEO1715876765 536 14 Ways to Use AI for Better Faster SEO

Not all of these seed keywords will have meaningful volume, but that’s okay. Switch to the Matching terms or Related terms tabs, and you’ll see hundreds more related keywords that do:

1715876765 329 14 Ways to Use AI for Better Faster SEO1715876765 329 14 Ways to Use AI for Better Faster SEO

You can even skip the ChatGPT part entirely and use the built-in AI suggestion feature in Keywords Explorer:

1715876765 558 14 Ways to Use AI for Better Faster SEO1715876765 558 14 Ways to Use AI for Better Faster SEO

Here, our AI copilot has brainstormed “subtopics and niche areas” related to our core topic, content strategy:

1715876765 473 14 Ways to Use AI for Better Faster SEO1715876765 473 14 Ways to Use AI for Better Faster SEO

Sidenote.

Don’t trust any volume or difficulty numbers AI gives you. Tools like ChatGPT don’t have access to actual keyword data—but they can hallucinate and make numbers up. If you want real data, you’ll need a keyword research tool like Ahrefs.

Analyze SERP intent

AI can help you understand the different types of search intent present in a particular SERP (search engine results page).

This can be useful for working out which type of content you need to create to match the dominant intent (do searchers want an informational guide, or a free tool?).

In the example below, I copy/pasted page titles from the SERP for the keyword “LLM” and asked ChatGPT to categorize them by the different intent types present:

1715876766 681 14 Ways to Use AI for Better Faster SEO1715876766 681 14 Ways to Use AI for Better Faster SEO

After a little cajoling and refining, ChatGPT grouped the titles into a few different categories, like definitional (explaining what an LLM is) and comparative (comparing different types of AI models):

1715876766 927 14 Ways to Use AI for Better Faster SEO1715876766 927 14 Ways to Use AI for Better Faster SEO

You can take this process to the next level with the Identify intents feature in Ahrefs. For your given keyword, scroll to the SERP overview report, and hit the “Identify intents” button:

14 Ways to Use AI for Better Faster SEO14 Ways to Use AI for Better Faster SEO

This has the benefit of also showing you the percentage of total estimated traffic each intent receives.

In this example, with 82% of traffic, it makes sense to target the keyword “llm” with a definitional article about LLMs, and ignore the lower traffic intent associated with LLM degree programs.

AI can be used to pump out complete articles, but you’ll get better results—and have less risk of a Google penalty—if you use it like a creative sparring partner for your content creation process.

Brainstorm titles and headers

Titles and headers have a crucial indirect role in SEO by encouraging readers to actually click and read through your content. AI can dramatically speed up the process of brainstorming titles and headers.

Here, I’ve pasted the content of my latest blog post into ChatGPT and asked it to suggest title ideas:

1715876766 185 14 Ways to Use AI for Better Faster SEO1715876766 185 14 Ways to Use AI for Better Faster SEO

I generally don’t use these ideas verbatim, but ChatGPT regularly generates words or phrases that make their way into my finished titles.

You can also use our free blog post title generator in the same way. Just describe your topic, choose the writing tone, and hit “generate”:

1715876766 520 14 Ways to Use AI for Better Faster SEO1715876766 520 14 Ways to Use AI for Better Faster SEO

You can modify and create new ideas at the click of a button:

1715876766 671 14 Ways to Use AI for Better Faster SEO1715876766 671 14 Ways to Use AI for Better Faster SEO

Check grammar

AI is great for checking writing for grammar mistakes. Here, I’ve pasted an article paragraph into our free AI grammar checker

1715876766 641 14 Ways to Use AI for Better Faster SEO1715876766 641 14 Ways to Use AI for Better Faster SEO

…and a moment later, AI has flagged two possible issues for me to resolve:

1715876766 418 14 Ways to Use AI for Better Faster SEO1715876766 418 14 Ways to Use AI for Better Faster SEO

Edit transcripts

Maybe you’ve interviewed an expert and want to add their quotes and experience into your search content. Or maybe your team has created a YouTube video that you’d like to repurpose into a keyword-targeted article.

In either case, you can use AI to tidy up and correctly format transcripts, making it much easier to pull out quotes and ideas.

In this example, I’ve asked ChatGPT to correct a free (and error-prone) transcript from a YouTube video:

1715876766 430 14 Ways to Use AI for Better Faster SEO1715876766 430 14 Ways to Use AI for Better Faster SEO

And here’s the edited version, complete with correctly capitalized brand names, removed typos, and grammatically correct punctuation:

1715876766 945 14 Ways to Use AI for Better Faster SEO1715876766 945 14 Ways to Use AI for Better Faster SEO

SEO is a never-ending process, and AI can be a useful tool for speeding up some of the ongoing optimization tasks you’ll need to make to keep your pages ranking.

Add missing topics

One way to improve search content’s performance is to ensure that it includes important information that the searcher needs. Common sense can be a useful guide, asking yourself “which topics am I missing?”—but AI can help automate the process too.

Ahrefs’ new experimental Content Grader tool uses AI to automatically analyze the top-ranking articles for a particular keyword, identify the topics present, and score them according to how well they cover the topic.

Here’s an example for the keyword programmatic seo, comparing the content of my article to the content of other top-ranking pieces. We can immediately see a couple of missing topic areas:

1715876766 644 14 Ways to Use AI for Better Faster SEO1715876766 644 14 Ways to Use AI for Better Faster SEO

Content Grader can even explain how you should address the topic gap, and share an example from another top-ranking article:

1715876766 252 14 Ways to Use AI for Better Faster SEO1715876766 252 14 Ways to Use AI for Better Faster SEO

Write meta descriptions

Good meta descriptions encourage searchers to click on your pages, but Google has a tendency to change and rewrite even the most carefully-crafted meta descriptions.

If you want to generate lots of meta descriptions without sinking tons of time into the process, AI is pretty perfect. Here’s our free AI meta description generator: just describe the contents of your page, choose a writing tone and the number of variations you’d like, and hit generate.

1715876766 724 14 Ways to Use AI for Better Faster SEO1715876766 724 14 Ways to Use AI for Better Faster SEO

And here are the outputs:

1715876767 979 14 Ways to Use AI for Better Faster SEO1715876767 979 14 Ways to Use AI for Better Faster SEO

Make content more helpful

Aleyda Solis created a custom GPT (a specially trained AI model) that reviews content according to Google’s helpful content guidelines.

While I don’t think it’s a replacement for the skilled judgment of a professional SEO, it can offer a quick, automated way to pinpoint obvious problems with content.

Here I’ve asked it to compare my article on programmatic SEO to a competing article:

1715876767 468 14 Ways to Use AI for Better Faster SEO1715876767 468 14 Ways to Use AI for Better Faster SEO

It’s easy to mess up certain parts of technical SEO, like schema or hreflang implementation. From my experience, AI is better and more reliable than I am in these areas.

Create schema markup

Adding schema markup to relevant content types (like recipes or reviews) can help your pages become eligible for Rich Results, special Google features that include a ton of extra data about your content.

Here, I’ve asked for recipe schema for a chicken soup recipe. With a couple of tweaks (like adding in the recipe author), I could add this to my page and become eligible for rich results (and most likely more clicks):

1715876767 713 14 Ways to Use AI for Better Faster SEO1715876767 713 14 Ways to Use AI for Better Faster SEO

Generate hreflang

Hreflang is an HTML attribute that tells search engines about the multiple versions of a page for different languages or regions. Here, ChatGPT has written the hreflang tags for four different versions of my blog post:

1715876767 802 14 Ways to Use AI for Better Faster SEO1715876767 802 14 Ways to Use AI for Better Faster SEO

AI is great at helping with these analytical and reporting tasks, from digging through performance data to see which tactics work, to sharing your findings in easy-to-communicate ways with your company or clients.

Of all the AI/SEO use cases I’ve covered, these are probably my favorite.

Constructing regex queries

Regular expressions (or regex) allow you to search within text and data for patterns that are otherwise difficult to spot. They can be pretty complicated, but AI is extremely good at writing and troubleshooting very complex queries for you.

Here’s ChatGPT helping me extract URLs from a list of email addresses, combining regex queries with a Google Sheets formula:

1715876767 155 14 Ways to Use AI for Better Faster SEO1715876767 155 14 Ways to Use AI for Better Faster SEO

And here it’s helping me filter a spreadsheet of URLs by their crawl depth:

1715876767 216 14 Ways to Use AI for Better Faster SEO1715876767 216 14 Ways to Use AI for Better Faster SEO

And here it’s written a query to use with Ahrefs Site Audit to help me filter out localized content (pages that have country codes, like /de/ for Germany, somewhere in their URL):

1715876767 886 14 Ways to Use AI for Better Faster SEO1715876767 886 14 Ways to Use AI for Better Faster SEO

Making Google Sheets formula

SEOs spend a lot of time in spreadsheets, often wrangling lots of data with complicated formulas. ChatGPT can make this process much, much easier.

Here I’ve described the structure of an article reporting spreadsheet to ChatGPT, and asked for a very complicated formula to allow me to filter for certain types of published articles. It doesn’t even break a sweat:

1715876767 166 14 Ways to Use AI for Better Faster SEO1715876767 166 14 Ways to Use AI for Better Faster SEO

It’s also great for troubleshooting when things go wrong:

1715876767 22 14 Ways to Use AI for Better Faster SEO1715876767 22 14 Ways to Use AI for Better Faster SEO

Writing Python scripts

Python is a popular language for automating SEO processes. Generative AI is pretty darn handy at writing and troubleshooting Python code, and I’ve used it to help speed up some of my SEO processes.

Here, I asked AI to create a basic web scraper for storing data from a given webpage:

1715876767 690 14 Ways to Use AI for Better Faster SEO1715876767 690 14 Ways to Use AI for Better Faster SEO

And here I asked for help writing a script to call the Ahrefs API and collect bulk traffic and backlink data for a list of websites:

1715876767 436 14 Ways to Use AI for Better Faster SEO1715876767 436 14 Ways to Use AI for Better Faster SEO

And yes—both of these scripts worked!

Vizualize performance data

All of the visuals in this section were created with ChatGPT, Ahrefs data, and a little know-how.

For longer explanations (and the prompts used to make these visualizations), check out Patrick’s article:

Here’s a graph of organic traffic over time, with traffic anomalies (usually Google updates) highlighted:

1715876767 550 14 Ways to Use AI for Better Faster SEO1715876767 550 14 Ways to Use AI for Better Faster SEO

Here’s a plot comparing desktop and mobile rankings for a selection of keywords:

1715876767 459 14 Ways to Use AI for Better Faster SEO1715876767 459 14 Ways to Use AI for Better Faster SEO

And here’s a chart showing seasonal patterns in backlink acquisition:

1715876767 61 14 Ways to Use AI for Better Faster SEO1715876767 61 14 Ways to Use AI for Better Faster SEO

AI can help you do SEO, but it’s also changing the industry as a whole. There are lots of myths circulating about the impact of AI. Let’s address the biggest, head-on.

Does Google penalize AI content?

No, not strictly speaking. Google penalizes bad content, and AI makes it easy to make bad content.

Some companies use AI to dramatically scale and automate their content creation. When this content is thin, there’s a chance that Google will issue a manual spam penalty. In this example, a site used AI to publish 1,800 thin articles and received a penalty, tanking their traffic to virtually zero:

1715876767 830 14 Ways to Use AI for Better Faster SEO1715876767 830 14 Ways to Use AI for Better Faster SEO

As I’ve written before,

“I don’t think that publishing AI content means an automatic penalty. AI content detectors don’t work, and even if they did, Google is apparently agnostic to AI use—but it is not agnostic to bad content or bad actors. And AI makes it very easy to make bad content.”

Ryan LawRyan Law

It’s a good idea to use AI to improve the efficiency or quality of your content, but not to pump out thin spam content.

Is Google losing market share to AI?

It doesn’t look like it.

Google has always been the main search engine SEOs care about, and in the age of AI… that hasn’t really changed. According to Statcounter, Google’s market share has held relatively steady at a staggering 91%:

1715876767 353 14 Ways to Use AI for Better Faster SEO1715876767 353 14 Ways to Use AI for Better Faster SEO

But although Google’s dominance over the search market is pretty unchallenged, there are more alternatives than ever. These are useful for seeing where Google might take inspiration and improve its own search experience in the future:

  • Competing search engines are offering their own AI features (like Bing or our Yep.com).
  • Companies like Perplexity.ai offer an alternative search experience built entirely on AI models
  • Some people are even building their own AI chatbots trained on specific bodies of work—instead of asking Google for health and fitness advice, you could ask a chatbot trained on the Huberman Labs podcast.

Will SGE reduce traffic from certain keywords?

Maybe.

Google has just launched AI Overviews (formerly known as Search Generative Experience, or SGE). AI Overviews seem to work a lot like featured snippets: they try to answer the searcher’s query directly, right there in the SERP, without the need to click on another website.

There’s a concern that many websites will see a decline in search traffic from AI Overviews, and some SEOs even suggest trying to optimize your content for AI Overviews.

While we wait to see what impact AI Overviews has on traffic from Google Search, the best response is to focus on topics that can’t be neatly summarized in a single paragraph.

We call these “deep topics”: areas where AI can’t provide everything the reader needs, because there are lots of possible answers, or it requires firsthand experience.

1715876767 947 14 Ways to Use AI for Better Faster SEO1715876767 947 14 Ways to Use AI for Better Faster SEO

Does Google reward first-person experience?

Theoretically, yes.

Google already has a plan for stopping SERPs from being swamped by copycat AI content, and it involves prioritizing content that includes EEAT: expertise, experience, authority, and trust:

 

“There are some situations where really what you value most is content produced by someone who has first-hand, life experience on the topic at hand.”

EEAT is used by Google’s Quality Raters, whose experiences may be used to train Google’s machine learning models to help them identify “quality” content.

But Google aside, EEAT is great for readers, so it’s worth incorporating into your SEO strategy even if you won’t see an immediate ranking boost. There are three simple ways we recommend standing out from AI content:

  • Experimentation: create proprietary data.
  • Experience: share your real, lived experiences.
  • Effort: go further than competing content.
1715876767 791 14 Ways to Use AI for Better Faster SEO1715876767 791 14 Ways to Use AI for Better Faster SEO

Final thoughts

SEO isn’t something that can be automated to perfection at the click of a button (and any tool that promises otherwise is lying). But AI can help speed up and improve the more tedious parts of your job.

If you want to test out some AI tools in the easiest possible way, try experimenting with our 40 free AI writing tools. They can help with everything from writing clickable titles to generating tons of meta descriptions, and help you separate AI fact from AI fiction.

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

SEO

Chatbots And AI Search Engines Converge: Key Strategies For SEO

Published

on

By

Chatbots And AI Search Engines Converge: Key Strategies For SEO

A lot is happening in the world of search right now, and for many, keeping pace with these changes can be overwhelming.

The rise of chatbots and AI assistants – like ChatGPT and its new model GPT-4o, along with Google’s rollout of AI Overviews and Search Generative Experience (SGE) – is blurring the lines between chatbots and search engines.

New AI-first entrants, such as Perplexity and You.com, also fragment the search space.

While this causes some confusion and necessitates that marketers pivot and optimize for multiple types of “engines,” it also presents a whole new array of opportunities for SEO pros to optimize for both traditional and AI-driven search engines in a new multisearch universe.

This evolution raises a broader question – perhaps for another day – about redefining what we call SEO to encompass terms like Artificial Intelligence Optimization (AIO) and Generative Engine Optimization (GEO).

Currently, every naming convention seems subject to change, which is something to consider as I write this article.

Either way, this evolution opens up tremendous opportunities for disruption in the overall search landscape.

What Is A Chatbot Or AI Assistant?

Screenshot from Wikipedia, May 2024

At the most basic level, chatbots use natural language processing (NLP) and large language models (LLMs) that are trained to extract data from online information, sources, and specific datasets. They then classify and fine-tune text and visual outputs based on a user’s prompt or question.

Chatbots are often used within specific applications or platforms, such as customer service websites, messaging apps, or ecommerce sites. They are designed to address specific queries or tasks within these defined contexts.

Right now, we see many crossovers between LLM-based chatbots and search engines. Rapid developments in these areas can cause confusion.

In this article, we’ll focus on the development of AI models in chatbots and their relation to search, with an inferred reference between chatbots and AI assistants.

The Evolution Of Chatbots And AI Models

Since ChatGPT emerged in November 2022, we’ve seen a significant boom in chatbots and AI assistants. Now, generative AI allows users to interact directly with AI and engage in human-like conversations to ask questions and complete various tasks.

For example, these AI tools can assist with SEO tasks, create content, compose emails, write essays, and even handle coding and programming tasks.

As they evolve, chatbots become multimodal (MMLLMs), improving capabilities beyond text to include images, audio, and more.

LLMs and LLMMsImage from 2024 AI Index Report from Stanford University, May 2024

For those interested in digging deeper into these models, the 2024 AI Index Report from Stanford University is a great resource for SEJ readers.

While many chatbots and AI models serve similar purposes, they also have distinct applications and use cases, such as content creation, image generation, and voice recognition.

Here are a few examples with some interesting differentiators and points:

  • ChatGPT: Conversational AI for research, ideation, text, image content, and more.
  • Google Gemini and Gemma: Uses Google’s LLM to connect and find sources within Google.
  • Microsoft Bing: Uses ChatGPT for conversational web search in Bing.
  • Anthropic Claude: Various AI models for content generation, images, and coding.
  • Stability AI: Suite of models and AI assistants for text, image, audio, and coding.
  • Meta Llama3: Utilizes Facebook’s social graph, its own Llama 3 model, and real-time data from Google.
  • Microsoft’s Copilot: AI assistant for business creativity and productivity apps.
  • Amazon LLM and Codewhisperer: Enhances customer and employer experiences.
  • Perplexity AI: Provides quick answers, sources of information, and citations.

Perplexity AI (which I will touch on later in this article) acts more like a search engine than many other chatbots and AI assistants.

Beyond their primary use cases, many companies are making their models available to a wider audience and broader ecosystems, allowing users to customize their own AI assistants.

For example, Amazon’s Bedrock enables AWS customers to use Anthropic and other LLMs, including Amazon’s own model, to create custom AI agents. Companies like Lonely Planet, Coda, and United Airlines are already using it.

On May 13, OpenAI launched its new flagship model, GPT-4. This model is a combination of AI technologies, bringing together what OpenAI calls “text, vision, and audio.” It also opens up access to its application programming interface (API), allowing developers to build their own applications.

All of this convergence has a lot of people wondering.

What’s The Difference Between Chatbots And Search Engines?

The first thing to note is that both chatbots and search engines are designed to provide information.

Search engines and some chatbot models share many similarities, which means their definitions can blur, and the relationships between them converge and collide.

However, at the moment (but it is changing), there is still a distinct difference between the two:

Search Engines

  • Search engines are better for exploring a wide range of topics.
  • They provide diverse perspectives from multiple sources.

Chatbots

  • Chatbots are better for quick answers, task completion, and personalized interactions.
  • They enhance the efficiency of the average searcher, making them much more effective at finding information.
Search engines vs chatbotsImage from author, May 2024

As more overlays and overlaps occur, the definitions of what constitutes a chatbot, an AI assistant, and a search engine may need to be redefined.

How Chatbots And Search Engines Work Together

Conversational search is a key area where search engines increasingly integrate chatbot features to provide a more interactive search experience.

You can ask questions in natural language, and the search engine may respond with direct answers or engage in a dialogue to refine your query.

Chatbots and AI assistants often utilize search engine technology to access information from the web, enhancing their ability to provide accurate and comprehensive answers.

This integration allows chatbots to go beyond their programmed knowledge base and tap into a broader range of information.

Here are a few examples:

  • Google: Integrates its own chatbot features into its search engine through SGE, providing direct answers and engaging in conversational search for some queries.
  • Bing: Incorporates a chatbot called “Bing Chat” that uses ChatGPT, conversational AI, and search technology to answer questions and provide information.
  • YouChat: A search engine that provides conversational responses to queries and allows for follow-up questions.
  • Meta: Utilizes its social graph and Google’s real-time data in its chatbot/AI assistant.
  • Perplexity AI: A chatbot that functions like a search engine, focusing on informational sources, sites, and citations.

These examples illustrate how the lines between chatbots and search engines are blurring. Thousands more instances show this convergence, highlighting the evolving landscape of digital search and AI.

How “Traditional” Search Engines Are Evolving As AI-First Entrants Arrive

The rise of generative AI and chatbots has caused significant upheaval in the traditional search space.

Traditional search engines are evolving into “answer engines.” This transformation is driven by the need to provide users with direct, conversational responses rather than just a list of links.

The line between chatbot engines and AI-led search engines is becoming increasingly blurred.

While AI in search is not a new concept, the introduction of generative AI and chatbots has necessitated a seismic shift in how search engines operate. For the first time, users can interact with AI in a conversational way, prompting giants like Google and Microsoft to adapt.

On May 14 at Google IO, Google announced the roll-out of AI Overviews as it integrates AI features into its search engine. It is also making upgrades to SGE.

The ultimate goal is to enhance its ability to provide direct answers and engage in conversational search. This evolution signifies Google’s commitment to maintaining its leadership in the search space by leveraging AI to meet user expectations.

In a recent interview on Wired Magazine titled It’s the End of Google Search As We Know It, Google Head of Search, Liz Reid, was clear that:

“AI Overviews like this won’t show up for every search result, even if the feature is now becoming more prevalent.”

As my co-founder, Jim Yu, states in the same article:

“The paradigm of search for the last 20 years has been that the search engine pulls a lot of information and gives you the links. Now the search engine does all the searches for you and summarizes the results and gives you a formative opinion.”

Beyond Google, we are seeing a rise in new, AI-driven search engines like Perplexity, You.com, and Brave, which act more like traditional search engines by providing informational sources, sites, and citations.

These platforms leverage generative AI to deliver comprehensive answers and facilitate follow-up questions, challenging the dominance of established players.

Meta is also entering the fray by utilizing its social graph and real-time data from Google in its AI assistant, further contributing to the convergence of search and AI technologies.

At the same time, according to Digiday, TikTok is starting to reward what it calls “search value.”

Going forward, it’s important to remember that people have diverse needs, and we turn to different platforms for specific purposes.

Just as we go to Amazon for products, Yelp for restaurant suggestions, and YouTube for videos, the rise of AI will only amplify this trend. Each search engine will find its niche, leveraging its strengths to cater to particular user requirements.

ChatGPT is an intriguing case that stands out not for its research capabilities but for its prowess in content creation. While it excels in crafting high-quality content, its research functionalities fall short.

Effective research relies on real-time data, which platforms like ChatGPT currently lack. As we move forward, we expect to see search engines specialize even further, each excelling in specific areas based on its unique strengths and features.

What Does It All Mean For Marketers?

This fast-moving landscape and the convergence of search and AI presents both challenges and opportunities for marketers.

Optimizing for one engine is no longer sufficient; it’s essential to target multiple platforms – each with unique users, demographics, and intents.

Here’s how marketers can adapt and thrive in this dynamic environment.

Optimizing For Different Platforms

Google

  • Strength: Dominates the traditional search space with a vast user base and comprehensive data sources.
  • Tip: Focus on core technical SEO, including schema markup and mobile optimization. Google’s Search Generative Experience means direct answers are becoming more prevalent, so structured data and high-quality content are vital.

Perplexity AI

  • Strength: Provides detailed citations and emphasizes source material, driving referral traffic back to original sites.
  • Tip: Ensure your content is authoritative and well-cited. Being a reliable source will increase the likelihood of your site being referenced, which can drive traffic and enhance brand trust.

ChatGPT

  • Strength: Excels in conversational AI, making it suitable for quick answers and personalized interactions.
  • Tip: Create engaging, concise content that answers common questions directly. Utilize conversational language in your SEO strategy to match the style of ChatGPT interactions.

Key Strategies For Marketers

From optimizing technical SEO to harnessing the power of semantic understanding and creativity, these strategies provide a roadmap for success in the era of AI-driven search.

Core Technical SEO

Basics like site speed, mobile-friendliness, and proper schema markup remain crucial. Ensuring your site is technically sound helps all search engines index and rank your content effectively.

Semantic Understanding

Search engines and conversational AI are increasingly focused on semantic search. Optimize for natural language queries and long-tail keywords to match user intent more accurately.

Content And Creativity

High-quality, creative content is more important than ever. Unique, valuable content that engages users will stand out in both traditional and AI-driven search results.

Expanded Role Of SEO

SEO now encompasses content creation, branding, public relations, and AIO. Marketers who can adapt to these roles will be more successful in the evolving search landscape.

Be The Source That Gets Cited

Ensure your content is authoritative and well-researched. Being a primary source will increase the likelihood of citations that drive traffic and enhance credibility.

Get Predictive

Anticipate follow-up questions and provide comprehensive answers. This will not only improve user experience but also increase the chances of your content being highlighted in AI-driven search results.

Brand Authority

Focus on areas where your brand excels. AI search engines prioritize authoritative sources, so build and maintain your reputation in key areas to stay competitive.

The Best Content That Provides The Best Experience Wins

Ultimately, the quality of your content will determine your success. Invest in creating the best possible user experience, from engaging visuals to informative text.

Key Takeaways

Today, search encompasses a dual purpose: It can serve as a standalone assistant-based application or integrate into search engines for AI-led conversational experiences.

This fusion presents marketers with a unique opportunity to elevate their brands by creating accurate and authoritative content that positions them as trusted sources in their respective fields.

Ranking on the first page and being recognized as the go-to source cited by AI engines is no less important than 10 or 20 years ago but is exponentially more difficult.

The good news is that whether it’s Google’s AI engine or newcomers like Perplexity, brands that establish themselves as authorities in their niche stand to benefit immensely.

Marketers need to embrace creativity and collaboration across omnichannel teams. Ensure that your website is visible and accessible to all types of engines, whether traditional or AI-driven.

I’d like to leave you with a few questions to consider as you find your way forward in this complex environment. Pardon the pun, but no one has all the right answers yet.

  • Are chatbots morphing into search engines?
  • How do social platforms differentiate as younger generations look to them as search engines?
  • How would you define a search engine?
  • Who will win the race for user loyalty – traditional search engines infused with AI or new entrants built on generative AI from the beginning?
  • How would you redefine your role as an SEO – are you AI first?

While you consider that, stay proactive and adaptable and position yourself and your company to leverage the diversity and complexity of the search ecosystem to your advantage. In a world of ChatGPT, chatbots, and AI in search, you’re not optimizing for one channel, such as Google or Bing.

Successful optimization in this multifaceted landscape calls for a holistic approach. It’s not about keyword rankings or click-through rates; it’s about unraveling the intricacies of each platform and adjusting your strategies accordingly.

This means optimizing your content for conversational search, tapping into the capabilities of AI to tailor user experiences, and seamlessly integrating across different channels and devices.

Leverage the strengths of each platform to amplify your message by use case and engage with your audience on a deeper level, and you’ll ultimately drive more meaningful results for your business.

More resources: 


Featured Image: Memory Stockphoto/Shutterstock

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

SEO

Competing Against Brands & Nouns Of The Same Name

Published

on

By

An illustration of a man in a business suit interacting with a floating 3D network of connected nodes, symbolizing SEO strategy and digital technology, set against a stylized outdoor background with clouds and plants

Establishing and building a brand has always been both a challenge and an investment, even before the days of the internet.

One thing the internet has done, however, is make the world a lot smaller, and the frequency of brand (or noun) conflicts has greatly increased.

In the past year, I’ve been emailed and asked questions about these conflicts at conferences more than I have in my entire SEO career.

When you share your brand name with another brand, town, or city, Google has to decide and determine the dominant user interpretation of the query – or at least, if there are multiple common interpretations, the most common interpretations.

Noun and brand conflicts typically happen when:

  • A rebrand’s research focuses on other business names and doesn’t take into consideration general user search.
  • When a brand chooses a word in one language, but it has a use in another.
  • A name is chosen that is also a noun (e.g. the name of a town or city).

Some examples include Finlandia, which is both a brand of cheese and vodka; Graco, which is both a brand of commercial products and a brand of baby products; and Kong, which is both the name of a pet toy manufacturer and a tech company.

User Interpretations

From conversations I’ve had with marketers and SEO pros working for various brands with this issue, the underlying theme (and potential cause) comes down to how Google handles interpretation of what users are looking for.

When a user enters a query, Google processes the query to identify known entities that are contained.

It does this to improve the relevance of search results being returned (as outlined in its 2015 Patent #9,009,192). From this, Google also works to return related, relevant results and search engine results page (SERP) elements.

For example, when you search for a specific film or TV series, Google may return a SERP feature containing relevant actors or news (if deemed relevant) about the media.

This then leads to interpretation.

When Google receives a query, the search results need to often cater for multiple common interpretations and intents. This is no different when someone searches for a recognized branded entity like Nike.

When I search for Nike, I get a search results page that is a combination of branded web assets such as the Nike website and social media profiles, the Map Pack showing local stores, PLAs, the Nike Knowledge Panel, and third-party online retailers.

This variation is to cater for the multiple interpretations and intents that a user just searching for “Nike” may have.

Brand Entity Disambiguation

Now, if we look at brands that share a name such as Kong, when Google checks for entities and references against the Knowledge Graph (and knowledge base sources), it gets two closer matches: Kong Company and Kong, Inc.

The search results page is also littered with product listing ads (PLAs) and ecommerce results for pet toys, but the second blue link organic result is Kong, Inc.

Also on page one, we can find references to a restaurant with the same name (UK-based search), and in the image carousel, Google is introducing the (King) Kong film franchise.

It is clear that Google sees the dominant interpretation of this query to be the pet toy company, but has diversified the SERP further to cater for secondary and tertiary meanings.

In 2015, Google was granted a patent that included features of how Google might determine differences in entities of the same name.

This includes the possible use of annotations within the Knowledge Base – such as the addition of a word or descriptor – to help disambiguate entities with the same name. For example, the entries for Dan Taylor could be:

  • Dan Taylor (marketer).
  • Dan Taylor (journalist).
  • Dan Taylor (olympian).

How it determines what is the “dominant” interpretation of the query, and then how to order search results and the types of results, from experience, comes down to:

  • Which results users are clicking on when they perform the query (SERP interaction).
  • How established the entity is within the user’s market/region.
  • How closely the entity is related to previous queries the user has searched (personalization).

I’ve also observed that there is a correlation between extended brand searches and how they affect exact match branded search.

It’s also worth highlighting that this can be dynamic. Should a brand start receiving a high volume of mentions from multiple news publishers, Google will take this into account and amend the search results to better meet users’ needs and potential query interpretations at that moment in time.

SEO For Brand Disambiguation

Building a brand is not a task solely on the shoulders of SEO professionals. It requires buy-in from the wider business and ensuring the brand and brand messaging are both defined and aligned.

SEO can, however, influence this effort through the full spectrum of SEO: technical, content, and digital PR.

Google understands entities on the concept of relatedness, and this is determined by the co-occurrence of entities and then how Google classifies and discriminates between those entities.

We can influence this through technical SEO through granular Schema markup and by making sure the brand name is consistent across all web properties and references.

This ties into how we then write about the brand in our content and the co-occurrence of the brand name with other entity types.

To reinforce this and build brand awareness, this should be coupled with digital PR efforts with the objective of brand placement and corroborating topical relevance.

A Note On Search Generative Experience

As it looks likely that Search Generative Experience is going to be the future of search, or at least components of it, it’s worth noting that in tests we’ve done, Google can, at times, have issues when generative AI snapshots for brands, when there are multiple brands with the same name.

To check your brand’s exposure, I recommend asking Google and generating an SGE snapshot for your brand + reviews.

If Google isn’t 100% sure which brand you mean, it will start to include reviews and comments on companies of the same (or very similar) name.

It does disclose that they are different companies in the snapshot, but if your user is skim-reading and only looking at the summaries, this could be an accidental negative brand touchpoint.

More resources:


Featured Image: VectorMine/Shutterstock

Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

Trending