Connect with us


Query Relaxation And Scoping As Part Of Semantic Search



Query Relaxation And Scoping As Part Of Semantic Search

The right search query is a Goldilocks-style effort: Not too specific that you get no results, and not too broad that you get too many.

Semantic search, meanwhile, is all about understanding what searchers throw into a search box.

In other words, with semantic search, we meet searchers where they are instead of requiring them to meet us where we are.

Enter query relaxation and query scoping.

Search engines get searchers to the right content right away through techniques like synonyms, query word removal, and query scoping.

We avoid missing out on relevant information that wouldn’t otherwise appear, and we leave out information that isn’t relevant.

Query relaxation and scoping are tied very closely with the concept of precision and recall.


Precision measures whether the returned results are relevant, and recall is whether relevant results are returned.

One way to increase recall specifically is through query expansion.

Query Expansion

Query expansion is all about expanding what the query will match with the hope of having better results.

The main reason a search engine might apply query expansion is due to some indication that the “base” search results without query expansion would not be satisfactory for the searcher.

In this series, we have already seen some ways to expand queries.

Typo tolerance, plural ignoring, and stemming and lemmatization are all ways to increase the recall of searches.

We’ve already seen those query expansion methods among the bedrocks of search, but other query expansion methods are also just as fundamental.

An article in Search Engine Journal from 2008 covers how Google performs query expansion!


The article discusses not just stemming and typo tolerance but also translations, word removals, and synonyms.

Synonyms And Alternatives

There’s a reason George Orwell introduced Newspeak in his novel 1984 and why it resonated in a story about life utterly controlled to the point of blandness.

Linguistic richness is driven by the ability to say the same thing, or nearly the same thing, with different words and phrases. “Great” can be “awesome,” and “low-cost” is a near neighbor to “cheap.”

Meanwhile, these different words can help us more precisely refer to items similar in all but the smallest ways.

These differences are sometimes so small that this precision instead breeds confusion and less likely to find what we want.

A customer wanting a rocking chair may not know whether to search for “rockers,” “rocking chairs,” or simply “chairs.”

This is where synonyms and alternatives provide value.

They help us expand recall in search results.


Synonyms and alternatives are similar, but they are not the same.

(You could say that they are not synonyms.)

Synonyms refer to two words or phrases that mean the same thing.

Alternatives instead refer to similar words or phrases but have some degrees of difference.


Often, synonyms make their way into a search engine through synonym lists.

These lists can come from predefined lists, such as general ecommerce terms.

The problem with predefined lists is that synonyms for one company’s search engine won’t necessarily work for another.

Quick: What’s a console? You may immediately think of video games, but someone else might think of a car or music.


For that reason, many synonym lists are created in-house.

At the beginning of a search implementation process, internal subject matter experts think of all of the words that could be synonyms for other words and add them to the search engine configuration.

(This, in reality, is often an idealized view of what happens. Often the person creating the synonym list is not a subject matter expert, but instead, the person implementing the search engine.)

Generally, this initial list will provide a good starting point, but there are sure to be missing synonyms.

The only real way to discover which terms your searchers will use is to let them search.

Using Analytics To Discover Synonyms

You’ll see very quickly in your analytics queries that could use new synonyms.

These queries are returning zero results and are a sign that searchers are looking for something they can’t find.


Now, not all of these queries will give you a new synonym.

Sometimes, searchers are looking for items that you just don’t have.

Nonetheless, you’ll see queries where you think immediately, “oh, we have that one,” and “I didn’t know people asked for it like that.”

There will also be times when a query returns results but not what the searcher wants.

These queries can also give you ideas for synonyms if you track “search refinements.”

Search refinements represent when searchers search and then search again.

This implies that the searchers didn’t find what they wanted the first time and tried again to find something better.

Someone searching for “Dell laptop” and following it up with “Dell notebook” is saying that “laptop” and “notebook” are related, but the search results for “laptop” were insufficient.


While there’s nothing wrong with looking for those trends in your analytics manually (it can be a good activity to slowly ease into the work week), you’ll be a lot more productive if you have a system that proactively sources them for you.

Some systems may even apply synonyms on your behalf, but this isn’t always helpful.

A human can spot refinements that don’t show valid synonyms or may see that the system is suggesting an incorrect type of synonym.

Types Of Synonyms

That’s right: There are different types of synonyms.

This concept may seem strange at first, but it’s probably not far from how most people think of them.

“Two-way” is the first type of synonym. These synonyms are direct replacements for each other.

“Small” and “mini” are two-way synonyms of each other.


The words don’t need to be perfect replacements but can be close enough that people might use one for the other.

For example, “rope” and “string” don’t describe the same thing, but they are close enough to be worthy two-way synonyms.

It can be useful to think of the query created through the use of synonyms.

If we take a query of “small cheese pizza” and expand that out, you can think of the query now as “(small or mini) and cheese and pizza.”

“One-way” is the next type of synonym.

This type is often used for words that refer to an object that belongs to a larger category.

“PlayStation” is a type of video game “console,” but a “console” is not a type of “PlayStation.”

If you add a one-way synonym to the search configuration, you can have PlayStations show up whenever someone searches for “console.”


Why not a two-way synonym between these two terms?

Because two-way synonyms are transitive.

If term one and term two are two-way synonyms, and terms two and three are two-way synonyms, then terms one and three are two-way.

In a more direct example, “PlayStation” and “console” and “Xbox” and “console” as two groups of two-way synonyms would mean that “PlayStation” and “Xbox” are synonyms, and searchers would see Playstations when searching for Xboxes, and vice versa.

“Alternative corrections” is the final type.

These are used when the words aren’t precise replacements for each other, and you want the exact match to appear higher than the alternative.

For example, you might say that “pants” are an alternative to “shorts,” but when someone searches the word “shorts,” then all shorts should appear higher than pants generally.

All synonym types, by their nature, expand recall.


However, the hit on precision should be minimal because these synonyms are “pointers” to similar concepts.

You would expect a better search experience for the end user.

Query Word Removal

Sometimes searchers will use a query that doesn’t return anything because the query was too specific or used a word that didn’t exist in any of the records.

Remove one word, or two words, from the query, and perfectly decent results would come back.

This is a great time to use query word removal.

Stop Words

Perhaps the most common query word removal step is removing “stop words.”

Stop words are very common words that provide meaning for communication but don’t help with retrieval. Words such as “the” or “an” can remove otherwise good matches.

This is more common in queries oriented toward natural language, such as voice search queries.


An example of this would be searching for “an orange shirt” on a product search engine.

If the search engine searches over the title, color, and category, there might be plenty of records that have “shirt” as a category and “orange” as a color, but none that include the word “an.”

Now, really, does the word “an” provide any useful information here?

No, it doesn’t, and the search engine can safely remove it without losing precision.

Unlike synonyms, you generally do not want to create your own stop word lists, and most search engines have them built-in per language.

However, there are times when you will want to expand on the built-in list, such as if you have an industry term that is so common that it doesn’t provide any value to a query.

Removing Words If No Results

Then there are queries where all of the words bring value but searched together, bring back no results.

Often searchers will be happy with less precise results in exchange for increased recall. In these situations, we want to remove words to put results in front of the user.


There are two main ways to do this: make all query words optional or remove words from the query.

If you make all of the query words optional when there are no results, you assume that records that match more words are more relevant, all else being equal.

An alternative is to remove query words one-by-one until you find matching records or there are no more words left in the query.

You can start by removing the first words or the last words. Last word removal tends to be more common.

Making all of the query words optional and then sorting by the number of matching words is generally the better approach, especially when paired with the removal of stop words.

This is, however, a less ideal approach when precision is important, and you want to show that, indeed, there were no results that matched all of the query words.

One person may be alright with seeing Uniqlo v-neck sweaters for a query of “Gucci v-neck sweaters,” while another sees those results as completely irrelevant.

Of course, another scenario is to know which words are actually providing the most value to the query and mark them as optional.


This is generally not seen in keyword-based search engines, but there have been some search engines that will take a similar approach for stop words.

For example, some search engines have experimented with discounting common words automatically without stop word lists, using inverse document frequency.

As with synonyms, query word removal will expand recall, usually without a hit on precision. Because stop words don’t provide much value to the result, you won’t lose out on good results by not including them.

Similarly, removing words when there are no results has no precision to lessen because there are no results that could be precise.

Query Scoping

We’ve primarily looked at situations where a searcher is overly precise and the search engine needs to expand the query to improve recall.

There are, likewise, times when the search engine can understand the user intent, and query scoping can increase precision.

Search expert Daniel Tunkelang calls query scoping “one of the most effective ways to capture query intent.”

He identifies two major steps in query scoping. The first is query tagging, followed by the scoping itself.


Query tagging identifies the parts of a query with the attributes they likely belong to.

For example, “Marcia” will most likely match to a “name” attribute, while “The Brady Bunch” maps to a “show title” attribute.

Query scoping takes this mapping and restricts attribute searching for these query parts.

The search engine doesn’t search “Brady” inside of the “name” attribute or “Marcia” in the “show title” attribute.

This kind of query scoping reduces recall, as we won’t see results that have that text in other attributes.

However, the outcome should be that we have higher precision because we aren’t searching for irrelevant attributes.

We could increase precision even further by filtering results by known attribute values.

This doesn’t even require machine learning, as the search engine can do a simple match between facet values and text in a query.


This reduces recall heavily, so we can also find a nice balance where we instead boost results with matching values rather than filtering.

The boosted results will tend to be the best matching ones because the query-filter match gives you a signal that it is what the searcher wants.

Through your analytics or hands-on experience, if you find that your search is missing user intent and requiring searches to be “just right,” then query expansion and query scoping are two ways to calibrate your precision and recall.

These approaches will let in results that should be there and leave out the ones that shouldn’t.

More resources:

Featured Image: penguiin/Shutterstock

!function(f,b,e,v,n,t,s) {if(f.fbq)return;n=f.fbq=function(){n.callMethod? n.callMethod.apply(n,arguments):n.queue.push(arguments)}; if(!f._fbq)f._fbq=n;n.push=n;n.loaded=!0;n.version='2.0'; n.queue=[];t=b.createElement(e);t.async=!0; t.src=v;s=b.getElementsByTagName(e)[0]; s.parentNode.insertBefore(t,s)}(window,document,'script', '');

if( typeof sopp !== "undefined" && sopp === 'yes' ){ fbq('dataProcessingOptions', ['LDU'], 1, 1000); }else{ fbq('dataProcessingOptions', []); }

fbq('init', '1321385257908563');

fbq('track', 'PageView');

fbq('trackSingle', '1321385257908563', 'ViewContent', { content_name: 'query-relaxation-semantic-search', content_category: 'seo-strategy technical-seo' }); }

Source link


8 Pillar Page Examples to Get Inspired By



8 Pillar Page Examples to Get Inspired By

Pillar pages are high-level introductions to a topic. They then link to other pages, which are usually more detailed guides about parts of the main topic.

Altogether, they form a content hub.

Example of a content hub

But not all pillar pages look the same. 

In this guide, we’ll look at eight examples of pillar pages to get your creative juices flowing.

Excerpt of beginner's guide to SEO by Ahrefs

Key stats

Estimated organic traffic: 1,200
Backlinks: 6,900
Referring domains: 899

Overview of Ahrefs' beginner's guide to SEO in Ahrefs' Site Explorer

This is our very own pillar page, covering the broad topic of search engine optimization (SEO)

Why I like it

Besides the fact that I’m biased, I like the custom design we created for this page, which makes it different from the articles on our blog. 

Even though the design is custom, our pillar page is still a pretty classic “hub and spoke” style pillar page. We’ve broken the topic down neatly into six different chapters and internally linked to guides we’ve created about them. There are also custom animations when you hover over each chapter:

Examples of chapters in the SEO guide

We’ve also added a glossary section that comes with a custom illustration of the SERPs. We have explanations of what each element means, with internal links to more detailed content:

Custom illustration of the SERP

Finally, it links to another “pillar page”: our SEO glossary


Consider creating a custom design for your pillar page so that it stands out. 

Excerpt of Doctor Diet's ketogenic diet guide

Key stats

Estimated organic traffic: 92,200
Backlinks: 21,600
Referring domains: 1,700

Overview of Diet Doctor's ketogenic diet guide in Ahrefs' Site Explorer

Diet Doctor is a health company focusing on low-carb diets. Its pillar page is a comprehensive guide on the keto diet. 

Why I like it

On the surface, it doesn’t exactly look like a pillar page; it looks like every other post on the Diet Doctor site. But that’s perfectly fine. It’s simply a different approach—you don’t have to call out the fact that it’s a pillar page. 


Diet Doctor’s guide is split into 10 different sections with links to its own resources. The links bring you to different types of content (not just blog posts but videos too).

Video course about keto diet for beginners

Unlike the classic pillar page, Diet Doctor’s guide goes into enough detail for anyone who is casually researching the keto diet. But it also links to further resources for anyone who’s interested in doing additional research.


Pillar pages need not always just be text and links. Make it multimedia: You can add videos and images and even link to your own multimedia resources (e.g., a video course).

Excerpt of Wine Folly's beginner's guide to wine

Key stats

Estimated organic traffic: 5,600
Backlinks: 2,800
Referring domains: 247

Overview of Wine Folly's beginner's guide to wine in Ahrefs' Site Explorer

Wine Folly is a content site devoted to wine knowledge and appreciation. Its pillar page, as expected, is about wine. 

Why I like it

Wine Folly’s pillar page is a classic example of a “hub and spoke” style pillar page—split into multiple sections, with some supporting text, and then internal links to other resources that support each subsection. 

Supporting text and links to other resources

This page doesn’t just serve as a pillar page for ranking purposes, though. Given that it ranks well and receives quite a significant amount of search traffic, the page also has a call to action (CTA) to Wine Folly’s book:

Short description of book; below that, CTA encouraging site visitor to purchase it


While most websites design pillar pages for ranking, you can also use them for other purposes: capture email addresses, sell a book, pitch your product, etc. 

Excerpt of A-Z directory of yoga poses

Key stats

Estimated organic traffic: 11,100
Backlinks: 3,400
Referring domains: 457

Overview of Yoga Journal's A-Z directory of yoga poses in Ahrefs' Site Explorer

Yoga Journal is an online and offline magazine. Its pillar page is an A-Z directory of yoga poses.

Why I like it

Yoga Journal’s pillar page is straightforward and simple. List down all possible yoga poses (in both their English and Sanskrit names) in a table form and link to them. 

List of yoga poses in table form

Since it’s listed in alphabetical order, it’s useful for anyone who knows the name of a particular pose and is interested in learning more. 

What I also like is that Yoga Journal has added an extra column on the type of pose each yoga pose belongs to. If we click on any of the pose types, we’re directed to a category page where you can find similar kinds of poses: 

Examples of standing yoga poses (in grid format)


The A-Z format can be a good format for your pillar page if the broad topic you’re targeting fits the style (e.g., dance moves, freestyle football tricks, etc.).

Excerpt of Atlassian's guide to agile development

Key stats

Estimated organic traffic: 115,200
Backlinks: 3,200
Referring domains: 860

Overview of Atlassian's guide to agile development in Ahrefs' Site Explorer

Atlassian is a software company. You’ve probably heard of its products: Jira, Confluence, Trello, etc. Its pillar page is on agile development.

Why I like it

Atlassian’s pillar page is split into different topics related to agile development. It then has internal links to each topic—both as a sticky table of contents and card-style widgets after the introduction: 

Sticky table of contents
Card-style widgets

I also like the “Up next” feature at the bottom of the pillar page, which makes it seem like an online book rather than a page. 

Example of "Up next" feature


Consider adding a table of contents to your pillar page. 

Excerpt of Muscle and Strength's workout routines database

Key stats

Estimated organic traffic: 114,400
Backlinks: 2,900
Referring domains: 592

Overview of Muscle and Strength's workout routines database in Ahrefs' Site Explorer

Muscle and Strength’s pillar page is a massive database linking to various categories of workouts. 

Why I like it

Calling it a pillar page seems to be an understatement. Muscle and Strength’s free workouts page appears to be more like a website. 

When you open the page, you’ll see that it’s neatly split into multiple categories, such as “workouts for men,” “workouts for women,” “biceps,” “abs,” etc. 

Workout categories (in grid format)

Clicking through to any of them leads us to a category page containing all sorts of workouts:

Types of workouts for men (in grid format)

Compared to the other pillar pages on this list, where they’re linking to other subpages, Muscle and Strength’s pillar page links to other category pages, which then link to their subpages, i.e., its massive archive of free workouts.


Content databases, such as the one above, are a huge undertaking for a pillar page but can be worth it if the broad topic you’re targeting fits a format like this. Ideally, the topic should be about something where the content for it is ever-growing (e.g., workout plans, recipes, email templates, etc.).

Excerpt of Tofugu's guide to learning Japanese

Key stats

Estimated organic traffic: 39,100
Backlinks: 1,100
Referring domains: 308

Overview of Tofugu's guide to learning Japanese in Ahrefs' Site Explorer

Tofugu is a site about learning Japanese. And its pillar page is about, well, learning Japanese.

Why I like it

This is an incredible (and yes, ridiculously good) guide to learning Japanese from scratch. It covers every stage you’ll go through as a complete beginner—from knowing no Japanese to having intermediate proficiency in the language. 

Unlike other pillar pages where information is usually scarce and simply links out to further resources, this page holds nothing back. Under each section, there is great detail about what that section is, why it’s important, how it works, and even an estimated time of how long that stage takes to complete. 

Another interesting aspect is how Tofugu has structured its internal links as active CTAs. Rather than “Learn more” or “Read more,” it’s all about encouraging users to do a task and completing that stage. 

CTA encouraging user to head to the next task of learning to read hiragana


Two takeaways here:

  • Pillar pages can be ridiculously comprehensive. It depends on the topic you’re targeting and how competitive it is.
  • CTAs can be more exciting than merely just “Read more.”
Excerpt of Zapier's guide to working remotely

Key stats

Estimated organic traffic: 890
Backlinks: 4,100
Referring domains: 1,100

Overview of Zapier's guide to working remotely in Ahrefs' Site Explorer

Zapier allows users to connect multiple software products together via “zaps.” It’s a 100% remote company, and its pillar page is about remote work. 

Why I like it

Zapier’s pillar page is basically like Wine Folly’s pillar page. Break a topic into subsections, add a couple of links of text, and then add internal links to further resources. 

In the examples above, we’ve seen all sorts of execution for pillar pages. There are those with custom designs and others that are crazily comprehensive.

But sometimes, all a pillar page needs is a simple design with links. 


If you already have a bunch of existing content on your website, you can create a simple pillar page like this to organize your content for your readers. 


Keep learning

Inspired by these examples and want to create your own pillar page? Learn how to successfully do so with these two guides:

Any questions or comments? Let me know on Twitter.  

Source link

Continue Reading

Subscribe To our Newsletter
We promise not to spam you. Unsubscribe at any time.
Invalid email address