Connect with us


Path To Next Generation Search



Path To Next Generation Search

Google announced a breakthrough in the effort to create an AI architecture that can handle millions of different tasks, including complex learning and reasoning. The new system is called the Pathways Language Model, referred to as PaLM.

PaLM is able to outperform the current state of the current AI state of the art as well as beat humans in the language and reasoning tests.

But the researchers also point out that they cannot shake the limitations inherent in large-scale languages models that can unintentionally result in negative ethical outcomes.

Background Information

The next few sections are background information that clarify what this algorithm is about.

Few-Shot Learning

Few-shot learning is the next stage of learning that is moving beyond deep learning.

Google Brain researcher, Hugo Larochelle (@hugo_larochelle) said in a presentation titled, Generalizing from Few Examples with Meta-Learning (video) explained that with deep learning, the problem is that they had to collect a vast amount of data that required significant amount of human labor.

He pointed out that deep learning will likely not be the path toward an AI that can solve many tasks because with deep learning, each task requires millions of examples from which to learn from for each ability that an AI learns.


Larochelle explains:

“…the idea is that we will try to attack this problem very directly, this problem of few-shot learning, which is this problem of generalizing from little amounts of data.

…the main idea in what I’ll present is that instead of trying to define what that learning algorithm is by N and use our intuition as to what is the right algorithm for doing few-shot learning, but actually try to learn that algorithm in an end-to-end way.

And that’s why we call it learning to learn or I like to call it, meta learning.”

The goal with the few-shot approach is to approximate how humans learn different things and can apply the different bits of knowledge together in order to solve new problems that have never before been encountered.

The advantage then is a machine that can leverage all of the knowledge that it has to solve new problems.

In the case of PaLM, an example of this capability is its ability to explain a joke that it has never encountered before.

Pathways AI

In October 2021 Google published an article laying out the goals for a new AI architecture called Pathways.

Pathways represented a new chapter in the ongoing progress in developing AI systems.


The usual approach was to create algorithms that were trained to do specific things very well.

The Pathways approach is to create a single AI model that can solve all of the problems by learning how to solve them, in that way avoiding the less efficient way of training thousands of algorithms to complete thousands of different tasks.

According to the Pathways document:

“Instead, we’d like to train one model that can not only handle many separate tasks, but also draw upon and combine its existing skills to learn new tasks faster and more effectively.

That way what a model learns by training on one task – say, learning how aerial images can predict the elevation of a landscape – could help it learn another task — say, predicting how flood waters will flow through that terrain.”

Pathways defined Google’s path forward for taking AI to the next level to close the gap between machine learning and human learning.

Google’s newest model, called Pathways Language Model (PaLM), is this next step and according to this new research paper, PaLM represents a significant progress in the field of AI.

What Makes Google PaLM Notable

PaLM scales the few-shot learning process.

According to the research paper:


“Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning, which drastically reduces the number of task-specific training examples needed to adapt the model to a particular application.

To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model (PaLM).”

There are many research papers published that describe algorithms that don’t perform better than the current state of the art or only achieve an incremental improvement.

That’s not the case with PaLM. The researchers claim significant improvements over the current best models and even outperforms human benchmarks.

That level of success is what makes this new algorithm notable.

The researchers write:

“We demonstrate continued benefits of scaling by achieving state-ofthe-art few-shot learning results on hundreds of language understanding and generation benchmarks.

On a number of these tasks, PaLM 540B achieves breakthrough performance, outperforming the fine tuned state of-the-art on a suite of multi-step reasoning tasks, and outperforming average human performance on the recently released BIG-bench benchmark.

A significant number of BIG-bench tasks showed discontinuous improvements from model scale, meaning that performance steeply increased as we scaled to our largest model.”

PaLM outperforms the state of the art in English natural language processing tasks and that makes PaLM important and notable.


On a collaborative benchmark called BIG-bench consisting of over 150 tasks (related to reasoning, translation, question answering), PaLM outperformed the state of the art but there were areas where it did not do as well.

Worthy of noting is that human performance outscored PaLM on 35% of the tasks, particularly mathematical related tasks (See section 6.2 BIG-bench of the research paper, page 17).

PaLM was better at translating another language into English than translating English to other languages. The researchers stated that this is a common problem that could be solved by prioritizing more multilingual data.

Nevertheless, PaLM pretty much outperformed other language models and humans across the board.

Ability to Reason

Of particular note was it’s performance with arithmetic and commonsense reasoning tasks.

Example of an arithmetic task:

Roger has 5 tennis balls. He buys 2 more cans of tennis balls. Each can has 3 tennis balls. How many tennis balls does he have now?

The answer is 11.

Example of commonsense reasoning:


Sean was in a rush to get home, but the light turned yellow and he was forced to do what?
Answer Choices: (a) take time (b) dawdle (c) go slowly (d) ocean (e) slow down

The answer is (e) slow down.

Generating Explanations

Another extraordinary example of how advanced PaLM is in tests of generating explanations.

Here’s how the research paper explains it:

“The goal of this section is to showcase the capabilities of PaLM with regards to explanatory language generation, for prompts that require a complex combination of logical inference chaining, world knowledge, abstract language understanding, and lexicographic language understanding (e.g., puns).”

Explanations of Jokes

Here is an example of the language model explaining a joke:

I was going to fly to visit my family on April 6th. My mom said “Oh great, your step dad’s poetry reading is that night!”

So now I’m flying in on April 7th.

Model Explanation:
The joke is that the speaker’s mother is trying to get them to go to their step dad’s poetry reading, but the speaker doesn’t want to go, so they are changing their flight to the day after the poetry reading.

Inference Chaining

Here’s an example of inference chaining, where multiple concepts and entities need to be correctly joined and considered to create an answer.

Guido was writing a Python program. He keeps getting confused by variable scope and looking it up on StackOverflow.

Is it possible that the Guido in the prompt refers to Guido van Rossum?


Model Output:
Guido van Rossum is the creator of Python. He would not need to look up variable scope on StackOverflow. The answer is “no”.”

Here is one more example:

Jennifer looked out her window and sees a really cool cloud below her. She unbuckles her seatbelt and heads to the bathroom. Is Jennifer probably traveling more than 300 miles per hour relative to the earth?

Model Output:
300 miles per hour is about 480 km/h. This is about the speed of a commercial airplane. Clouds are usually below airplanes, so Jennifer is probably on an airplane.

The answer is “yes”.”

Next Generation Search Engine?

The above example of the ability of PaLM for complex reasoning demonstrates how a next generation search engine may be able to answer complex answers utilizing knowledge from the Internet and other sources.

Achieving an AI architecture that can produce answers that reflect the world around us is one of the stated goals of Google Pathways and PaLM is a step in that direction.

However, the authors of the research emphasized that PaLM is not the final word on AI and search. They were explicit in stating that PaLM is a first step toward the next kind of search engine that Pathways envisions.

Before we proceed further, there are two words, jargon so to speak, that are important to understand in order to get what PaLM is about.

  • Modalities
  • Generalization

The word “modalities” is a reference to how things are experienced or the state in which they exist, like text that is read, images that are seen, things that are listened to.

The word “generalization” in the context of machine learning is about the ability of a language model to solve tasks that it hasn’t previously been trained on.

The researchers noted:

“PaLM is only the first step in our vision towards establishing Pathways as the future of ML scaling at Google and beyond.

We believe that PaLM demonstrates a strong foundation in our ultimate goal of developing a large-scale, modularized system that will have broad generalization capabilities across multiple modalities.”

Real-World Risks and Ethical Considerations

Something different about this research paper is that the researchers warn about ethical considerations.

They state that large-scale language models trained on web data absorb many of the “toxic” stereotypes and social disparities that are spread on the web and they state that PaLM is not resistant to those unwanted influences.

The research paper cites a research paper from 2021 that explores how large-scale language models can promote the following harm:

  1. Discrimination, Exclusion and Toxicity
  2. Information Hazards
  3. Misinformation Harms
  4. Malicious Uses
  5. Human-Computer Interaction Harms
  6. Automation, Access, and Environmental Harms

Lastly, the researchers noted that PaLM does indeed reflect toxic social stereotypes and makes clear that filtering out these biases are challenging.

The PaLM researchers explain:

“Our analysis reveals that our training data, and consequently PaLM, do reflect various social stereotypes and toxicity associations around identity terms.

Removing these associations, however, is non-trivial… Future work should look into effectively tackling such undesirable biases in data, and their influence on model behavior.


Meanwhile, any real-world use of PaLM for downstream tasks should perform further contextualized fairness evaluations to assess the potential harms and introduce appropriate mitigation and protections.”

PaLM can be viewed as a peek into what the next generation of search will look like. PaLM makes extraordinary claims to besting the state of the art but the researchers also state that there is still more work to do, including finding a way to mitigate the harmful spread of misinformation, toxic stereotypes and other unwanted results.


Read Google’s AI Blog Article About PaLM

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance

Read the Google Research Paper on PaLM

PaLM: Scaling Language Modeling with Pathways (PDF)

fbq('track', 'PageView');

fbq('trackSingle', '1321385257908563', 'ViewContent', { content_name: 'google-palm', content_category: 'news seo ' });

Source link

See also  Google Explains How AI Keeps Search Safe Via MUM & BERT


How To Use Google’s Structured Data Markup Helper



How To Use Google's Structured Data Markup Helper

If you drill down to the very core, every search engine optimization (SEO) strategy has the same aim: convincing Google your webpage is the best answer to a user’s query.

There are a lot of tactics you can and should employ to achieve this, but that’s the goal.

And, as the Google brain has grown more complex, it’s able to display increasingly more detailed and helpful answers.

For example, if you’re looking to book a flight from Chicago O’Hare to LAX, Google can now show you options in rich snippets on search results pages.

Likewise, if you run a concert venue, you can add code known as structured data to your website that will encourage Google to display your events when they’re relevant to web searchers.

If you’re not familiar with the term “structured data,” don’t fret – there are a lot of SEO professionals and web marketers who aren’t.

In this article, we’ll set that right, plus give you tips on using the Structured Data Markup Helper to easily add it to your site.

What Is Structured Data?

As defined in this post, structured data is information (data) that is organized (structured). Organized information is basically what structured data is.


For SEO purposes, structured data is a specific type of formatting that gives Google information about the meaning of a page.

Following a standardized vocabulary outlined by, it is used across several search engines, including Google, Bing, Yahoo, and Yandex.

Structured data can use syntax like JSON-LD, RDFa, and Microdata, among others.

Why Is Structured Data Important?

There are several reasons why webpages use structured data.

For one thing, it makes navigation easier for both search engine crawlers and human users.

This is because it provides the information that can then be displayed on search engine results pages (SERPs) in the form of rich snippets, video carousels, and other special search result features and enhancements.

This leads to faster indexing by search spiders and enhances your site’s search visibility. This can also help improve your click-through rate, increase conversions, and grab more voice search traffic.

In an article for Search Engine Journal, Winston Burton, Senior Vice President of SEO at global search and marketing agency Acronym, detailed the results of adding structured data to the client’s website.


With no other optimization strategies employed, the client saw a 400% net growth in rich result organic traffic and a 140% growth in impressions for the company’s answer center.

See also  Legal Considerations & Team Communication For Remote Companies

Even if this is a statistical outlier, it still highlights the massive potential of using structured data.

What Is Structured Data Used For?

Now that we’ve covered what structured data is and why it’s important, let’s look into some of the ways it can be used.

In an April 2022 Google Search Central SEO office-hours hangout, Google Search Advocate John Mueller dove into structured data and its uses.

If you have 30 minutes to spare, it’s well worth the watch. If you’re in a hurry, the part that’s relevant to the current topic begins at 27:19. Or better yet, read Roger Montti’s coverage of it here.

In this hangout, Mueller was asked a question about how to choose the best format for structured data.

His answer was that it’s not so much about what format a page uses, but rather what kind of rich result is available for the page.

Structured data is very versatile and provides a lot of opportunities for businesses to use it to drive clicks. Some of these you may wish to take advantage of include:


Knowledge Panels

Used for things that are part of the Google Knowledge Graph, they provide a quick overview of information about a topic.

Screenshot from search, Google, June 2022

As a business, you can use knowledge panels to give users at-a-glance information about your brand name, logo, and phone number, among other things.

Rich Snippets

Sometimes referred to as rich results, this is the additional data Google shows users in addition to normal search results. This may include things like music, events, or recipes.

Rich Snippets ExampleScreenshot from search, Google, June 2022

For commercial purposes, this is where reviews can be shown. It can also highlight things like products, addresses, and special offers.

Hosted Carousels

Common on mobile devices, this shows multiple “cards” from the same site.

Not to be confused with ordinary carousels, which can include images, video, and other data pulled from multiple sites, hosted carousels use content from only one “host” site.

Google currently supports the following types of hosted carousels:

  • Educational Course.
  • Movie.
  • Recipe.
  • Restaurant.
Carousel exampleScreenshot from search, Google, June 2022


If you’re using Google’s automated ads as part of your PPC strategy, you can use structured snippets to give more information to customers.

See also  15 Digital Marketing ROI Metrics You Need To Know

For example, you could use them to provide information about a line of products, included features or services offered.

AdWords exampleScreenshot from search, Google, June 2022

But, before you go inserting structured snippets into your webpages willy-nilly, you should know these are subject to standard Google Ads policies and must meet a number of requirements, a full list of which can be found here.

Getting Started With Structured Data

By now you should see the benefits structured data can offer, so let’s look at how to add it to your website.

The simplest way to add structured data to your webpage is by using Google’s Data Highlighter tool.


To use this, simply open the tool and highlight data like name, date, location, etc. with your mouse.

Google will note this information the next time it crawls your site and present the data in rich snippets on search results pages.

You can also manually markup elements on HTML webpages. Sound intimidating? It’s not. You just have to have a small working knowledge of coding.

For your convenience, we’ve provided a step-by-step guide to help you through the process:

  1.   Open Google’s Structured Data Markup Helper.
  2.   Click the “Website” tab.
  3.   Select the type of page you’re marking up (e.g., job postings, restaurants, Q&A page, local businesses, etc.)
  4.   Enter the URL of an existing page or raw page HTML.
  5.   Click “Start Tagging.”
  6.   Highlight the parts of the page you want to be included in rich snippets and identify them in the dropdown that appears.
  7.   Fill in the required information. For an event, this includes the event name, location, and date.
  8.   After you have finished tagging, click the “Create HTML” button and choose an output format. JSON-LD is Google’s preferred format, though you can also choose Microdata.
  9.   Copy the code or download it. If you are using JSON-LD, paste the generated code into the body of the existing page. If you choose Microdata, replace your page with the generated HTML.
See also  Google FAQ Rich Results Limited to Two Per Page Rolling Out

Some other things to note:

  • To test the generated code, copy and paste it into the Rich Result test, which will show you any missing fields you need to fill in.
  • You can have multiple items on one page, but Google recommends that they are all the same type, e.g., all movies or all job postings.
  • All pages you want to display rich snippets for should be available to the public and not hidden behind login screens.
  • It may take a few weeks for Google to crawl your new page, but once it does it can be shown in rich snippets.

Is Structured Data A Ranking Signal?

Now for the $10,000 question: Will structured data markup help your site appear higher in search rankings?

Unfortunately, no.

In a deep dive into the topic, Search Engine Journal found that while it offers many benefits, there is no direct evidence schema markup is used by Google to determine search ranking.

That said, because it helps search engines more easily understand the content of your website, it can help you show up in relevant queries you may have been excluded from in the past.

Key Takeaways

Traffic is always the name of the game in digital marketing. And leveraging structured data on your website is a great way to help attract visitors.


Not only does it enhance the appearance of your content in search results, but it can help your site get indexed faster.

Rich results (particularly positive product reviews) can also significantly improve your click-through rate and average time on the page.

If your page is used in a featured snippet, it will show at the top of SERPs.

In addition to the increase in visibility that provides, featured snippets are used to answer voice search queries. That means you’ll be the only result for anyone who uses Siri or Alexa for a query.

The final reason you should use structured data on your website is that it gives you more control over your information.

You determine how Google understands your brand and allows you to control how your information is defined.

Structured data is a useful tool in your toolbox. It doesn’t work for every site and every type of content, but if you’re in a field where it is useful, it’s something you need to be using.

Featured Image: NicoElNino/Shutterstock


Source link

Continue Reading

Subscribe To our Newsletter
We promise not to spam you. Unsubscribe at any time.
Invalid email address