SEARCHENGINES

Microsoft Explains How Bing AI Chat Is So Fast (Prometheus)

Published

1 year ago

February 23, 2023

Microsoft’s Jordi Ribas, Corporate Vice President of Search & AI at Microsoft, put together a detailed blog post explaining the Prometheus technology and how Bing uses it to make Bing AI chat fast and current.

Note: The blog post actually goes into more than just Prometheus but I think most of you will find the Prometheus aspect more interesting but the whole blog post is worth a read.

Prometheus is part of Greek mythology and is known as the God of forethought and crafty counsel, a cultural hero, and a trickster figure in Greek mythology. But when it comes to search, it is more about how Bing is able to combine the up-to-date and comprehensive Bing Search index and ranking system, plus the answers results “with the creative reasoning capabilities of OpenAI’s most-advanced GPT models,” Jodi Ribas explained.

Prometheus leverages Bing and GPT to generate a set of internal queries iteratively through a component called Bing Orchestrator, I believe you can see this when you see Bing AI chat translate a long-winded question into a query.

I can be wrong, but I think this process is visible when Bing takes my query “why does bing call their ai chat technology prometheus and what does it do?” and then does the “[Searching for: bing ai chat technology prometheus]” in the screenshot below:

Bing said this is “to provide an accurate and rich answer for the user query within the given conversation context. All within a matter of milliseconds.” Bing calls the answer Bing Chat returns the “Prometheus-generated answer.”

Jodi Ribas explains, “selecting the relevant internal queries and leveraging the respective Bing search results is a critical component of Prometheus, since it provides relevant and fresh information to the model, enabling it to answer recent questions and reducing inaccuracies – this method is called grounding. Put another way, the model reasons over the data provided by Bing and hence it’s grounded by Bing data, via the Bing Orchestrator. The diagram below illustrates how Prometheus works at a high level.”

Here is the diagram:

And for sites that use IndexNow, the content can be fed into this system in seconds. Here is an example of a post I wrote last night and it showing up in Bing AI chat in minutes:

I couldn’t resist… Yep, Bing Chat accurately knew the Feb 2023 Product Reviews Update rolled out. And it also knew the biggest change with the update was related to more languages being impacted globally. Oh, and it’s calling itself Sydney again. 🙂 pic.twitter.com/9P1BmDgsCd
— Glenn Gabe (@glenngabe) February 21, 2023

Fabrice Canel from Bing credited IndexNow:

Thanks for the awesome feedback on the new Bing @rustybrick, @glenngabe ! Our team is delighted to offer our users the latest content in chat seconds after it’s published. Thanks to https://t.co/8oIEYT0WfW for using IndexNow to help us achieve our freshness goal. Much appreciated https://t.co/2Y8G1ORST5
— Fabrice Canel (@facan) February 22, 2023

Then Prometheus can add relevant Bing search answers including weather, stock, sports, news, and so on, to the Chat answer. We’ve seen examples of this when Bing includes local packs or news boxes, and so on, directly in the Chat AI box. Prometheus basically embeds search result features in the AI chat box.

Such as this example:

I love how fast Bing AI Chat is https://t.co/b4kWMesxuo pic.twitter.com/yTARABu5Y8
— Barry Schwartz (@rustybrick) February 20, 2023

And Bing credits Prometheus to the fact that it can show citations in the sentences in the Bing AI Chat answer, “so that users can easily click to access those sources and verify the information. Sending traffic to these sources is important for a healthy web ecosystem and remains one of our top Bing goals,” Jodi Ribas added.

It is an interesting blog post you probably want to read through.

Forum discussion at LinkedIn.

Related Topics:Bing chat Explains fast MICROSOFT Prometheus searchengine

Up Next

Google Now Says Favicons No Longer Need To Be Hosted On Same Domain

Don't Miss

Microsoft Bing Testing Integrating Image Creator In Search Results

Click to comment

You must be logged in to post a comment Login

SEARCHENGINES

Daily Search Forum Recap: April 29, 2024

Published

23 hours ago

April 30, 2024

Entireweb News Bot

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Google’s March 2024 core update completed on April 19th, Google just didn’t confirm it until a week later. Google said its spam reporting tool will add site reputation abuse after May 5. Google responded to concerns over the Chrome IP masking and how it will impact advertisers. Google Knowlwdge Panels has translated sections. Apple Business Connect gains actions with links. Google AI is writing some knowledge panels. I am offline today, all these stories were pre-written and scheduled, including this newsletter.

Search Engine Roundtable Stories:

Google March 2024 Core Update Finished April 19th (A Week Ago)

The Google March 2024 core update finished a week ago and Google did not tell us until today. It finished officially on April 19, 2024, and took 45 days to roll out after starting on March 5, 2024. Google also said this helped reduce low-quality and unoriginal content in search results by 45%, which is up from their estimate of 40%.

Google Spam Reporting Tool To Gain Site Reputation Abuse

Danny Sullivan, Google’s Search Liaison, said that the search company will add the upcoming site reputation abuse policy to the spam reporting tool when the policy begins to be enforced. So sometime after May 5, 2024, the report spam form will gain a new option to report site reputation abuse.

Google Responds To Concerns Over Chrome IP Masking

A week ago, Anu Adegbola wrote a fabulous piece on some new privacy changes that may be coming to Google Chrome in the future named Chrome IP masking and how that may impact advertisers. Ginny Marvin, the Google Ads Liaison, responded to those concerns, saying, “Chrome has not made any recent updates to its IP protection proposal.”

Google Knowledge Panel With Auto-Translated Texts

Google is auto-translating some of the content within the Google Knowledge Panels and blocks. So if you are in a location where you don’t only speak English, Google may show you your local language as an additional block of text in the knowledge panel.

Apple Business Connect Actions: Add Links To Apple Maps Local Listing

Apple Business Connect now lets you add links to your local listings that show up in Apple Maps. This is under the “actions” section that enables customers to order food, buy tickets, schedule an appointment, and more.

Google AI Writing Some Search Knowledge Panels

Google has for a long time used AI to write some knowledge panels. But now Google is labeling some of these AI written knowledge panels with “Al overviews are experimental” as a disclaimer. This may show up for both SGE and non-SGE results, I believe.

Google Maps Pigeon People

I am not sure where this first started but in Japan there is this group of people who dress up as pigeons when the Google Maps street view cameras drive by.

Programming Note: Offline For Last Days Of Passover

This is a programming note that I will be completely offline for the last days of the Passover holiday. The last days of Passover are on Monday and Tuesday, April 29th and 30th. Any stories published here will be scheduled and written beforehand and not posted live.

Other Great Search Threads:

Search Engine Land Stories:

Feedback:

Have feedback on this daily recap; let me know on Twitter @rustybrick or @seroundtable, on Threads, Mastodon and Bluesky and you can follow us on Facebook and on Google News and make sure to subscribe to the YouTube channel, Apple Podcasts, Spotify, Google Podcasts or just contact us the old fashion way.

Note: This was pre-written and scheduled to be posted today, I am currently offline for Passover.

SEARCHENGINES

Offline For Last Days Of Passover 5784

Published

2 days ago

April 29, 2024

Entireweb News Bot

This is a programming note that I will be completely offline for the last days of the Passover holiday. The last days of Passover are on Monday and Tuesday, April 29th and 30th. Any stories published here will be scheduled and written beforehand and not posted live.

I will be completely offline, so any social media posts, tweets, anything coming from this site or my social channels are all scheduled beforehand.

I won’t be able to reply to comments, remove spam or break any stories on those days. I will catch up when I get back online.

Feel free to check out the archives or catch up with the weekly videos or just browse the search pics. Oh, and if you have nothing to do, feel free to subscribe to my YouTube channel.

For more on this holiday, check out Wikipedia.

For all those celebrating the holiday – have a good one and I’ll be back on Wednesday.

SEARCHENGINES

Daily Search Forum Recap: April 26, 2024

Published

3 days ago

April 28, 2024

Entireweb News Bot

Here is a recap of what happened in the search forums today, through the eyes of the Search Engine Roundtable and other search forums on the web.

Google Publisher Center removes the ability to add publications manually. Google is testing placing the snippet date next to the URL. Google now shows IP ranges for user-triggered fetchers. Google Ads has a new warning for low keyword quality. Google and Microsoft impress with earnings reports. And I posted the weekly SEO video recap. Also, I am offline Monday and Tuesday for the last days of Passover.