Connect with us

MARKETING

Is A/B testing dead?

Published

on

Is A/B testing dead?


“Today, A/B testing is thriving — it’s been a huge improvement from non-A/B testing,” said George Khachatryan, CEO of AI company OfferFit, in a recent webinar. “At the same time, the people performing these tests every day recognize that’s it’s a lot more difficult than it may seem.”

Designing A/B tests, determining samples sizes, and deploying them takes up a lot of time and resources, and analyzing the findings requires high levels of precision. All in all, the manual tasks required by A/B testing can place a heavy burden on marketers.

“When you’re running a full experimentation program, it’s never enough to run one A/B test,” Khachatryan said. “When you run one, you gain valuable insights, and inevitably want to gain more. So you end up running more.”

He added, “Those who are doing this hands-on realize it just becomes a rapid explosion in the number of tests they need – it becomes infeasible very early on this exponential curve.”

graph showing how A/B testing fails to scale
Source: George Khachatryan

Marketers need a solution that allows them to test a growing number of campaign variables while simultaneously giving them enough time to analyze the data. Fortunately, A/B testing is evolving.

Expanding the power of A/B testing

In the webinar, Khachatryan highlighted the “multi-armed bandit problem” that’s affecting modern A/B testing. In the traditional version of this scenario, a person at a casino must determine which slot machines (the “one-armed bandits” that steal your money) are going to have the best payouts, then figure out which order will be optimal. With A/B testing, the variables are the multi-armed bandits, and the marketer must discover which are most effective so they can allocate more resources to the areas performing well.

“You can think of [a multi-armed bandit] like a smart A/B test,” he said. “It’ll navigate the exploration-exploitation tradeoff — it’ll start randomly pulling those ten handles, but as it goes, it’ll dynamically reallocate resources so that if something looks bad it’ll stop pulling.”

mult-armed bandits vs contextual bandits in A/B testing
Source: George Khachatryan

He added, “These multi-arm bandits are designed to experiment just the right amount so you’re learning but also taking advantage of what you’ve already learned.”

While these multi-armed, or A/B, models have served marketers well over the years, there’s a new iteration of the framework that is more accurate and effective. According to Khachatryan, these are “contextual bandits.”

“It does what a multi-armed bandit does, but it takes into account different contexts,” he said. “So, if you have two different customers, with different characteristics, it’ll know to pull different levers.”

Contextual bandit frameworks are essentially automated experimentation and personalization at scale. It’s a model that can completely automate the process, and it’s what every marketer should be moving toward to improve campaign effectiveness at scale.


Get the daily newsletter digital marketers rely on.


Automated experimentation is the future

Many of the tech giants have already adopted contextual bandit frameworks, but marketers should note that this technology is still incredibly new. Brands should allocate enough time and resources to make the transition process easier, because, according to Khachatryan, it’s the “future of experimentation.”

“In the past, manual A/B testing works with one mention at a time,” he said. “With these contextual bandits, you can set it up to simlutantous test multiple dimensions.”

Whether it’s testing email subject line efficacy, call-to-action click-through rates, or optimal article posting times, marketers have a lot of experimental data to keep up with. Automated testing solutions can make these processes more manageable by decreasing the time spent on manual tasks, replacing them with continuous automated experimentation.

automated campaign testing
Source: George Khachatryan

“You can think of this as the next iteration of experimentation, or test-and-learn programs,” Khachatryan said. “When a marketer sets up this system of continuous automated experimentation, it creates this interplay where you can see what happens, gain insights, and then use those insights to get new ideas.”

He added, “So you still have the agile test-and-learn cycle, but it’s accelerated.”

Time will tell how quickly marketers adopt these automated experimentation technologies. But, with the high level of marketing technology replacements that took place over the past year, there’s a good chance more brands will sign on sooner rather than later.

Watch this webinar presentation at Digital Marketing Depot.


Marketing automation: A snapshot

What they are. For today’s marketers, automation platforms are often the center of the marketing stack. They aren’t shiny new technologies, but rather dependable stalwarts that marketers can rely upon to help them stand out in a crowded inbox and on the web amidst a deluge of content.

How they’ve changed. To help marketers win the attention battle, marketing automation vendors have expanded from dependence on static email campaigns to offering dynamic content deployment for email, landing pages, mobile and social. They’ve also incorporated features that rely on machine learning and artificial intelligence for functions such as lead scoring, in addition to investing in the user interface and scalability.

Why we care. The growing popularity of account-based marketing has also been a force influencing vendors’ roadmaps, as marketers seek to serve the buying group in a holistic manner — speaking to all of its members and their different priorities. And, ideally, these tools let marketers send buyer information through their tight integrations with CRMs, giving the sales team a leg up when it comes to closing the deal.

Read next: What is marketing automation?


About The Author

Corey Patterson is an Editor for MarTech and Search Engine Land. With a background in SEO, content marketing, and journalism, he covers SEO and PPC to help marketers improve their campaigns.



Source link

MARKETING

Drive Conversions and Generate Engagement With Instacart Promotions

Published

on

Drive Conversions and Generate Engagement With Instacart Promotions

Through deals and coupons, Instacart has saved consumers more than $700 million in 2022. As we dive into 2023, the leading grocery technology company in North America has big plans to help consumers save even more while also helping CPGs generate sales. Instacart recently announced an advertising solution that helps both sellers and consumers called Instacart Promotions. This exciting feature is designed to help drive conversions, boost sales, and generate overall engagement on the app.

Interested in this feature and how it can help your business on Instacart? Read on as we dive into everything you need to know about this ad solution including benefits, how to get started, and more.

 

What are Instacart Promotions?

 

Instacart Promotions is an advertising feature that’s now available to all brand partners, including emerging brands, within their open beta program. Promotions give CPGs the opportunity to offer new deal structures, promotions, and incentives with Instacart Ad campaigns. With this feature in place, consumers will have access to more promotions, coupons, and deals that are tailored to them within the Instacart Marketplace.

“With the launch of our new Instacart Promotions, all of our brand partners now have the ability to set up coupons and promotions that can drive meaningful business results while also passing on more savings opportunities to consumers. We’re proud to continue expanding our portfolio with additional self-service capabilities, ad formats that drive results, and measurement that brands need to understand the true impact of their campaigns on Instacart.”

 

– Ali Miller, VP of Ads Product at Instacart

 

Source: Instacart

 

How Do Instacart Promotions Work?

 

Promotions, now available in Ads Manager, gives consumers the ability to discover more promotions and savings opportunities within the Instacart app. These promotions now show up directly on product item cards before checkout for easy accessibility. Promotions allow advertisers to customize their campaigns to sync with their goals and objectives whether that be driving sales, building baskets, or boosting trials.

Instacart shared a recent example of a brand successfully utilizing Promotions… 

Athletic Brewing, General Mills, Sola Company, and Wells Enterprises (maker of Halo Top) are strengthening campaign performance by pairing Instacart Promotions with ad formats such as Sponsored Product and Display. Instacart Promotions include two new flexible and customizable structures: Coupons (“buy X units, save $Y”) and Stock Up & Save (“Spend $X, Save $Y”). 

According to Instacart, in the coming months, the company “will work to further enhance the new offering with new deal structures such as Free Gifts and Buy One, Get One (“BOGO”). The new deal structures will help brand partners run “Free Sample” programs that can win new customers and serve personalized discounts for different customer segments, such as “new to brand” and “new to category.”  

 

Example of Instacart Promotions

Source: Instacart

 

Instacart Promotions Benefits

 

Deliver Value and Savings to Consumers

 

With Instacart Promotions, you have the opportunity to deliver value and savings that will have consumers coming back for more. With this savings feature, your brand can stand out among the competition and offer a variety of deals to shoppers ie: “Buy X units, Save $Y”.

 

Hot tip: Ensure you are selecting products for your promotion that are well-stocked and widely available.  

 

Tailor Your Campaigns to Specific Objectives

 

With a variety of savings options available, your brand can structure deals to fit specific business goals and objectives. 

 

Hot tip: If you’re looking to drive visibility and awareness, try pairing promotions with Sponsored Product campaigns. 

 

Access Real-Time Performance Insights 

 

The Promotions beta program is live and can be accessed within Instacart Ads Manager. Within Ads Manager, advertisers can access real-time insights to maximize performance and adjust campaigns as needed.

 

Hot tip: Make sure your budget matches your discount and objectives.

 

“As an advertiser, Instacart’s unique offering to self-manage promotions is so exciting! Historically, making adjustments to offer values and other promotion parameters was a more manual process, but now we’ll be able to easily make optimizations in real-time based on redemption performance.”

Emily Choate

Emily Choate, Senior Specialist, Marketplace Search at Tinuiti

 

Interested in Instacart Promotions?

 

With Instacart Promotions, you have the opportunity to reach new customers, build bigger baskets, and drive sales. Interested in testing out the beta program or looking to get started with advertising on the app? Drop us a line – we’d love to help elevate your CPG brand on Instacart.

 

Source link

Continue Reading

MARKETING

(Re)Introducing your favorite Optimizely products!

Published

on

(Re)Introducing your favorite Optimizely products!



It’s important to us that you, our valued customers and partners, can identify with the tools you use daily.  

In that pursuit, Optimizely set out to simplify the way we talk about our product suite. That starts, first and foremost, with the words we use to refer to the technology.  

So, we’ve taken a hard look at everything in our portfolio, and are thrilled to introduce new names we believe are more practical, more consistent, and better representative of the technology we all know and love.  

You may have seen some of these names initially at Opticon 2022 as well as on our website. In the spirit of transparency, the team here at Optimizely wanted to make sure you had full visibility into the complete list of new names, as well as understand the context (and rationale) behind the changes. 

So, without further ado… 

Which names changed?  

Some, but not all. For your ongoing reference, below is a complete list of Optimizely products, with previous terminology you may be familiar with in the first column, and (if applicable) the new name in the second column.  

Used to be… 

Is now (or is still)… 

Meaning… 

DXP 

Optimizely Digital Experience Platform 

A fully-composable solution designed to support the orchestration, monetization, and experimentation of any type of digital experience — all from a single, open and extensible platform. 

Content Cloud 

Optimizely Content Management System 

A best-in-class system for building dynamic websites and helping digital teams deliver rich, secure and personalized experiences. 

Welcome 

Optimizely Content Marketing Platform 

An industry-leading and user-friendly platform helping marketing teams plan campaigns, collaborate on tasks, and author content. 

DAM 

Optimizely Digital Asset Management 

A modern storage tool helping teams of any size manage, track, and repurpose marketing and brand assets (with support for all file types). 

Content Recs 

Optimizely Content Recommendations 

AI-powered and real-time recommendations to serve the unique interests of each visitor and personalize every experience. 

B2B Commerce 

Optimizely Configured Commerce 

A templatized and easy-to-deploy platform designed to help manufacturers and distributors drive efficiency, increase revenue and create easy buying experiences that retain customers. 

Commerce Cloud 

Optimizely Customized Commerce 

A complete platform for digital commerce and content management to build dynamic experiences that accelerate revenue and keep customers coming back for more. 

PIM 

Optimizely Product Information Management 

A dedicated tool to help you set up your product inventory and manage catalogs of any size or scale. 

Product Recs 

Optimizely Product Recommendations 

Machine-learning algorithms optimized for commerce to deliver personalized product recommendations in real-time. 

Web 

Optimizely Web Experimentation 

An industry-leading experimentation tool allowing you to run A/B and multi-variant tests on any channel or device with an internet connection. 

Full Stack 

Optimizely Feature Experimentation 

A comprehensive experimentation platform allowing you to manage features, deploy safer tests, and roll out new releases – all in one place. 

Personalization 

Optimizely Personalization 

An add-on to core experimentation products, allowing teams to create/segment audiences based on past behavior and deliver more relevant experiences. 

Program Management 

Optimizely Program Management 

An add-on to core experimentation products, allowing teams to manage the end-to-end lifecycle of an experiment. 

ODP 

Optimizely Data Platform 

A centralized hub to harmonize data across your digital experience tools, providing one-click integrations, AI-assisted guidance for campaigns, and unified customer profiles. 

 

So, why the change?  

 It boils down to three guiding principles:  

  1. Uniformity: Create a naming convention that can be applied across the board, for all products, to drive consistency 
  2. Simplicity: Use terms that are both practical and concise, ensuring the names are something that everyone can understand and identify with  
  3. Completeness: Develop a framework that showcases the full and complimentary nature of all the products and solutions within the Optimizely suite 

 As the Optimizely portfolio comes together as a complete, unified platform, it’s important that our names reflect this, as well as support our 3 key solutions (i.e. orchestrate amazing content experiences, monetize every digital experience, and experiment across all touchpoints).  

Other questions? We’ve got you covered. 

Q: Why have you made these product name changes? 

    • We wanted to simplify how we talk about our portfolio. The renaming applies a naming convention that is both practical and concise.  

 

Q: Do the new product name changes affect the products I own? 

    • No, there is no impact to product functionality or capabilities.  

 

Q: Do the new product name changes affect who is my Customer Success Manager or Account Manager?  

    • No, there are no changes to your Customer Success Manager or Account Manager. 

 

Q: Do the new product name changes affect the ownership of the company?  

    • No, ownership of the company has not changed. We have only made changes to the Product Names. 

 

Q: Have any contact details changed that I need to be aware of?  

    • Only contact details for former Welcome customers has changed. These are the new contact details you should be aware of: Optimizely, Inc.| 119 5th Ave | 7th Floor | New York, NY 10003 USA. Phone: +1 603 594 0249 | www.optimizely.com 

 

Q: Where can I send any follow up questions I might have?  

    • If you have any questions about the Product Names, please contact your Customer Success Manager or Account Manager.  


Source link

Continue Reading

MARKETING

Email Marketing Trends 2023: Predictions by the Industry Stalwarts

Published

on

Email Marketing Trends 2023: Predictions by the Industry Stalwarts


Every year, we see new trends entering the world of email marketing.

Source link

Continue Reading

Trending