Connect with us

MARKETING

How Sky and RS Group built testing and experimentations programs that actually deliver

Published

on



Testing and experimentation are cornerstones to building a great customer experience—but how do you make sure you’re testing the right things? We received some robust insights at a panel discussion hosted by Optimizely at a recent CX circle London event

The panel consisted of two testing and experimentation experts—Natasha Senior, Senior Digital Manager at Sky and Stewart Ehoff, Head of Experimentation at the leading provider of industrial and electronic solutions, RS Group.

During the session, the duo filled us in on how they get ideas for testing, what tools they use and the biggest item on their testing agenda for 2023. 

Here’s a round-up of Natasha and Stewart’s expert insights and best advice for anyone looking to take their testing game to the next level in the new year.  

Advertisement

How has experimentation evolved in the last couple years? 

Natasha from Sky has seen experimentation expand from a purely marketing-focused initiative to a cross-functional tactic. At Sky, they use experimentation across the business to reduce contact center calls, improve web accessibility, and even optimize their offline customer experience. 

“Experimentation is becoming the heart of everything we do. People think it’s just one department that owns it—like product, tech or marketing—but it’s not. It’s our whole business culture.” — Natasha Senior, Senior Digital Manager at Sky

And Stewart from RS Group agreed, highlighting how experimentation continues to grow as an organization-wide practice. 

“Over the last three years, experimentation has been more widely adopted, so there’s a lot more talent in the space,” said Stewart. “I hope that one day, experimentation will have the same level of importance as SEO—where you simply wouldn’t build products, services or solutions without it.”

How Sky and RS Group built testing and experimentations programs

Where do you get your test ideas from?

For Stewart, it’s important to involve as many key stakeholders as possible to build a strong and effective experimentation roadmap. That’s why RS Group is on a mission to expand experimentation ideation horizontally across the business. 

If people don’t understand the power of experimentation, it can limit the number of good testing ideas produced—because those ideas truly can come from any department. 

Advertisement

“There needs to be an outreach process in place, where you take your stakeholders through the value of experimentation and educate them on the possibilities,” said Stewart. “This will give you more ideas to test and learn from, which is great for experimentation!”

For Sky, the best experimentation ideas come from outside the experimentation team—specifically, from their contact center, which has a front-row seat for how the business’ tech affects its customers.

“We try to visit the contact center once or twice a year to sit with the advisors. They often give us great testing ideas because they’ve sat talking to the customer all day, every day,” said Natasha. “Their insights are invaluable.”

How have Optimizely products helped you build a culture of experimentation? 

Experimentation teams are great at creating (and—as we’ve seen—sourcing) ideas for experiments and understanding which of these are worth pursuing; but they tend not to have the deep tech expertise required to integrate these experiments into a business’ tech stack.  

Optimizely’s Feature Experimentation product has helped RS Group embed experimentation across the business and ensure experiments are built, not by their experimentation team, but by their engineers. Instead, Stewart’s experimentation team is set up to empower other teams to use their testing tools and methodologies to drive their own outcomes.

“You can’t build a culture of experimentation by simply sticking a web snippet on a page and having a few people run some tests. It has to be deeper than that. Testing has to be fundamentally ingrained into your tech stack.” — Stewart Ehoff, Head of Experimentation at RS Group

Advertisement

Most of RS Group’s experiments are delivered server-side, built by their engineers. 

The same goes for Natasha’s team at Sky, who have a long-standing partnership with Optimizely.

“Learning how to use Optimizely Full Stack is part of every developer’s training when they join us,” said Natasha. Just like RS Group, Sky’s experimentation team isn’t involved in building experiments, instead, it’s ingrained in the development team’s way of working. 

What tools are you using to increase your experimentation capabilities?  

Alongside Optimizely, Sky uses Contentsquare’s digital experience analytics platform to create problem statements and build hypotheses for experiments. 

“Your problem statement can’t go anywhere without data,” said Natasha. Contentsquare’s digital experience analytics cloud platform provides Sky with unique customer behavior insights to help build a pipeline of robust, data-driven experiments that the entire company can get behind. 

Contentsquare’s integration with Qualtrics, a Voice of Customer (VoC) feedback platform, enables Sky to validate errors flagged in customer feedback by rewatching affected sessions in Session Replay.

Advertisement

“A/B testing tells you whether a test has worked, but not why. Contentsquare and Qualtrics give us the ‘why’ we need to effectively iterate our testing. — Natasha Senior, Senior Digital Manager at Sky.

For RS Group, the process of improving experimentation practices is still in its early stages. “One of our biggest challenges is around how to increase our understanding of our customers and the problems they’re having to ensure our testing is rooted in strong data and hypotheses,” said Stewart.

Currently, RS Group uses VoC surveys, feedback from customer services and Adobe Analytics to obtain the quantitative data they need to understand their customers. They also work closely with their user experience research team, which is a “wealth of knowledge and information,” said Stewart. “That’s why bringing experimentation and user experience research together is so powerful.” 

What’s next on Sky and RS Group’s experimentation roadmap for 2023?

Sky plans to install Optimizely into their telephonic systems using Optimizely Agent. “We want to start doing A/B tests end-to-end,” said Natasha. “If someone lands on sky.com, uses the bot and then calls in, I want to track and experiment on the entire journey.” 

Contentsquare will help by providing rich, contextual insights into how customers feel at each stage of that digital journey—from start to finish, page by page. This will help the team at Sky make informed decisions about which tests will have the biggest impact on improving the digital experience of their customers.

Alternately, RS Group is focusing on process and automation to get experimentation velocity to the next level. Stewart’s team has spent this year building an experimentation program management system in Airtable to help align stakeholders from different business units. “The program will help us expand our testing roadmap and begin automating our experiments,” said Stewart. 

Advertisement

“To scale properly, we need to reduce the manual time spent analyzing experiments, writing emails, responding to Slacks and building experiment scorecards.” So, for RS Group, it’s all about building repeatable, scalable and automated experiments that save time.

Watch the session on-demand 

Feeling inspired? There’s more where that came from. Watch Natasha’s and Stewart’s session from CX circle London on Contentsquare’s on-demand page to get more inspiration for your experimentation strategy.

And if you’d like to learn more about how Contentsquare can help you skyrocket your experimentation program, get in touch with us today. We’d love to show you how our digital experience analytics platform gives you all the tools you need to build informed tests that truly deliver.


Source link

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address

MARKETING

Trends in Content Localization – Moz

Published

on

Trends in Content Localization - Moz

Multinational fast food chains are one of the best-known examples of recognizing that product menus may sometimes have to change significantly to serve distinct audiences. The above video is just a short run-through of the same business selling smokehouse burgers, kofta, paneer, and rice bowls in an effort to appeal to people in a variety of places. I can’t personally judge the validity of these representations, but what I can see is that, in such cases, you don’t merely localize your content but the products on which your content is founded.

Sometimes, even the branding of businesses is different around the world; what we call Burger King in America is Hungry Jack’s in Australia, Lays potato chips here are Sabritas in Mexico, and DiGiorno frozen pizza is familiar in the US, but Canada knows it as Delissio.

Tales of product tailoring failures often become famous, likely because some of them may seem humorous from a distance, but cultural sensitivity should always be taken seriously. If a brand you are marketing is on its way to becoming a large global seller, the best insurance against reputation damage and revenue loss as a result of cultural insensitivity is to employ regional and cultural experts whose first-hand and lived experiences can steward the organization in acting with awareness and respect.

Source link

Advertisement
Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

MARKETING

How AI Is Redefining Startup GTM Strategy

Published

on

How AI Is Redefining Startup GTM Strategy

AI and startups? It just makes sense.

(more…)

Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

MARKETING

More promotions and more layoffs

Published

on

More promotions and more layoffs

For martech professionals salaries are good and promotions are coming faster, unfortunately, layoffs are coming faster, too. That’s according to the just-released 2024 Martech Salary and Career Survey. Another very unfortunate finding: The median salary of women below the C-suite level is 35% less than what men earn.

The last year saw many different economic trends, some at odds with each other. Although unemployment remained very low overall and the economy grew, some businesses — especially those in technology and media — cut both jobs and spending. Reasons cited for the cuts include during the early years of the pandemic, higher interest rates and corporate greed.

Dig deeper: How to overcome marketing budget cuts and hiring freezes

Be that as it may, for the employed it remains a good time to be a martech professional. Salaries remain lucrative compared to many other professions, with an overall median salary of $128,643. 

Advertisement

Here are the median salaries by role:

  • Senior management $199,653
  • Director $157,776
  • Manager $99,510
  • Staff $89,126

Senior managers make more than twice what staff make. Directors and up had a $163,395 median salary compared to manager/staff roles, where the median was $94,818.

One-third of those surveyed said they were promoted in the last 12 months, a finding that was nearly equal among director+ (32%) and managers and staff (30%). 

PX3zocqNZfzMbWNEZhW9dZnAgkdPrLW8fjkrbVrcEkrNJpJiXrVKkjlQ0Tzuj8YKh Ht9HTEvmxDDt0ZsntfYiZHS0NJ7zEZ 6yMT3OjZajbaXBFV1D2Pk5euJeHKdRuzOzM5ZUxwNtsVNaiIbNrd Q

Extend the time frame to two years, and nearly three-quarters of director+ respondents say they received a promotion, while the same can be said for two-thirds of manager and staff respondents.

Dig deeper: Skills-based hiring for modern marketing teams

Employee turnover 

In 2023, we asked survey respondents if they noticed an increase in employee churn and whether they would classify that churn as a “moderate” or “significant” increase. For 2024, given the attention on cost reductions and layoffs, we asked if the churn they witnessed was “voluntary” (e.g., people leaving for another role) or “involuntary” (e.g., a layoff or dismissal). More than half of the marketing technology professionals said churn increased in the last year. Nearly one-third classified most of the churn as “involuntary.”

FIHUBtZJfK3IzbyZl C6WXBPTE64Gzg1URDzQUXCrD8YkAPZS7mmjpmAAiuhhheJUE4dGVcn6e9XW87ogLVz0Ya4rqHwB8WfXTHS W0hRW7yEdr2bQNjlTwnXvNhMv9NZ092pq1ws7lu DYqLV8i6fcFIHUBtZJfK3IzbyZl C6WXBPTE64Gzg1URDzQUXCrD8YkAPZS7mmjpmAAiuhhheJUE4dGVcn6e9XW87ogLVz0Ya4rqHwB8WfXTHS W0hRW7yEdr2bQNjlTwnXvNhMv9NZ092pq1ws7lu DYqLV8i6fc

Men and Women

Screenshot 2024 03 21 124540Screenshot 2024 03 21 124540

This year, instead of using average salary figures, we used the median figures to lessen the impact of outliers in the salary data. As a result, the gap between salaries for men and women is even more glaring than it was previously.

In last year’s report, men earned an average of 24% more than women. This year the median salary of men is 35% more than the median salary of women. That is until you get to the upper echelons. Women at director and up earned 5% more than men.

Methodology

The 2024 MarTech Salary and Career Survey is a joint project of MarTech.org and chiefmartec.com. We surveyed 305 marketers between December 2023 and February 2024; 297 of those provided salary information. Nearly 63% (191) of respondents live in North America; 16% (50) live in Western Europe. The conclusions in this report are limited to responses from those individuals only. Other regions were excluded due to the limited number of respondents. 

Advertisement

Download your copy of the 2024 MarTech Salary and Career Survey here. No registration is required.

Get MarTech! Daily. Free. In your inbox.

Source link

Advertisement
Keep an eye on what we are doing
Be the first to get latest updates and exclusive content straight to your email inbox.
We promise not to spam you. You can unsubscribe at any time.
Invalid email address
Continue Reading

Trending

Follow by Email
RSS