Ben Labay – Experimentation Program Management

Experimentation programs are focused on developing an experimentation culture that supports running continuous research and testing efforts in order to decrease innovation risk and improve business and customer goals.

To consistently innovate, your organization must promote a culture of experimentation, and make experimentation an integral part of every day’s work.

However, the practice of experimentation can go way beyond optimizing websites. That is why it’s important to learn the frameworks, tools and rituals that can help you and others in your organization embrace experimentation.

Introduction video (5 minutes) 

This course is essential for you if…
You are struggling with:

• Buy-in from leadership
• No measurement of key metrics and KPIs
• No development or data resources for the testing program
• Even successful tests aren’t implemented
• Poor ideas or test quality
• Low test velocity
• Affecting change in your organization

These struggles are addressed by better program management. Understanding the principles and tools of experimentation program management will make it more effective, and fun. This will help you elevate your program and your career.

After taking this course you will…

• Clearly understand the pillars of experimentation programs and how to scale them to your needs.
• Have the program management tools to help manage the tension between risk and reward, between complexity and business objectives.
• Evaluate the program needs according to business goals and expected outcomes with the right set of questions.
• Communicate the outcomes more effectively to increase engagement from broader team.

Skills you will master
Conversion Rate Optimization (CRO) Experimentation metrics Experimentation programs Experimentation strategy Marketing experimentation

Your course curriculum
EXPERIMENTATION PROGRAM MANAGEMENT

1 Why Experimentation?
You are already convinced…but is your boss? Is your leadership bought into CRO and experimentation? This lesson speaks to the WHY, not the what or the how, so you have the context and language to elevate experimentation within your career and your orga …

2 Experimentation Operating System
This is the framework of the operating system. It provides the language we can commonly use to help translate all the different components into how and where it can work in your organization. Topics covered Get an overview of the experimentation operat …

3 Assessment & Strategy Integration
If we’re all playing a game, let’s make sure we know the rules. This is the first and most fundamental phase of the experimentation operating system. It orients the program to make change that matters, that we care about. 8921865, 8921895 Topics covere …

4 Process & Planning
Process and Planning is the systems to accelerate accessibility, trust, and velocity within an experimentation program. This covers much of the traditional and common project and program management components such as roadmapping, data tracking, priorit …

5 Test & Learn
You already have goal and metric maps, you have the research and prioritization tools….In this section of Experimentation program management, we’re talking about the workflow tools and rituals to use as a systems approach to running tests. Topics cover …

6 Decisions & Execution
Topics covered Know what tools help to increase ease and velocity of decisions from test results Know the implementation implications to help plan ahead of time Understand the importance of communication and the tools available Download the slides here

7 Scaling & Program Metrics
9000028 Topics covered Know where you can start programs, and the principles of scaling and resourcing Understand the purpose, categories, and examples of experimentation program audits Understand the primary metric taxonomy and where program metrics f …

ABOUT THE EXPERT

Ben Labay
Managing Director @ Speero  
Ben is Speero’s Managing Director. He combines years of academic and statistics training with customer experience and UX knowledge to help scope and run conversion research programs for companies around the world.