Skip to main content

Course

Advanced Experimentation

This course is designed for practitioners who already understand the foundations of experimentation and want to dive deeper into the implementation methods, calculations, setup, and analysis of experiments. 

Abstract 3D image that resembles a pink and blue ribbon

Lessons

The bayesian approach to A/B testing

Learn how Bayesian A/B testing works, why it's different from traditional testing, and how it helps teams make faster, more confident decisions.

Client-side testing and personalization explained

Learn how client-side testing enables fast experimentation and personalized experiences while understanding its benefits, limitations, and use cases.

Why session-based attribution is flawed in A/B tests

Learn what conversion attribution KPIs measure, why they matter for experimentation, and how they help evaluate campaign and personalization success.

The frequentist approach to A/B testing

Understand the Frequentist approach to A/B testing, including statistical significance, p-values, confidence levels, and experiment interpretation.

Choosing the right optimization KPI for your A/B tests

Learn three essential A/B testing rules that reduce costly mistakes, improve experiment quality, and help teams generate reliable optimization outcomes.

Outliers detection in A/B testing

Understand how outlier detection identifies unusual data points, minimizes skewed experiment results, and improves the reliability of performance analysis.

Server-side testing and personalization explained

Explore how server-side testing enables faster experimentation, backend optimization, and personalized customer experiences across digital touchpoints.

The complex nature of running multivariate tests

Learn why multivariate testing is often impractical, when A/B testing is the better choice, and how to optimize experiments with faster, actionable insights.

The role of optimization analytics in experimentation

Discover how optimization analytics helps evaluate experiments, uncover actionable insights, and continuously improve digital experiences with confidence.

Explore more learning paths

Contact sales

Talk to an expert to learn how Mastercard can enhance your business through our products and services.

Mastercard