A/B Testing in Python
Learn the practical uses of A/B testing in Python to run and analyze experiments. Master p-values, sanity checks, and analysis to guide business decisions.
Kurs Kostenlos Starten4 Stunden16 Videos51 Übungen6.074 LernendeLeistungsnachweis
Kostenloses Konto erstellen
oder
Durch Klick auf die Schaltfläche akzeptierst du unsere Nutzungsbedingungen, unsere Datenschutzrichtlinie und die Speicherung deiner Daten in den USA.Trainierst du 2 oder mehr?
Versuchen DataCamp for BusinessBeliebt bei Lernenden in Tausenden Unternehmen
Kursbeschreibung
In this course, you will dive into the world of A/B testing, gain a deep understanding of the practical use cases, and learn to design, run, and analyze these A/B tests in Python.
Did you know that you are almost guaranteed to participate in an A/B test every time you browse the internet? From search engines and e-commerce sites to social networks and marketing campaigns — all businesses hire the best data analysts, scientists, and engineers to leverage the power of AB testing. Testing different variants can help optimize the customer experience, maximize profits, inform the next best design, and much more.
You’ll start by learning how to define the right metrics before learning how to estimate the appropriate sample size and duration to yield conclusive results. Throughout this course, you’ll use a range of Python packages to help with A/B testing, including statsmodels, scipy, and pingouin.
By the end of the course, you will be able to run the necessary checks that guarantee accurate results, master the art of p-values, and analyze the results of A/B tests with ease and confidence to guide the most critical business decisions.
Discover How A/B Tests Work
Did you know that you are almost guaranteed to participate in an A/B test every time you browse the internet? From search engines and e-commerce sites to social networks and marketing campaigns — all businesses hire the best data analysts, scientists, and engineers to leverage the power of AB testing. Testing different variants can help optimize the customer experience, maximize profits, inform the next best design, and much more.
Learn About A/B Testing in Python
You’ll start by learning how to define the right metrics before learning how to estimate the appropriate sample size and duration to yield conclusive results. Throughout this course, you’ll use a range of Python packages to help with A/B testing, including statsmodels, scipy, and pingouin.
By the end of the course, you will be able to run the necessary checks that guarantee accurate results, master the art of p-values, and analyze the results of A/B tests with ease and confidence to guide the most critical business decisions.
Für Unternehmen
Trainierst du 2 oder mehr?
Erhalten Sie für Ihr Team Zugriff auf die vollständige DataCamp-Bibliothek mit zentralisierten Berichten, Zuweisungen, Projekten und mehrIn den folgenden Tracks
Angewandte Statistik in Python
Gehe zu Track- 1
Overview of A/B Testing
KostenlosIn this chapter, you’ll learn the foundations of A/B testing. You’ll explore clear steps and use cases, learn the reasons and value of designing and running A/B tests, and discover the most commonly used metrics design and estimation frameworks.
- 2
Experiment Design and Planning
In Chapter 2, you’ll cover the experiment design process. Starting with learning how to formulate strong A/B testing hypotheses, you’ll also cover statistical concepts such as power, error rates, and minimum detectable effects. You’ll finish the chapter by learning to estimate the appropriate sample size needed to yield conclusive results and tackle scenarios with multiple comparisons.
Hypothesis formulation and distributions50 xpStrong hypothesis formulation50 xpPlotting distributions100 xpCentral limit theorem for means100 xpExperimental design: setting up testing parameters50 xpInterpreting p-values100 xpError rates in the wild50 xpExperimental design: power analysis50 xpPlotting power curves100 xpSample size for means100 xpSample size for proportions100 xpMultiple comparisons tests50 xpIs a multiple comparisons correction needed?100 xpCorrected p-values100 xp - 3
Data Processing, Sanity Checks, and Results Analysis
Here, you’ll discover a concrete workflow for cleaning, preprocessing, and exploring AB testing data, as well as learn the necessary sanity checks we need to follow to ensure valid results. You’ll explore a detailed explanation and example of analyzing difference in proportions A/B tests.
Data cleaning and exploratory analysis50 xpProportions EDA100 xpA/B test data cleaning100 xpSanity checks: Internal validity50 xpSRM100 xpDistributions balance100 xpSanity checks: external validity50 xpNovelty effects detection100 xpSimpson's paradox in action100 xpAnalyzing difference in proportions A/B tests50 xpDifference in proportions A/B test100 xpInterpretation of confidence intervals50 xpConfidence intervals for proportions100 xp - 4
Practical Considerations and Making Decisions
In the final chapter, you’ll develop frameworks for analyzing differences in means and leveraging non-parametric tests when several assumptions aren't met. You’ll also learn how to apply the Delta method when analyzing ratio metrics and discover the best practices and some advanced topics to continue the A/B testing mastery journey.
Analyzing difference in means A/B tests50 xpT-test for difference in means100 xpPairwise t-tests100 xpNon-parametric statistical tests50 xpParametric or non-parametric?100 xpMann-Whitney U test100 xpChi-square test for independence100 xpRatio metrics and the delta method50 xpDelta or not?100 xpDelta method100 xpA/B Testing best practices and advanced topics intro50 xpBest practices50 xpDay-of-the-week effect100 xpWrap-up: A/B testing in python50 xp
Für Unternehmen
Trainierst du 2 oder mehr?
Erhalten Sie für Ihr Team Zugriff auf die vollständige DataCamp-Bibliothek mit zentralisierten Berichten, Zuweisungen, Projekten und mehrIn den folgenden Tracks
Angewandte Statistik in Python
Gehe zu TrackMoe Lotfy, PhD
Mehr AnzeigenPrincipal Data Science Manager
Was sagen andere Lernende?
Melden Sie sich an 14 Millionen Lernende und starten Sie A/B Testing in Python Heute!
Kostenloses Konto erstellen
oder
Durch Klick auf die Schaltfläche akzeptierst du unsere Nutzungsbedingungen, unsere Datenschutzrichtlinie und die Speicherung deiner Daten in den USA.