Skip to main content

Introduction to Probability Rules Cheat Sheet

Learn the basics of probability with our Introduction to Probability Rules Cheat Sheet. Quickly reference key concepts and formulas for finding probability, conditional probability, and more.
Jan 2023  · 1 min read

Welcome to our Introduction to Probability Rules Cheat Sheet. This guide is designed to provide a quick reference for the fundamental concepts and formulas in probability. Whether you're a student studying probability for the first time or a professional looking to refresh your knowledge, this cheat sheet will be a valuable resource. It covers key topics such as finding probability, conditional probability, Bayes' theorem and more. Keep it handy as you work through problems or study for exams.

Probability Cheat Sheet.png

Have this cheat sheet at your fingertips

Download PDF

Definitions    

The following pieces of jargon frequently occur when discussing probability.

  • Event: A thing that you can observe whether it happens or not.
  • Probability: The chance that an event happens, on a scale from 0 (cannot happen) to 1 (always happens). Denoted P(event).
  • Probability universe: The probability space where all the events you are considering can either happen or not happen.
  • Mutually exclusive events: If one event happens, then the other event cannot happen (e.g., you cannot roll a dice that is both 5 and 1).
  • Independent events: If one event happens, it does not affect the probability that the other event happens (e.g., the weather does not affect the outcome of a dice roll).
  • Dependent events: If one event happens, it changes the probability that the other event happens (e.g., the weather affects traffic outcomes).
  • Conjunctive probability (a.k.a. joint probability): The probability that all events happen.
  • Disjunctive probability: The probability that at least one event happens.
  • Conditional probability: The probability that one event happens, given another event happened.

Complement Rule: Probability of events not happening

  • Definition: The complement of A is the probability that event A does not happen. It is denoted A' or Ac.
  • Formula: P(A') = 1 - P(A)
  • Example: The probability of basketball player Stephen Curry successfully shooting a three-pointer is 0.43. The complement, the probability that he misses, is 1 - 0.43 = 0.57.

Odds: Probability of the event happening versus not happening

  • Definition: The odds of event A happening is the probability that the event happens divided by the probability that the event doesn't happen.
  • Formula: Odds(A) = P(A) / P(A') =  P(A) / 1 - P(A)
  • Example: The odds of basketball player Stephen Curry successfully shooting a three-pointer is the probability that he scores divided by the probability that he misses, 0.43 / 0.57 = 0.75.

Multiplication Rules: Probability of both events happening

Mutually exclusive events

  • Definition: The probability of two mutually exclusive events happening is zero.
  • Formula: P(A ∩ B) = 0
  • Example: If the probability of it being sunny at midday is 0.3 and the probability of it raining at midday is 0.4, the probability of it being sunny and rainy is 0, since these events are mutually exclusive.

Independent events

  • Definition: The probability of two independent events happening is the product of the probabilities of each event.
  • Formula:  P(A ∩ B) = P(A) * P(B)
  • Example: If the probability of it being sunny at midday is 0.3 and the probability of your favorite soccer team winning their game today is 0.6, the then probability of it being sunny at midday and your favorite soccer team winning their game today is 0.3 * 0.6 = 0.18.

The conjunctive fallacy

  • Definition: The probability of both events happening is always less than or equal to the probability of one event happening. That is P(A ∩ B) <= P(A), and P(A ∩ B) <= P(B). The conjunctive fallacy is when you don't think carefully about probabilities and estimate that probability of both events happening is greater than the probability of one of the events. 
  • Example: A famous example known as 'The Linda problem" comes from a 1980s research experiment. A fictional person was described:

Linda is 31 years old, single, outspoken, and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice and also participated in anti-nuclear demonstrations.

Participants had to choose which statement had a higher probability of being true:

  1. Linda is a bank teller.
  2. Linda is a bank teller and is active in the feminist movement.

Many participants chose fell for the conjunctive fallacy and chose option 2, even though it must be less likely than option 1 using the multiplication rule.

Addition Rules: Probability of at least one event happening

Mutually exclusive events

  • Definition: The probability of at least one mutually exclusive event happening is the sum of the probabilities of each event happening.
  • Formula: P(A ∪ B) = P(A) + P(B)
  • Example: If the probability of it being sunny at midday is 0.3 and the probability of it raining at midday is 0.4, the probability of it being sunny or rainy is 0.3 + 0.4 = 0.7, since these events are mutually exclusive.

Independent events

  • Definition: The probability of at least one mutually exclusive event happening is the sum of the probabilities of each event happening minus the probability of both events happening.
  • Formula: P(A ∪ B) = P(A) + P(B) - P(A ∩ B)
  • Example: If the probability of it being sunny at midday is 0.3 and the probability of your favorite soccer team winning their game today is 0.6, the then probability of it being sunny at midday or your favorite soccer team winning their game today is 0.3 + 0.6 - (0.3 * 0.6) = 0.72.

The disjunctive fallacy

  • Definition: The probability of at least one event happening is always greater than or equal to the probability of one event happening. That is P(A ∪ B) >= P(A), and P(A ∪ B) >= P(B). The disjunctive fallacy is when you don't think carefully about probabilities and estimate that the probability of at least one event happening is less than the probability of one of the events.
  • Example: Returning to the "Linda problem," consider having to rank these two statements in order of probability:
  1. Linda is a bank teller.
  2. Linda is a bank teller and is active in the feminist movement.

The disjunctive fallacy would be to think that choice 1 had a higher probability of being true, even though that is impossible because of the additive rule of probabilities. 

Bayes Rule: Probability of an event happening given another event happened

  • Definition: For dependent events, the probability of event B happening, given that event A happened, is equal to the probability that both events happen divided by the probability that event A happens. Equivalently, it is equal to the probability that event A happens given that event B happened times the probability of event B happening divided by the probability that event A happens.
  • Formula: P(B|A) = P(A ∩ B) / P(A) = P(A|B) * P(B) / P(A)
  • Example: Suppose it's a cloudy morning, and you want to know the probability of rain today. If the probability of it raining that day given a cloudy morning is 0.6, and the probability of it raining on any day is 0.1. The probability of it being cloudy on any day is 0.3, then the probability of it raining, given a cloudy morning, is 0.6 * 0.1 / 0.3 = 0.2. That is, if you have a cloudy morning, it is twice as likely to rain than if you didn't have a cloudy morning, due to the dependence of the events.
Related

Inside Our Favorite DataFramed Episodes of 2022

An inside look at our favorite episodes of the DataFramed podcast of 2022
Adel Nehme's photo

Adel Nehme

2 min

[Infographic] Data Science Project Checklist

Use this checklist when planning your next data science project.
Adel Nehme's photo

Adel Nehme

Why We Need More Data Empathy

We talk with Phil Harvey about the concept of data empath, real-world examples of data empathy, the importance of practice when learning something new, the role of data empathy in AI development, and much more.

Adel Nehme's photo

Adel Nehme

44 min

Data Governance Fundamentals Cheat Sheet

Master the fundamentals of data governance with our Data Governance Fundamentals Cheat Sheet. Quickly reference key concepts, best practices, and key components of a data governance program.
Richie Cotton's photo

Richie Cotton

1 min

ChatGPT Cheat Sheet for Data Science

In this cheat sheet, gain access to 60+ ChatGPT prompts for data science tasks.
Travis Tang's photo

Travis Tang

10 min

Docker for Data Science: An Introduction

In this Docker tutorial, discover the setup, common Docker commands, dockerizing machine learning applications, and industry-wide best practices.
Arunn Thevapalan's photo

Arunn Thevapalan

15 min

See MoreSee More