HomeCheat sheetsData Science

# Introduction to Probability Rules Cheat Sheet

Learn the basics of probability with our Introduction to Probability Rules Cheat Sheet. Quickly reference key concepts and formulas for finding probability, conditional probability, and more.
Jan 2023  · 1 min read

Welcome to our Introduction to Probability Rules Cheat Sheet. This guide is designed to provide a quick reference for the fundamental concepts and formulas in probability. Whether you're a student studying probability for the first time or a professional looking to refresh your knowledge, this cheat sheet will be a valuable resource. It covers key topics such as finding probability, conditional probability, Bayes' theorem and more. Keep it handy as you work through problems or study for exams. Have this cheat sheet at your fingertips

## Definitions

The following pieces of jargon frequently occur when discussing probability.

• Event: A thing that you can observe whether it happens or not.
• Probability: The chance that an event happens, on a scale from 0 (cannot happen) to 1 (always happens). Denoted P(event).
• Probability universe: The probability space where all the events you are considering can either happen or not happen.
• Mutually exclusive events: If one event happens, then the other event cannot happen (e.g., you cannot roll a dice that is both 5 and 1).
• Independent events: If one event happens, it does not affect the probability that the other event happens (e.g., the weather does not affect the outcome of a dice roll).
• Dependent events: If one event happens, it changes the probability that the other event happens (e.g., the weather affects traffic outcomes).
• Conjunctive probability (a.k.a. joint probability): The probability that all events happen.
• Disjunctive probability: The probability that at least one event happens.
• Conditional probability: The probability that one event happens, given another event happened.

## • Definition: The complement of A is the probability that event A does not happen. It is denoted A' or Ac.
• Formula: P(A') = 1 - P(A)
• Example: The probability of basketball player Stephen Curry successfully shooting a three-pointer is 0.43. The complement, the probability that he misses, is 1 - 0.43 = 0.57.

## Odds: Probability of the event happening versus not happening

• Definition: The odds of event A happening is the probability that the event happens divided by the probability that the event doesn't happen.
• Formula: Odds(A) = P(A) / P(A') =  P(A) / 1 - P(A)
• Example: The odds of basketball player Stephen Curry successfully shooting a three-pointer is the probability that he scores divided by the probability that he misses, 0.43 / 0.57 = 0.75.

## Multiplication Rules: Probability of both events happening

### • Definition: The probability of two mutually exclusive events happening is zero.
• Formula: P(A ∩ B) = 0
• Example: If the probability of it being sunny at midday is 0.3 and the probability of it raining at midday is 0.4, the probability of it being sunny and rainy is 0, since these events are mutually exclusive.

### • Definition: The probability of two independent events happening is the product of the probabilities of each event.
• Formula:  P(A ∩ B) = P(A) * P(B)
• Example: If the probability of it being sunny at midday is 0.3 and the probability of your favorite soccer team winning their game today is 0.6, the then probability of it being sunny at midday and your favorite soccer team winning their game today is 0.3 * 0.6 = 0.18.

### The conjunctive fallacy

• Definition: The probability of both events happening is always less than or equal to the probability of one event happening. That is P(A ∩ B) <= P(A), and P(A ∩ B) <= P(B). The conjunctive fallacy is when you don't think carefully about probabilities and estimate that probability of both events happening is greater than the probability of one of the events.
• Example: A famous example known as 'The Linda problem" comes from a 1980s research experiment. A fictional person was described:

Linda is 31 years old, single, outspoken, and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice and also participated in anti-nuclear demonstrations.

Participants had to choose which statement had a higher probability of being true:

1. Linda is a bank teller.
2. Linda is a bank teller and is active in the feminist movement.

Many participants chose fell for the conjunctive fallacy and chose option 2, even though it must be less likely than option 1 using the multiplication rule.

## Addition Rules: Probability of at least one event happening

### • Definition: The probability of at least one mutually exclusive event happening is the sum of the probabilities of each event happening.
• Formula: P(A ∪ B) = P(A) + P(B)
• Example: If the probability of it being sunny at midday is 0.3 and the probability of it raining at midday is 0.4, the probability of it being sunny or rainy is 0.3 + 0.4 = 0.7, since these events are mutually exclusive.

### • Definition: The probability of at least one mutually exclusive event happening is the sum of the probabilities of each event happening minus the probability of both events happening.
• Formula: P(A ∪ B) = P(A) + P(B) - P(A ∩ B)
• Example: If the probability of it being sunny at midday is 0.3 and the probability of your favorite soccer team winning their game today is 0.6, the then probability of it being sunny at midday or your favorite soccer team winning their game today is 0.3 + 0.6 - (0.3 * 0.6) = 0.72.

### The disjunctive fallacy

• Definition: The probability of at least one event happening is always greater than or equal to the probability of one event happening. That is P(A ∪ B) >= P(A), and P(A ∪ B) >= P(B). The disjunctive fallacy is when you don't think carefully about probabilities and estimate that the probability of at least one event happening is less than the probability of one of the events.
• Example: Returning to the "Linda problem," consider having to rank these two statements in order of probability:
1. Linda is a bank teller.
2. Linda is a bank teller and is active in the feminist movement.

The disjunctive fallacy would be to think that choice 1 had a higher probability of being true, even though that is impossible because of the additive rule of probabilities.

## • Definition: For dependent events, the probability of event B happening, given that event A happened, is equal to the probability that both events happen divided by the probability that event A happens. Equivalently, it is equal to the probability that event A happens given that event B happened times the probability of event B happening divided by the probability that event A happens.
• Formula: P(B|A) = P(A ∩ B) / P(A) = P(A|B) * P(B) / P(A)
• Example: Suppose it's a cloudy morning, and you want to know the probability of rain today. If the probability of it raining that day given a cloudy morning is 0.6, and the probability of it raining on any day is 0.1. The probability of it being cloudy on any day is 0.3, then the probability of it raining, given a cloudy morning, is 0.6 * 0.1 / 0.3 = 0.2. That is, if you have a cloudy morning, it is twice as likely to rain than if you didn't have a cloudy morning, due to the dependence of the events.
Related  ### Free Access Week | Aug 28 – Sept 3

Access DataCamp's entire platform for free, including all 440+ courses, for an entire week. No catch, no credit card required—just unlimited learning for anyone with internet access.

Will Rix

5 min

### How to Choose The Right Data Science Bootcamp in 2023 (With Examples)

Learn everything about data science bootcamps, including a list of top programs to kickstart your career.  ### DataCamp Portfolio Challenge: Win \$500 Publishing Your Best Work

Win up to \$500 by building a free data portfolio with DataCamp Portfolio. DataCamp Team

5 min  ### Building Diverse Data Teams with Tracy Daniels, Head of Insights and Analytics at Truist

Tracy and Richie discuss the best way to approach DE & I in data teams and the positive outcomes of implementing DEI correctly.  ### Making Better Decisions using Data & AI with Cassie Kozyrkov, Google's First Chief Decision Scientist

Richie speaks to Google's first Chief Decision Scientist and CEO of Data Scientific, Cassie Kozyrkov, covering decision science, data and AI.

### Chroma DB Tutorial: A Step-By-Step Guide

With Chroma DB, you can easily manage text documents, convert text to embeddings, and do similarity searches.
See MoreSee More