Basic Probability

Introduction

1. Explain probability and the numerical range.
  • Probability is a measure of the likelihood of an event to occur.
  • Probabilities are expressed as numerical values between 0 and 1, where 0 indicates impossibility (an event will not occur), 1 indicates certainty (an event will occur), and values between 0 and 1 represent degrees of likelihood.
2. Explain the term outcome.
A possible result that could occur during an experiment.
3. Explain the term event.
An event is an outcome or a set of outcomes of an experiment or a random process.
4. Explain the term sample space.
The sample space is the set of all possible outcomes of an experiment.
5. Explain the term trial.
A trial refers to a single occurrence or experiment in which an outcome is observed.
6. What is the sample space of a six-sided die?
The sample space is ${1, 2, 3, 4, 5, 6}$.
7. Provide the formula to calculate the probability of an event

The probability of an event A, denoted as $P(A)$, is the likelihood that event A will occur.

$P(A) = \frac{\text{Number of outcomes for event A}}{\text{Total numer of possible outcomes}}$

8. Explain experimental and theoretical probability.
  1. Experimental: Probability of something happened based off the results of an actual experiment
  2. Theoretical: The expected probability of something happening.
9. When will experimental and theoretical probability converge?
As the number of trials increases, the experimental probability will get closer to the theoretical probability value.

Types of Events

1. Explain dependent event and provide example(s).
  • Definition: An event is affected by other events. The probability of the second event is conditional on the outcome of the first.
  • Example: The probability of drawing a king on the second draw from a standard deck of 52 cards without replacements. The probability of drawing a king on the second draw depends on the outcome of the first card.
2. Explain independent event and provide example(s).
  • Definition: Each event does not affect each other. The outcome of the first event has no impact on the probability of the second event.
  • Example: Tossing a fair coin twice is an example of independent events. Whether the first coin toss results in heads or tails does not influence the outcome of the second toss.
3. Explain mutually exclusive event and provide example(s).
  • Definition: Events that cannot occur simultaneously.
  • Example: Not possible to flip heads and tails simultaneously.
4. Explain complement of an event.
  • The complement of event A $(A’)$ , is the set of outcomes that are not in A.
  • The probability of $A’$ is $1-P(A)$
5. Explain intersection of events.
The intersection of events A and B $(A \cap B)$ is the set out outcomes that are in both A and B.
6. Explain union of events.
The union of events A and B $(A \cup B)$ is the set out outcomes that are in either A or B or both.
7. Explain Gambler’s Fallacy (Monte Carlo Fallacy).
The gambler’s fallacy is the mistaken belief that if a particular event occurs more frequently than normal recently, it is less likely to happen in the future (or vice versa), given that the probability of such events does not depend on what has happened in the past.
8. Explain the concept of regression to the mean and how is it different than Gambler’s Fallacy.
Regression to the mean implies that following an extreme random event, the next random event is likely to be less extreme. However, the extreme event may be still above the mean. In contrast, gamblers fallacy implies that the next random event should be below the mean (expected value) to even out the extreme random event that was above the mean, which is a wrong belief.

Probability Formulas

1. Explain marginal probability.
Marginal probability (aka simple probability) refers to the probability of a single event occurring, without considering the influence of other events or variables.
2. Explain conditional probability and provide the formula.

Definition: Conditional probability is the probability of an event occurring given that another event has already occurred.

Formula:

$$ P(A|B) = \frac{P(A\cap B)}{P(B)} $$

Where

  • $P(A|B)$: Conditional probability of event A given event B.
  • $P(A\cap B)$: Intersection Probability.
  • $P(B)$: Probability of event B occurring.
3. What is the probability of event A occurring given that event A and B are independent? Explain your answer.

$P(A|B) = P(A)$

The conditional probability of A given B is the marginal probability of A because event B does not influence the probability of event A.

4. How to calculate independent probabilities of A and B occurring?

$P(A \cap B) = P(A)\times P(B)$

Multiply the individual probabilities to find the probability of both events occurring simultaneously.

5. How to calculate dependent probabilities of A and B occurring?

$P(A \cap B) = P(A) \times P(B|A)$

Multiply the probability of the first event by the conditional probability of the second event given the first event.

6. What is the probability of a mutually exclusive event occurring at the same time?

$P(A \cap B) = 0$

The probability is 0 because A and B are mutually exclusive and thus, cannot occur at the same time.

7. How to calculate the probability of A or B occurring when they are independent from each other?

$P(A \cup B) = P(A) + P(B) - P(A\cap B)$

Add the probabilities together and less away the intersection to prevent double counting the probability of both A and B occurring.

8. How to calculate the probability of A or B occurring when they are dependent?

$P(A \cup B) = P(A) + P(B) - P(A\cap B)$

Add the probabilities together and less away the intersection to prevent double counting the probability of both A and B occurring.

9. How to calculate the probability of A or B occurring if they are mutually exclusive?

$P(A \cup B) = P(A) + P(B)$

Simply add the probabilities together. Mutually exclusive events do not have probability of them occurring simultaneously.

10. When to apply addition or multiplication rule to calculate the probabilities?
  1. Use the addition rule when you want to find the probability of the union (either one or the other or both) of two mutually exclusive events A and B.
  2. Use the multiplication rule when you want to find the probability of the intersection (both events occurring simultaneously) of two independent events A and B.
Last updated on 19 Nov 2023