Basic Probability
Introduction
1. Explain probability and the numerical range.
- Probability is a measure of the likelihood of an event to occur.
- Probabilities are expressed as numerical values between 0 and 1, where 0 indicates impossibility (an event will not occur), 1 indicates certainty (an event will occur), and values between 0 and 1 represent degrees of likelihood.
2. Explain the term outcome.
3. Explain the term event.
4. Explain the term sample space.
5. Explain the term trial.
6. What is the sample space of a six-sided die?
7. Provide the formula to calculate the probability of an event
The probability of an event A, denoted as $P(A)$, is the likelihood that event A will occur.
$P(A) = \frac{\text{Number of outcomes for event A}}{\text{Total numer of possible outcomes}}$
8. Explain experimental and theoretical probability.
- Experimental: Probability of something happened based off the results of an actual experiment
- Theoretical: The expected probability of something happening.
9. When will experimental and theoretical probability converge?
Types of Events
1. Explain dependent event and provide example(s).
- Definition: An event is affected by other events. The probability of the second event is conditional on the outcome of the first.
- Example: The probability of drawing a king on the second draw from a standard deck of 52 cards without replacements. The probability of drawing a king on the second draw depends on the outcome of the first card.
2. Explain independent event and provide example(s).
- Definition: Each event does not affect each other. The outcome of the first event has no impact on the probability of the second event.
- Example: Tossing a fair coin twice is an example of independent events. Whether the first coin toss results in heads or tails does not influence the outcome of the second toss.
3. Explain mutually exclusive event and provide example(s).
- Definition: Events that cannot occur simultaneously.
- Example: Not possible to flip heads and tails simultaneously.
4. Explain complement of an event.
- The complement of event A $(A’)$ , is the set of outcomes that are not in A.
- The probability of $A’$ is $1-P(A)$
5. Explain intersection of events.
6. Explain union of events.
7. Explain Gambler’s Fallacy (Monte Carlo Fallacy).
8. Explain the concept of regression to the mean and how is it different than Gambler’s Fallacy.
Probability Formulas
1. Explain marginal probability.
2. Explain conditional probability and provide the formula.
Definition: Conditional probability is the probability of an event occurring given that another event has already occurred.
Formula:
$$ P(A|B) = \frac{P(A\cap B)}{P(B)} $$
Where
- $P(A|B)$: Conditional probability of event A given event B.
- $P(A\cap B)$: Intersection Probability.
- $P(B)$: Probability of event B occurring.
3. What is the probability of event A occurring given that event A and B are independent? Explain your answer.
$P(A|B) = P(A)$
The conditional probability of A given B is the marginal probability of A because event B does not influence the probability of event A.
4. How to calculate independent probabilities of A and B occurring?
$P(A \cap B) = P(A)\times P(B)$
Multiply the individual probabilities to find the probability of both events occurring simultaneously.
5. How to calculate dependent probabilities of A and B occurring?
$P(A \cap B) = P(A) \times P(B|A)$
Multiply the probability of the first event by the conditional probability of the second event given the first event.
6. What is the probability of a mutually exclusive event occurring at the same time?
$P(A \cap B) = 0$
The probability is 0 because A and B are mutually exclusive and thus, cannot occur at the same time.
7. How to calculate the probability of A or B occurring when they are independent from each other?
$P(A \cup B) = P(A) + P(B) - P(A\cap B)$
Add the probabilities together and less away the intersection to prevent double counting the probability of both A and B occurring.
8. How to calculate the probability of A or B occurring when they are dependent?
$P(A \cup B) = P(A) + P(B) - P(A\cap B)$
Add the probabilities together and less away the intersection to prevent double counting the probability of both A and B occurring.
9. How to calculate the probability of A or B occurring if they are mutually exclusive?
$P(A \cup B) = P(A) + P(B)$
Simply add the probabilities together. Mutually exclusive events do not have probability of them occurring simultaneously.
10. When to apply addition or multiplication rule to calculate the probabilities?
- Use the addition rule when you want to find the probability of the union (either one or the other or both) of two mutually exclusive events A and B.
- Use the multiplication rule when you want to find the probability of the intersection (both events occurring simultaneously) of two independent events A and B.