Probability: A Comprehensive Guide for
High School and College
Introduction to Probability
Probability is a branch of mathematics that deals with the likelihood of an event occurring. It's
a fundamental concept with applications in various fields, including statistics, finance,
science, and everyday life. This guide will cover the essential concepts of probability, starting
from basic principles and progressing to more advanced topics.
Basic Concepts
1. Experiment, Sample Space, and Event
● Experiment: An activity or process that leads to well-defined outcomes.
○ Example: Tossing a coin, rolling a die, or drawing a card from a deck.
■ Detailed Explanation: An experiment is any process where the outcome is
uncertain. It could be something as simple as flipping a coin or as complex
as conducting a scientific study. The key is that there are several possible
outcomes, and we're interested in the likelihood of each.
● Sample Space (S): The set of all possible outcomes of an experiment.
○ Example:
■ Tossing a coin: S = {Head, Tail}
■ Rolling a die: S = {1, 2, 3, 4, 5, 6}
■ Detailed Explanation: The sample space is like a complete menu of all the
possibilities. For a coin, it's either heads or tails. For a die, it's the numbers 1
through 6. It's crucial to define the sample space accurately because it
forms the basis for calculating probabilities.
● Event (E): A subset of the sample space, representing a specific outcome or a group of
outcomes.
○ Example:
■ Rolling an even number on a die: E = {2, 4, 6}
■ Drawing a king from a deck of cards: E = {King of Hearts, King of Diamonds,
King of Clubs, King of Spades}
■ Detailed Explanation: An event is what we're interested in. It's a specific
set of outcomes from the sample space. In the die example, we're
interested in the event where the outcome is an even number.
2. Definition of Probability
, The probability of an event E, denoted as P(E), is a number between 0 and 1 (inclusive) that
measures the likelihood of E occurring.
● Classical Probability: If all outcomes in the sample space are equally likely, then the
probability of an event E is defined as:
P(E) = (Number of favorable outcomes) / (Total number of possible outcomes) = n(E) /
n(S)
○ Detailed Explanation: This is the most straightforward way to think about
probability. If every outcome has the same chance of happening, we can
calculate the probability by dividing the number of ways our event can happen by
the total number of possibilities. For example, the probability of rolling a 4 on a
fair die is 1/6 because there's one way to roll a 4, and there are six possible
outcomes.
● Relative Frequency Probability: If an experiment is repeated many times, the
probability of an event E can be estimated by the relative frequency of E:
P(E) ≈ (Number of times E occurs) / (Total number of trials)
○ Detailed Explanation: This is useful when outcomes are not equally likely.
Imagine a weighted coin. We can't use classical probability. Instead, we flip the
coin many times and see how often it lands on heads. The proportion of times it
lands on heads gives us an estimate of the probability of getting heads.
● Axiomatic Probability: A more formal approach that defines probability based on a
set of axioms:
○ Axiom 1: For any event E, P(E) ≥ 0.
○ Axiom 2: P(S) = 1.
○ Axiom 3: If E1, E2, E3, ... are mutually exclusive events (i.e., they cannot occur at
the same time), then P(E1 ∪ E2 ∪ E3 ∪ ...) = P(E1) + P(E2) + P(E3) + ...
○ Detailed Explanation: This is a more theoretical foundation for probability. It
doesn't tell us how to calculate probability, but it sets the rules that any
probability measure must follow.
■ Axiom 1 says that probabilities can't be negative.
■ Axiom 2 says that the probability of the sample space (i.e., the probability
of something happening) is 1.
■ Axiom 3 deals with mutually exclusive events and says that the probability
of any of them happening is the sum of their individual probabilities.
3. Types of Events
● Simple Event: An event consisting of only one outcome.
○ Example: Rolling a 4 on a die.
■ Detailed Explanation: A simple event is the most basic kind of event. It's
just one single outcome from the sample space.
● Compound Event: An event consisting of more than one outcome.
○ Example: Rolling an even number on a die.
High School and College
Introduction to Probability
Probability is a branch of mathematics that deals with the likelihood of an event occurring. It's
a fundamental concept with applications in various fields, including statistics, finance,
science, and everyday life. This guide will cover the essential concepts of probability, starting
from basic principles and progressing to more advanced topics.
Basic Concepts
1. Experiment, Sample Space, and Event
● Experiment: An activity or process that leads to well-defined outcomes.
○ Example: Tossing a coin, rolling a die, or drawing a card from a deck.
■ Detailed Explanation: An experiment is any process where the outcome is
uncertain. It could be something as simple as flipping a coin or as complex
as conducting a scientific study. The key is that there are several possible
outcomes, and we're interested in the likelihood of each.
● Sample Space (S): The set of all possible outcomes of an experiment.
○ Example:
■ Tossing a coin: S = {Head, Tail}
■ Rolling a die: S = {1, 2, 3, 4, 5, 6}
■ Detailed Explanation: The sample space is like a complete menu of all the
possibilities. For a coin, it's either heads or tails. For a die, it's the numbers 1
through 6. It's crucial to define the sample space accurately because it
forms the basis for calculating probabilities.
● Event (E): A subset of the sample space, representing a specific outcome or a group of
outcomes.
○ Example:
■ Rolling an even number on a die: E = {2, 4, 6}
■ Drawing a king from a deck of cards: E = {King of Hearts, King of Diamonds,
King of Clubs, King of Spades}
■ Detailed Explanation: An event is what we're interested in. It's a specific
set of outcomes from the sample space. In the die example, we're
interested in the event where the outcome is an even number.
2. Definition of Probability
, The probability of an event E, denoted as P(E), is a number between 0 and 1 (inclusive) that
measures the likelihood of E occurring.
● Classical Probability: If all outcomes in the sample space are equally likely, then the
probability of an event E is defined as:
P(E) = (Number of favorable outcomes) / (Total number of possible outcomes) = n(E) /
n(S)
○ Detailed Explanation: This is the most straightforward way to think about
probability. If every outcome has the same chance of happening, we can
calculate the probability by dividing the number of ways our event can happen by
the total number of possibilities. For example, the probability of rolling a 4 on a
fair die is 1/6 because there's one way to roll a 4, and there are six possible
outcomes.
● Relative Frequency Probability: If an experiment is repeated many times, the
probability of an event E can be estimated by the relative frequency of E:
P(E) ≈ (Number of times E occurs) / (Total number of trials)
○ Detailed Explanation: This is useful when outcomes are not equally likely.
Imagine a weighted coin. We can't use classical probability. Instead, we flip the
coin many times and see how often it lands on heads. The proportion of times it
lands on heads gives us an estimate of the probability of getting heads.
● Axiomatic Probability: A more formal approach that defines probability based on a
set of axioms:
○ Axiom 1: For any event E, P(E) ≥ 0.
○ Axiom 2: P(S) = 1.
○ Axiom 3: If E1, E2, E3, ... are mutually exclusive events (i.e., they cannot occur at
the same time), then P(E1 ∪ E2 ∪ E3 ∪ ...) = P(E1) + P(E2) + P(E3) + ...
○ Detailed Explanation: This is a more theoretical foundation for probability. It
doesn't tell us how to calculate probability, but it sets the rules that any
probability measure must follow.
■ Axiom 1 says that probabilities can't be negative.
■ Axiom 2 says that the probability of the sample space (i.e., the probability
of something happening) is 1.
■ Axiom 3 deals with mutually exclusive events and says that the probability
of any of them happening is the sum of their individual probabilities.
3. Types of Events
● Simple Event: An event consisting of only one outcome.
○ Example: Rolling a 4 on a die.
■ Detailed Explanation: A simple event is the most basic kind of event. It's
just one single outcome from the sample space.
● Compound Event: An event consisting of more than one outcome.
○ Example: Rolling an even number on a die.
