A sample space is the complete set of all possible outcomes of a random experiment, typically denoted by Ω (omega) or S. Every event in probability theory is defined as a subset of the sample space, and the probability function assigns values to events in a way consistent with the axioms of probability. Correctly identifying the sample space is the critical first step in any probabilistic analysis, as it determines which outcomes are possible and how they are structured.
| Experiment | Sample Space Ω | Size |Ω| | Type |
|---|---|---|---|
| Fair coin flip | {H, T} | 2 | Finite, discrete |
| Roll of a die | {1, 2, 3, 4, 5, 6} | 6 | Finite, discrete |
| Two coin flips | {HH, HT, TH, TT} | 4 | Finite, discrete |
| Card drawn from deck | All 52 cards | 52 | Finite, discrete |
| Exact height of a person | All real numbers in (0, ∞) | ∞ (uncountable) | Continuous |
| Arrival time in [0, 60] min | [0, 60] ⊆ ℝ | ∞ (uncountable) | Continuous |
Wikimedia Commons, CC BY-SA
Probability is a numerical measure of the likelihood that a specific event will occur, expressed as a value between 0 (impossible) and 1 (certain). It quantifies uncertainty by assigning weights to outcomes in a sample space, and forms the mathematical foundation for statistics, stochastic processes, and decision theory. Probability theory underpins fields as diverse as quantum mechanics, financial modeling, machine learning, and epidemiology.
Conditional probability is the probability of an event A occurring given that another event B has already occurred, denoted P(A|B) and read "probability of A given B." It updates the original probability by restricting the sample space to the outcomes where B has occurred. Conditional probability is the cornerstone of Bayesian reasoning, decision trees, diagnostic testing, and machine learning classifiers.
A random variable is a function that assigns a numerical value to each outcome in a sample space of a random experiment, providing a bridge between probability theory and real-valued analysis. Discrete random variables take countable values (like the number of heads in coin flips), while continuous random variables take values over an interval (like height or temperature). Random variables are characterized by their probability distributions, which describe the likelihood of each possible value, and are fundamental to statistics, signal processing, and stochastic modeling.
The term "sample space" was introduced by the Austrian-American mathematician Richard von Mises in the early 20th century as part of the frequentist interpretation of probability. "Sample" comes from Latin "exemplum" (example, instance); "space" from Latin "spatium" (extent, room).