Probability
Probability is a numerical measure of the likelihood that a specific event will occur, expressed as a value between 0 (impossible) and 1 (certain). It quantifies uncertainty by assigning weights to outcomes in a sample space, and forms the mathematical foundation for statistics, stochastic processes, and decision theory. Probability theory underpins fields as diverse as quantum mechanics, financial modeling, machine learning, and epidemiology.
Key Formula
P(A) = |A| / |Ω| (for equally likely outcomes)
LaTeX: P(A) = \frac{\text{Number of favorable outcomes}}{\text{Total number of equally likely outcomes}} = \frac{|A|}{|\Omega|}
| Symbol | Meaning | Unit |
|---|---|---|
| P(A) | Probability of event A | dimensionless (0 to 1) |
| |A| | Number of outcomes in event A | count |
| |Ω| | Total number of outcomes in sample space Ω | count |
Worked Example
Problem
A fair six-sided die is rolled. What is the probability of getting an even number?
Solution
Step 1: Identify the sample space: Ω = {1, 2, 3, 4, 5, 6}, so |Ω| = 6. Step 2: Identify favorable outcomes (even numbers): A = {2, 4, 6}, so |A| = 3. Step 3: Apply the classical probability formula: P(A) = |A|/|Ω| = 3/6. Step 4: Simplify: P(A) = 1/2 = 0.5.
Answer
P(even number) = 1/2 = 0.5 (or 50%)
Axiomatic Properties of Probability
| Property | Mathematical Statement | Interpretation | Example |
|---|---|---|---|
| Non-negativity | P(A) ≥ 0 for all A | Probability is never negative | P(rain) = 0.3 ≥ 0 |
| Normalization | P(Ω) = 1 | Something in the sample space must occur | Sum of all outcomes = 1 |
| Additivity | P(A∪B) = P(A)+P(B) if A∩B=∅ | Mutually exclusive events add | P(1 or 2 on die) = 1/3 |
| Complement rule | P(Aᶜ) = 1 − P(A) | Probability of not-A | P(not heads) = 1 − 0.5 = 0.5 |
| Inclusion-exclusion | P(A∪B) = P(A)+P(B)−P(A∩B) | Overcounting correction | P(A or B) for overlapping sets |
Interactive Tools
Wikimedia Commons, CC BY-SA
Related Terms
Sample Space
A sample space is the complete set of all possible outcomes of a random experiment, typically denoted by Ω (omega) or S. Every event in probability theory is defined as a subset of the sample space, and the probability function assigns values to events in a way consistent with the axioms of probability. Correctly identifying the sample space is the critical first step in any probabilistic analysis, as it determines which outcomes are possible and how they are structured.
Conditional Probability
Conditional probability is the probability of an event A occurring given that another event B has already occurred, denoted P(A|B) and read "probability of A given B." It updates the original probability by restricting the sample space to the outcomes where B has occurred. Conditional probability is the cornerstone of Bayesian reasoning, decision trees, diagnostic testing, and machine learning classifiers.
Bayes' Theorem
Bayes' Theorem describes how to update the probability of a hypothesis given new evidence, relating the conditional probability P(A|B) to P(B|A) through prior probabilities. It is the mathematical foundation of Bayesian inference, where beliefs are updated as new data arrives. The theorem has transformative applications in medical diagnostics, spam filtering, machine learning, scientific hypothesis testing, and artificial intelligence.
From Latin "probabilitas" (credibility, likelihood), derived from "probabilis" (provable, credible). The formal mathematical theory was developed by Blaise Pascal and Pierre de Fermat in the 17th century through correspondence about gambling problems, and later axiomatized by Andrey Kolmogorov in 1933.