Conditional Probability
Conditional probability is the probability of an event A occurring given that another event B has already occurred, denoted P(A|B) and read "probability of A given B." It updates the original probability by restricting the sample space to the outcomes where B has occurred. Conditional probability is the cornerstone of Bayesian reasoning, decision trees, diagnostic testing, and machine learning classifiers.
Key Formula
P(A|B) = P(A ∩ B) / P(B), where P(B) > 0
LaTeX: P(A|B) = \frac{P(A \cap B)}{P(B)}, \quad P(B) > 0
| Symbol | Meaning | Unit |
|---|---|---|
| P(A|B) | Probability of A given that B has occurred | dimensionless (0 to 1) |
| P(A ∩ B) | Probability that both A and B occur | dimensionless (0 to 1) |
| P(B) | Probability that B occurs (must be > 0) | dimensionless (0 to 1) |
Worked Example
Problem
In a class of 30 students, 18 passed Mathematics and 12 passed both Mathematics and Science. What is the probability that a randomly selected student passed Science, given they passed Mathematics?
Solution
Step 1: Identify events: A = passed Science, B = passed Mathematics. Step 2: P(B) = 18/30 = 0.6. Step 3: P(A ∩ B) = P(passed both) = 12/30 = 0.4. Step 4: Apply conditional probability: P(A|B) = P(A ∩ B)/P(B) = 0.4/0.6. Step 5: Simplify: P(A|B) = 2/3 ≈ 0.667.
Answer
P(Science | Mathematics) = 2/3 ≈ 66.7%
Conditional Probability: Key Rules and Relations
| Rule | Formula | When to Use | Example |
|---|---|---|---|
| Definition | P(A|B) = P(A∩B)/P(B) | Updating probability given new information | Disease given positive test |
| Multiplication rule | P(A∩B) = P(A|B)·P(B) | Finding joint probability | P(two aces drawn) |
| Independence | P(A|B) = P(A) | Events do not affect each other | Coin flips are independent |
| Total probability | P(A) = Σ P(A|Bᵢ)·P(Bᵢ) | Partitioning the sample space | P(defective) by machine |
| Bayes' theorem | P(B|A) = P(A|B)·P(B)/P(A) | Reversing conditional probability | Posterior probability |
Interactive Tools
Wikimedia Commons, CC BY-SA
Related Terms
Probability
Probability is a numerical measure of the likelihood that a specific event will occur, expressed as a value between 0 (impossible) and 1 (certain). It quantifies uncertainty by assigning weights to outcomes in a sample space, and forms the mathematical foundation for statistics, stochastic processes, and decision theory. Probability theory underpins fields as diverse as quantum mechanics, financial modeling, machine learning, and epidemiology.
Bayes' Theorem
Bayes' Theorem describes how to update the probability of a hypothesis given new evidence, relating the conditional probability P(A|B) to P(B|A) through prior probabilities. It is the mathematical foundation of Bayesian inference, where beliefs are updated as new data arrives. The theorem has transformative applications in medical diagnostics, spam filtering, machine learning, scientific hypothesis testing, and artificial intelligence.
Sample Space
A sample space is the complete set of all possible outcomes of a random experiment, typically denoted by Ω (omega) or S. Every event in probability theory is defined as a subset of the sample space, and the probability function assigns values to events in a way consistent with the axioms of probability. Correctly identifying the sample space is the critical first step in any probabilistic analysis, as it determines which outcomes are possible and how they are structured.
The term "conditional" comes from Latin "condicionalis" (depending on a condition). The mathematical formulation of conditional probability was developed in the 18th and 19th centuries, with significant contributions by Thomas Bayes (1763) and Pierre-Simon Laplace.