Probability

Total Probability and Bayes’ Theorem

Understand

Events \(E_1,E_2,\dots,E_n\) form a partition of \(S\) if they are pairwise disjoint, have positive probabilities and their union is \(S\). For any event \(A\):

\[P(A)=\sum_{i=1}^nP(E_i)P(A\mid E_i)\qquad\text{(total probability)}\]\[P(E_i\mid A)=\frac{P(E_i)P(A\mid E_i)}{\sum_jP(E_j)P(A\mid E_j)}\qquad\text{(Bayes’ theorem)}\]

The \(P(E_i)\) are prior probabilities; \(P(E_i\mid A)\) are posterior probabilities, updated after observing \(A\).

Tip: draw a tree. Multiply along each branch, add the branches that end in \(A\) to get \(P(A)\), then divide the branch you want by that total.

Key Concepts

  • Identify the partition (causes) and the observed event.
  • Total probability = sum of branch products.
  • Bayes = wanted branch ÷ total.

Formula Bank

Bayes’ theorem

\[P(E_i\mid A)=\frac{P(E_i)P(A\mid E_i)}{\sum_jP(E_j)P(A\mid E_j)}\]

Solved Examples

Two workshops

Workshop X makes 60% of a firm’s chairs and workshop Y the rest. 3% of X’s chairs and 5% of Y’s chairs are faulty. A chair chosen at random is faulty. Find the probability that it came from Y.

Practice & Topic Test

Topic Practice

A fresh set of questions from this topic. Change answers freely – solutions appear after you submit.

Start Practice

Topic Test

Timed: up to 10 questions in 15 minutes.

Start Test

Topic Summary

Bayes’ theorem reverses a conditional probability: from P(effect | cause) to P(cause | effect).

Ready to practise this topic?

Create a free account to take practice sessions and tests, see detailed explanations and track your progress.

Create Student Account