Distribution of the sample mean (CLT)
Master the distribution of the sample mean and the Central Limit Theorem in Year 12 Specialist Mathematics for Queensland (QCAA). The sample mean \(\bar X\) is a random variable with mean \(\mu\) and standard deviation \(\dfrac{\sigma}{\sqrt n}\), and for a large sample it is approximately normal whatever the parent distribution.
You will learn to find the standard deviation of \(\bar X\), state the model \(\bar X\sim N\!\left(\mu,\dfrac{\sigma^2}{n}\right)\) when \(n\ge 30\), standardise with \(z=\dfrac{\bar x-\mu}{s/\sqrt n}\) and find probabilities for the sample mean — the foundation of statistical inference in Unit 4.
Theory
The Central Limit Theorem (CLT) says that for a large sample (\(n\ge 30\)) the sample mean \(\bar X\) is approximately normal, \(\bar X\sim N\!\left(\mu,\dfrac{\sigma^2}{n}\right)\), whatever the shape of the parent distribution. In Year 12 Specialist Mathematics (QCAA, Queensland) you find the sample-mean standard deviation \(\dfrac{\sigma}{\sqrt n}\), standardise with \(z=\dfrac{\bar x-\mu}{s/\sqrt n}\), and use the normal distribution to find probabilities for \(\bar X\).
Take a random sample of size \(n\) from a population and compute its mean. A different sample gives a different mean, so the sample mean \(\bar X\) is itself a random variable, with its own distribution called the sampling distribution of the sample mean.
If the parent random variable \(X\) has mean \(\mu\) and standard deviation \(\sigma\), then \(\bar X\) has the same mean \(\mu\), but a smaller standard deviation \(\dfrac{\sigma}{\sqrt n}\) (often called the standard error). Larger samples make \(\bar X\) cluster more tightly around \(\mu\).
The Central Limit Theorem is the key result: for a large sample \(n\ge 30\), the sampling distribution of \(\bar X\) is approximately normal, \(\bar X\sim N\!\left(\mu,\dfrac{\sigma^2}{n}\right)\), regardless of the shape of the parent distribution — even a strongly skewed parent gives a bell-shaped sampling distribution.
To find a probability you standardise: \(z=\dfrac{\bar x-\mu}{\sigma/\sqrt n}\) is approximately \(N(0,1)\). When \(\sigma\) is unknown, the sample standard deviation \(s\) is used in its place, and \(\dfrac{\bar X-\mu}{s/\sqrt n}\) is approximately standard normal for large \(n\).
For a sample of size \(n\) from a population with mean \(\mu\) and standard deviation \(\sigma\), the sample mean has:
The Central Limit Theorem: for large \(n\) (\(n\ge 30\)), whatever the parent distribution,
To find a probability, standardise the sample mean (using \(s\) for \(\sigma\) when \(\sigma\) is unknown):
How to solve a sample-mean problem
- Check the condition. Confirm the sample is large, \(n\ge 30\) (or that the parent is already normal). Only then does the CLT make \(\bar X\) approximately normal.
- State the distribution. Write \(\bar X\sim N\!\left(\mu,\dfrac{\sigma^2}{n}\right)\); the standard deviation of \(\bar X\) is \(\dfrac{\sigma}{\sqrt n}\) (use \(s\) if \(\sigma\) is unknown).
- Standardise. Convert the value \(\bar x\) to \(z=\dfrac{\bar x-\mu}{\sigma/\sqrt n}\).
- Find the probability. Read the required area under the standard normal curve, subtracting for a "between" interval and using \(1-\Phi(z)\) for an upper tail.
The sample-mean standard deviation is \(\sigma\) divided by \(\sqrt n\):
| \(\text{sd}(\bar X)\) | \(=\) | \(\dfrac{\sigma}{\sqrt n}\) |
| \(=\) | \(\dfrac{20}{\sqrt{100}}\) | |
| \(=\) | \(\dfrac{20}{10}\) | |
| \(=\) | \(2\) |
The standard deviation of \(\bar X\) is \(2\) g.
Since \(n=81\ge 30\), the CLT applies; find the variance \(\dfrac{\sigma^2}{n}\):
| \(\text{Var}(\bar X)\) | \(=\) | \(\dfrac{\sigma^2}{n}\) |
| \(=\) | \(\dfrac{18^2}{81}\) | |
| \(=\) | \(\dfrac{324}{81}\) | |
| \(=\) | \(4\) |
Write the normal model with mean \(\mu\) and this variance:
| \(\bar X\) | \(\sim\) | \(N(250,\,4)\) |
\(\bar X\sim N(250,4)\); the standard deviation of \(\bar X\) is \(2\).
The parent is skewed, but \(n=36\ge 30\), so the CLT applies. Find the sample-mean sd:
| \(\dfrac{\sigma}{\sqrt n}\) | \(=\) | \(\dfrac{6}{\sqrt{36}}\) |
| \(=\) | \(\dfrac{6}{6}\) | |
| \(=\) | \(1\) |
Standardise the value \(21.5\):
| \(z\) | \(=\) | \(\dfrac{21.5-20}{1}\) |
| \(=\) | \(1.5\) |
Read the upper tail of the standard normal:
| \(P(\bar X>21.5)\) | \(=\) | \(P(Z>1.5)\) |
| \(=\) | \(1-0.9332\) | |
| \(=\) | \(0.0668\) |
\(P(\bar X>21.5)\approx 0.0668\).
Find the sample-mean sd using \(s\) in place of \(\sigma\):
| \(\dfrac{s}{\sqrt n}\) | \(=\) | \(\dfrac{40}{\sqrt{64}}\) |
| \(=\) | \(\dfrac{40}{8}\) | |
| \(=\) | \(5\) |
Standardise both endpoints:
| \(z_1\) | \(=\) | \(\dfrac{490-500}{5}=-2\) |
| \(z_2\) | \(=\) | \(\dfrac{505-500}{5}=1\) |
Subtract the standard-normal areas:
| \(P(490<\bar X<505)\) | \(=\) | \(\Phi(1)-\Phi(-2)\) |
| \(=\) | \(0.8413-0.0228\) | |
| \(=\) | \(0.8185\) |
\(P(490<\bar X<505)\approx 0.8185\).
Common pitfalls
Frequently asked questions
What does the Central Limit Theorem say?
For a large sample (\(n\ge 30\)), the sample mean \(\bar X\) is approximately normal, \(\bar X\sim N\!\left(\mu,\dfrac{\sigma^2}{n}\right)\), no matter what shape the parent distribution has.
What is the standard deviation of the sample mean?
It is \(\dfrac{\sigma}{\sqrt n}\), the population standard deviation divided by the square root of the sample size. It is smaller than \(\sigma\), and it shrinks as \(n\) grows.
How large does the sample need to be?
As a rule, \(n\ge 30\) is large enough for the CLT to make \(\bar X\) approximately normal for most parent distributions. If the parent is already normal, \(\bar X\) is exactly normal for any \(n\).
Do I use \(\sigma\) or the sample standard deviation \(s\)?
Use \(\sigma\) if it is known. If it is not, use the sample standard deviation \(s\) in its place: for large \(n\), \(\dfrac{\bar X-\mu}{s/\sqrt n}\) is approximately standard normal.
How do I find a probability for \(\bar X\)?
Standardise: \(z=\dfrac{\bar x-\mu}{\sigma/\sqrt n}\), then read the required area under the standard normal curve, just as for any normal probability.
Does the parent distribution have to be normal?
No. The CLT works for any parent shape — skewed, exponential or discrete — provided the sample is large. That is exactly why the theorem is so useful.