The exact distribution of the sample proportion
In Year 12 Mathematical Methods (Queensland, QCAA), the sample proportion \(\hat p=\dfrac{X}{n}\) records the fraction of successes in a random sample of size \(n\), where \(X\sim B(n,p)\). Its exact distribution lists the values \(\hat p=\dfrac{k}{n}\) with the binomial probabilities \(P\!\left(\hat p=\dfrac{k}{n}\right)=P(X=k)=\dbinom{n}{k}p^{k}(1-p)^{n-k}\). The mean is \(E(\hat p)=p\) and the standard deviation (the standard error) is \(\sqrt{\dfrac{p(1-p)}{n}}\) — a distribution you can tabulate and graph exactly for small \(n\).
Take a random sample of size \(n\) from a large population in which a proportion \(p\) are successes. The number of successes \(X\) is a binomial random variable, \(X\sim B(n,p)\). The sample proportion \(\hat p=\dfrac{X}{n}\) is the fraction of the sample that are successes. Because \(X\) changes from one sample to the next, \(\hat p\) is itself a random variable.
Since \(X\) can equal \(0,1,2,\ldots,n\), the sample proportion takes the values \(\hat p=\dfrac{k}{n}\) — the proportions \(0,\dfrac{1}{n},\dfrac{2}{n},\ldots,1\), not the counts. Each has an exact probability read straight from the binomial: \(P\!\left(\hat p=\dfrac{k}{n}\right)=P(X=k)=\dbinom{n}{k}p^{k}(1-p)^{n-k}\). For small \(n\) this can be set out as a table or drawn as a column graph.
The mean of the sample proportion is \(E(\hat p)=p\) (it does not depend on \(n\)), and the standard deviation — called the standard error — is \(\text{SD}(\hat p)=\sqrt{\dfrac{p(1-p)}{n}}\). A larger sample gives a smaller standard error, so \(\hat p\) clusters more tightly around \(p\). The shape is symmetric when \(p=0.5\) and leans towards the small or large proportions otherwise.
For a sample of size \(n\) with \(X\sim B(n,p)\), the exact probability of each value of \(\hat p\):
The mean and standard deviation (standard error) of the sample proportion:
To reverse these for \(p\) or \(n\) from a given mean and standard deviation:
Working with the exact distribution of \(\hat p\)
- Identify \(n\) and \(p\). The sample size is \(n\) and the population proportion is \(p\); the number of successes is \(X\sim B(n,p)\).
- List the values. The sample proportion takes \(\hat p=\dfrac{k}{n}\) for \(k=0,1,\ldots,n\) — proportions, not counts.
- Exact probabilities. \(P\!\left(\hat p=\dfrac{k}{n}\right)=\dbinom{n}{k}p^{k}(1-p)^{n-k}\). Add several of these for an interval such as \(P(\hat p\le a)\).
- Mean and standard deviation. \(E(\hat p)=p\) and \(\text{SD}(\hat p)=\sqrt{\dfrac{p(1-p)}{n}}\) (take the square root; do not stop at \(\dfrac{p(1-p)}{n}\)).
- Shape and technology. Compare \(p\) with \(0.5\) for the shape; a calculator's binomial menu gives each \(P(X=k)\) and cumulative probabilities directly.
| \(\hat p=\tfrac{1}{2}\) | \(\Rightarrow\) | \(X=2\) |
| \(P(X=2)\) | \(=\) | \(\dbinom{4}{2}(0.5)^{4}\) |
| \(=\) | \(\dfrac{6}{16}=0.375\) |
| \(E(\hat p)\) | \(=\) | \(p=0.2\) |
| \(\text{SD}(\hat p)\) | \(=\) | \(\sqrt{\dfrac{0.2\times 0.8}{100}}\) |
| \(=\) | \(\sqrt{0.0016}=0.04\) |
The counts \(\dbinom{5}{k}\) are \(1,5,10,10,5,1\), and each height is \(\dfrac{1}{32}\dbinom{5}{k}\).
| \(P(\hat p\le 0.4)\) | \(=\) | \(P(X\le 2)\) |
| \(=\) | \(\dfrac{1+5+10}{32}=\dfrac{16}{32}\) | |
| \(=\) | \(0.5\) |
Square both sides of the standard-error formula, then solve for \(n\).
| \(\dfrac{0.5\times 0.5}{n}\) | \(=\) | \(0.05^{2}=0.0025\) |
| \(n\) | \(=\) | \(\dfrac{0.25}{0.0025}=100\) |
Common pitfalls
Frequently asked questions
What is the sample proportion \(\hat p\)?
For a sample of size \(n\) with \(X\sim B(n,p)\) successes, \(\hat p=\dfrac{X}{n}\). Since \(X\) varies between samples, \(\hat p\) is a random variable.
What values can \(\hat p\) take?
The proportions \(\dfrac{k}{n}\) for \(k=0,1,\ldots,n\). For \(n=5\): \(0,0.2,0.4,0.6,0.8,1\).
How do you find \(P\!\left(\hat p=\dfrac{k}{n}\right)\)?
Use \(P(X=k)=\dbinom{n}{k}p^{k}(1-p)^{n-k}\). For a fair coin tossed \(4\) times, \(P(\hat p=\tfrac{1}{2})=\dbinom{4}{2}(0.5)^{4}=0.375\).
What are the mean and standard deviation of \(\hat p\)?
\(E(\hat p)=p\) and \(\text{SD}(\hat p)=\sqrt{\dfrac{p(1-p)}{n}}\). For \(p=0.2\), \(n=100\): mean \(0.2\), standard deviation \(0.04\).
When is the distribution symmetric?
Only when \(p=0.5\), since then \(P(\hat p=\tfrac{k}{n})=P(\hat p=\tfrac{n-k}{n})\). Otherwise it leans towards the small (\(p<0.5\)) or large (\(p>0.5\)) proportions.
Is this the same as the normal approximation?
No. This is the exact distribution built from the binomial columns. The normal approximation is a separate large-sample result, treated in the next subtopic.