Sample size determination

Lore & Background

Sample size determination is a crucial aspect of research methodology. In practice, the sample size used in a study is usually determined based on the cost, time, or convenience of collecting the data, and the need for it to offer sufficient statistical power. In complex studies, different sample sizes may be allocated, such as in stratified surveys or experimental designs with multiple treatment groups. In a census, data is sought for an entire population, hence the intended sample size is equal to the population.

Reader's Guide

Sample size determination is significant because it directly affects the reliability and validity of study findings. Larger sample sizes generally lead to increased precision when estimating unknown parameters, as described by the law of large numbers and the central limit theorem. However, in some situations, the increase in precision for larger sample sizes is minimal or even non-existent due to systematic errors, strong dependence in the data, heavy-tailed distributions, or bias. Sample sizes may be chosen using several methods: based on experience, a target variance for an estimate, a power target for a statistical test, or a confidence level. For estimating a proportion, a common formula uses a conservative estimate of p = 0.5 to maximize variance, yielding n = Z² / W², where Z is the Z-score for the desired confidence level and W is the desired width of the confidence interval. The legacy of sample size determination lies in its foundational role in ensuring that empirical studies can produce meaningful and trustworthy conclusions.

Did You Know?

• The maximum variance of the estimator of a proportion is 0.25, which occurs when the true parameter p = 0.5.
• Sample sizes may be evaluated by the quality of the resulting estimates, often based on cost, time, or convenience of data collection.
• In experimental design, different treatment groups may have different sample sizes.
• The Wald method for the binomial distribution yields a confidence interval using the formula (p̂ − Z√(0.25/n), p̂ + Z√(0.25/n)).