Skip to content
Statculator

Topic

Study Design in Statistics: Types, Steps and Examples

What study design is, the four main types and when to use each, the seven steps of an experiment, how to sample and size a study, and how the design decides the statistical test.

By Hira Noor, BS Mathematics · Updated · 11 min read

Definition

Study design in statistics is the plan for how you collect data to answer a research question: who you study, how you choose them, what you measure, when you measure it and whether you assign a treatment. The four main types are experimental studies (such as randomized controlled trials), cohort studies, case-control studies and cross-sectional studies. Only a randomized experiment can show cause and effect on its own; the other three are observational and show association. The design decides which statistical test you can use and how many participants you need.

Key takeaways

  • Study design is decided before any data are collected, and it limits every conclusion you can draw afterwards.
  • The first split is who assigns the exposure: in an experiment the researcher does; in an observational study nature or the participants do.
  • The four main types are experimental (randomized controlled trial), cohort, case-control and cross-sectional.
  • Good experiments rest on four principles: control, randomization, replication and blocking, plus blinding where possible.
  • How you sample decides who your results apply to; a random sample supports inference to the population, a convenience sample does not.
  • Plan the sample size in advance: a survey at 95% confidence and ±5% needs 385 people, and comparing two means with d = 0.5 at 80% power needs about 63 per group.
On this page
  1. What is study design in statistics?
  2. The four main types of study design
  3. Observational vs experimental studies
  4. Which study design should you use?
  5. The 7 steps of experimental design
  6. Principles of experimental design
  7. Sampling methods: choosing who is in the study
  8. How many participants? Sample size in study design
  9. How study design determines the statistical test
  10. Common sources of bias in study design
  11. Study design & sample size guides
  12. FAQ

What is study design in statistics?

A study design (also called a research design) is the blueprint that links a question to data. It fixes the population you want to learn about, the sample you will actually measure, the variables (the exposure or treatment and the outcome), the timing of measurement and the method of assignment. Statistics comes in at two points: at the planning stage, where it sets the sampling method and the sample size, and at the analysis stage, where the design tells you which test or model is valid.

Design matters more than analysis because analysis cannot repair it. A biased sample stays biased however clever the test, and an observational study cannot become proof of cause and effect after the fact. That is why statisticians ask to be involved before data collection, not after. If the terms population, sample and parameter are new, start with Population vs Sample: Definitions, Differences and Examples and Parameter vs Statistic: Difference, Symbols and Examples.

The four main types of study design

Ask one question first: did the researcher assign the exposure? If yes, it is an experiment. If no, it is observational, and the direction in time sorts it further. Following people forward from exposure to outcome is a cohort study; starting from the outcome and looking back for exposure is a case-control study; measuring both at one moment is a cross-sectional study.

Decision tree for choosing a study design: if the researcher assigns the exposure it is an experiment (randomized controlled trial if assignment is random, otherwise quasi-experiment); if not, it is observational and splits into cohort (exposure to outcome, forward in time), case-control (outcome back to exposure) and cross-sectional (both at one point in time)
The four main study designs follow from two questions: who assigns the exposure, and which direction in time the study runs.
The four main types of study design compared
DesignHow it worksWhat it measuresCan show cause?Example
Experimental (randomized controlled trial)Researcher randomly assigns treatment or control, then measures the outcomeEffect of the treatment (difference in means or risks)Yes, if well randomized and controlled200 patients randomly given a new drug or a placebo; blood pressure compared after 8 weeks
Cohort (prospective or retrospective)Groups defined by exposure are followed to see who develops the outcomeIncidence and relative riskNo, but strong evidence of association and timingSmokers and non-smokers followed for 10 years to compare rates of lung disease
Case-controlPeople with the outcome (cases) are compared with similar people without it (controls) on past exposureOdds ratioNo; prone to recall and selection bias100 people with a rare cancer and 200 matched controls asked about past chemical exposure
Cross-sectionalExposure and outcome measured once, at the same time, in a samplePrevalence and associationNo; cannot tell which came firstA survey of 1,000 adults on screen time and sleep quality

Two smaller families sit around these four. Descriptive studies (case reports, case series and descriptive surveys) describe what happens without a comparison group and often generate the hypothesis that a later study tests. Quasi-experiments assign a treatment without randomization, for example giving a new teaching method to one school and comparing it with another, and they sit between experiments and cohort studies in strength. At the top, systematic reviews and meta-analyses pool several studies of the same question.

Observational vs experimental studies

In an observational study you record what already happens: who smokes, who exercises, who buys what. In an experimental study you impose the treatment. The difference is not about the size or quality of the data but about confounding: a third variable that is linked to both the exposure and the outcome. People who choose to exercise also tend to eat differently and smoke less, so an observed link between exercise and heart health mixes several causes. Random assignment breaks those links on average, which is why an experiment can isolate the effect of the treatment.

Observational and experimental studies side by side
Observational studyExperimental study
Who assigns the exposureParticipants, circumstances or natureThe researcher
Main threatConfounding and selection biasPoor randomization, dropout, lack of blinding
Conclusion you can drawAssociationCause and effect
When it is the only optionHarmful exposures (smoking), rare outcomes, long time spansWhen assigning the treatment is ethical and practical
Typical cost and speedOften cheaper and faster (except long cohorts)Often slower and more expensive

Which study design should you use?

Start from the question and the constraints, not from the design you know best. The usual ranking of evidence puts systematic reviews first, then randomized controlled trials, then cohort, case-control and cross-sectional studies, then case reports, but the strongest design is often not ethical or affordable. Pick the strongest one your situation allows.

Matching the research situation to a study design
Your situationDesign that usually fitsWhy
You want to know if a treatment or change causes a better outcome, and you can assign itRandomized controlled trialRandomization removes confounding, so a difference can be read as an effect
The exposure is harmful or cannot be assigned (smoking, pollution)Cohort studyFollows exposed and unexposed people forward and gives relative risk
The outcome is rare or takes years to appearCase-control studyStarts from the few cases instead of waiting for them
You need a snapshot: how common something is right nowCross-sectional surveyOne round of measurement gives prevalence quickly and cheaply
You can assign the change but not at random (whole schools, policies)Quasi-experimentCompares treated and untreated groups; adjust for differences at baseline
Each person can try every treatment and the effect wears offCrossover or matched-pairs designEach person is their own control, so fewer participants are needed

The 7 steps of experimental design

Textbooks number the steps differently (five, six or seven), but they cover the same ground. Here is the seven-step version, with what statistics contributes at each one.

  1. State the research question in a form data can answer: “Does a 10-minute daily practice app raise exam scores?” rather than “Does the app help?”
  2. Write the hypotheses. The null hypothesis H₀ says there is no effect (mean score with the app = mean score without it); the alternative H₁ says there is one.
  3. Define the variables. The independent variable is what you change (app or no app); the dependent variable is what you measure (exam score). List the variables you will hold constant or record as possible confounders, such as prior grades.
  4. Design the treatments and control. Decide the treatment groups, what the control group receives (no app, or a placebo app), and whether the design is between-subjects (different people in each group) or within-subjects (each person tries both, as in a paired design).
  5. Choose the sample and the sample size. Define the population, pick a sampling method and calculate how many participants you need for adequate power (see the worked example below).
  6. Assign participants at random to the groups, and blind participants and assessors where you can, so neither expectations nor choices decide who gets the treatment.
  7. Measure, then analyze with the test the design implies. Collect the outcome the same way in every group, then run the test you planned in advance, report the effect size with a confidence interval and the p-value, and state any deviations from the plan.

Principles of experimental design

R. A. Fisher’s agricultural experiments in the 1920s and 1930s set out the principles that most designed experiments still follow.

  • Control: compare the treatment with a control group that differs only in the treatment, so the comparison has a baseline.
  • Randomization: use chance to assign units to groups. It balances known and unknown confounders on average and justifies the p-value. The Random Number Generator can produce an allocation list.
  • Replication: apply each treatment to enough units that chance variation can be estimated and averaged out. Replication is what the sample size calculation sets.
  • Blocking: group similar units (same field, same age band, same lab) and randomize within each block, which removes that source of variation from the error. A two-way ANOVA analyzes a blocked design.
  • Blinding: keep participants (single-blind) and also the people measuring the outcome (double-blind) unaware of who got which treatment, so expectations cannot shift the results.

Sampling methods: choosing who is in the study

Random assignment decides who gets the treatment; random sampling decides who is in the study at all. The first supports conclusions about cause, the second supports generalizing to the population. A randomized trial run on volunteers from one hospital shows the drug works for patients like them, not necessarily for everyone. The sampling method sets who your results apply to.

Common sampling methods and when each one fits
MethodHow it worksBest forWatch out for
Simple randomEvery member of the population has the same chance of selectionSmall, well-listed populationsNeeds a complete list (sampling frame)
StratifiedSplit the population into groups (strata) and sample randomly within eachMaking sure small subgroups are representedWeight the results if strata are sampled unequally
ClusterRandomly pick whole groups (schools, villages) and study everyone in themSpread-out populations with no full listPeople in a cluster are alike, so you need a larger sample
SystematicPick every k-th unit from a list after a random startLists, production linesA hidden pattern in the list can bias it
ConvenienceStudy whoever is easy to reachPilot studies onlyResults do not generalize; not a probability sample

How many participants? Sample size in study design

Too small a sample wastes the study: real effects go undetected because power is low, which is a Type II error. Too large a sample wastes money and, in a trial, exposes more people than needed to an untested treatment. The calculation depends on the design. For estimating a proportion you need the confidence level and margin of error; for comparing groups you also need the significance level α, the power (1 − β) and the effect size you want to detect.

Sample size for a survey and for a two-group experiment

Problem. A college wants to estimate the share of its 2,000 students who use a study app, to within ±5 percentage points at 95% confidence. Then it plans an experiment to test whether the app raises exam scores by half a standard deviation (d = 0.5) at α = 0.05 (two-sided) with 80% power.

  1. 01Survey, infinite population: n₀ = z² · p(1 − p) / e² = 1.96² × 0.5 × 0.5 / 0.05² = 384.16, which rounds up to 385. Using p = 0.5 gives the largest, safest answer when you have no earlier estimate.
  2. 02Finite population correction for N = 2,000: n = n₀ / (1 + (n₀ − 1) / N) = 384.16 / (1 + 383.16 / 2,000) = 384.16 / 1.1916 = 322.4, so survey 323 students.
  3. 03Experiment, two independent means: n per group = 2(z₁₋α/₂ + z₁₋β)² / d² = 2 × (1.960 + 0.842)² / 0.5² = 2 × 7.849 / 0.25 = 62.8, so 63 per group, 126 in total.
  4. 04Allow for dropout: if 10% of students may not sit the exam, recruit 63 / 0.9 = 70 per group.

Answer. Survey 323 of the 2,000 students for the usage estimate, and randomize about 140 students (70 per group) for the experiment. The exact t-based calculation gives 64 per group, one more than the normal approximation, which is why the two kinds of calculator can differ by a participant or two.

Try it: Sample Size CalculatorWork out the sample size for a survey, a mean or a two-group comparison, with the finite population correction and every step shown.

For quick survey planning you can also use Cochran’s formula, Slovin’s formula or Yamane’s formula, and the Margin of Error Calculator shows how precise a sample you already have is. For an experiment, the Effect Size Calculator turns earlier results into the d you plug into the power calculation.

How study design determines the statistical test

The design fixes the structure of the data, and the structure picks the test. Independent groups need an independent-samples test; the same people measured twice need a paired test; a case-control study can estimate an odds ratio but not a risk, because the researcher chose how many cases to include. The table pairs common designs with the usual first analysis; How to Choose the Right Statistical Test covers the full decision.

Common study designs and the analysis that usually fits them
Design and outcomeUsual analysisCalculator
Two randomized groups, numeric outcomeIndependent-samples t-testIndependent t-test
Same people before and after, or a crossover trialPaired t-testPaired t-test
Three or more groups, numeric outcomeOne-way ANOVAANOVA
Two groups, yes/no outcome (trial or cohort)Two-proportion z-test, relative riskTwo-proportion z-test
Case-control studyOdds ratio, chi-square test of independenceChi-square test
Cross-sectional survey, two categorical variablesChi-square test of independenceChi-square test
Cross-sectional survey, two numeric variablesCorrelation or regressionCorrelation
Survey estimating one proportion or meanConfidence intervalConfidence interval

Common sources of bias in study design

  • Selection bias: the sample differs from the population in a way linked to the outcome, for example an online survey that misses people without internet access.
  • Confounding: a third variable drives both exposure and outcome. Randomization handles it in experiments; in observational studies, matching, stratification and regression can only adjust for confounders you measured.
  • Recall bias: in case-control studies, cases tend to remember past exposures better than controls.
  • Nonresponse and dropout: if the people who do not answer or who leave the study differ from those who stay, the results shift. Report response and dropout rates.
  • Measurement bias: an unblinded assessor or a leading survey question pushes results in one direction.
  • Survivorship bias: studying only those who made it through a process (successful firms, surviving patients) hides the cases that failed.

Study design & sample size guides

Each guide takes one part of study design & sample size further, with formulas and worked examples.

Frequently asked questions

What is meant by study design?

Study design is the plan for collecting data to answer a research question. It sets the population, how the sample is chosen, which variables are measured and when, and whether the researcher assigns a treatment. It decides what kind of conclusion the study can support and which statistical analysis is valid.

What are the four types of study design?

The four main types are experimental studies such as randomized controlled trials, cohort studies, case-control studies and cross-sectional studies. Experiments assign the treatment and can show cause and effect; the other three are observational and show association. Cohort studies follow exposed and unexposed groups forward, case-control studies look back from the outcome, and cross-sectional studies measure everything at one time.

What are the 7 steps of experimental design?

State the research question, write the null and alternative hypotheses, define the independent, dependent and control variables, design the treatments and control group, choose the sample and calculate the sample size, randomly assign participants (with blinding if possible), and measure the outcome and analyze it with the test planned in advance.

What are the types of design in statistics?

In statistics, designs are usually split into observational designs (cohort, case-control, cross-sectional and descriptive studies) and experimental designs. Common experimental layouts are the completely randomized design, the randomized block design, the matched-pairs design, factorial designs that test two or more factors at once, and crossover designs where each participant receives every treatment.

What is the difference between an observational study and an experiment?

In an experiment the researcher assigns the treatment, ideally at random; in an observational study the researcher only records exposures that people already have. Random assignment balances confounding variables, so an experiment can show cause and effect, while an observational study shows association.

How do you choose a sample size for a study?

Set the confidence level and margin of error for an estimate, or the significance level, power and smallest effect worth detecting for a comparison, then apply the matching formula. A survey at 95% confidence and ±5% needs 385 people from a large population, and comparing two means with an effect size of 0.5 at 80% power needs about 63 per group. Add extra participants to cover expected dropout.

Further reading

Cite this page

Statculator. (2026, November 14). Study Design in Statistics: Types, Steps and Examples. Retrieved November 14, 2026, from https://statculator.com/learn/topics/study-design/