Solving Evaluating Statistical Claims Questions on the SAT
These Digital SAT questions describe a study or survey and ask whether its conclusion can be generalized to a population, whether it supports cause-and-effect, or whether the design has a flaw.
Problem-Solving and Data Analysis · Updated October 21, 2026 · 10 min read
01
The method: Sample vs. Assignment vs. Claim
Two different design choices answer two different questions. Random sampling — randomly choosing who is measured — determines whether results can be generalized to a population. Random assignment — randomly placing participants into groups (treatment vs. control) — determines whether you can conclude causation. A study can have either, both, or neither.
Use Sample vs. Assignment vs. Claim: identify whether the study used random sampling, identify whether it used random assignment, then check whether the stated claim matches what that combination actually supports.
Researchers randomly selected 500 people from a city, then simply asked whether they exercise regularly and measured their stress level — no groups were assigned. They found that people who exercise regularly reported lower stress. Walk through evaluating that claim below.
Evaluate a study design
Step 1 · Design
Observational survey, not an experiment
No one was placed into an exercise or non-exercise group — researchers only measured and asked.
Try it
A study finds that city residents who own a gym membership have lower average blood pressure than those who don't. Which statement is best supported?
02
Random sampling vs. random assignment
These two ideas get tested against each other constantly, so keep them separate by what question each one answers. Random sampling answers: “Can I trust this result applies to the population I sampled from?” Random assignment answers: “Can I trust that the treatment — not something else — caused the difference I observed?” A well-designed experiment often uses both.
Sampling, assignment, or both?
1 / 3
Classify the design used in each scenario.
Researchers randomly select 300 students from a school to survey about study habits.
Try it
A company wants to know if a new packaging design increases sales. It randomly assigns 40 of its 80 stores to use the new packaging and the other 40 to keep the old packaging, then compares sales. What does the random assignment allow them to conclude if sales are higher in the new-packaging stores?
Lock this skill with free SAT Math practice.
Study-design questions appear throughout Problem-Solving and Data Analysis. Drill today's free Math set — no account required.
Two variables can move together without one causing the other. Classic example: ice cream sales and drowning incidents both rise in the summer — not because ice cream causes drowning, but because a third factor (warm weather, more swimming) drives both. This is called a confounding variable.
When the SAT describes an observational study (no random assignment) and asks what can be concluded, the safe answer is almost always “an association, not a cause” — unless a confounding explanation is even more directly suggested by the choices.
Try it
A researcher notices that in a large dataset, towns with more libraries tend to have lower crime rates. Which of the following is the most likely explanation, other than libraries directly reducing crime?
04
Spotting weak study claims
A handful of flaws show up again and again: a nonrandom or self-selected sample (only people who chose to respond), no control group to compare against, and results from one group applied to a different group that wasn't part of the study. When you see a strong claim (“X causes Y” or “X% of everyone believes...”), check the study design before accepting it.
Try it
A magazine surveys its own readers online and reports that “80% of Americans prefer Brand X.” What is the main flaw in this claim?
05
Practice until it's automatic
These mix sampling vs. assignment, spotting confounding variables, and identifying weak survey designs — the recurring themes across this question type.
A poll only surveys people leaving a gym about exercise habits. What kind of bias does this introduce?
True or false: random assignment allows researchers to conclude causation.
A study observes (does not assign) that students who eat breakfast have higher grades. What can be concluded?
A drug trial randomly assigns patients to a drug group or a placebo group. What does this support?
A national survey uses a random sample of 1,500 adults across all 50 states. What does this support?
Two variables rise together because both are caused by a third variable. What is this called?
Once you can spot sampling and assignment reliably, you're ready to combine this with margin of error, which quantifies exactly how much uncertainty a sample's estimate carries.
06
Practice questions
Here are three Evaluating Statistical Claims questions from our problem sets, from easier to harder, in the same format as the Digital SAT. Answer each one to see the full explanation.
Question 1 · Easy
A researcher wants to estimate the average number of hours of sleep per night for adults in Rowan County. Which sampling method is most likely to produce an estimate that can be generalized to all adults in the county?
Question 2 · Medium
A university reported that 78% of its students who lived on campus graduated within 6 years, compared with 62% of its students who lived off campus. Students chose where to live. Which statement is best supported by these data?
Question 3 · Hard
The manager of Pinecrest Apartments asked each of the complex's 64 households whether it would like a shared garden in the courtyard. Of the 52 households that answered, 41 said yes; the other 12 households did not answer. Which conclusion is best supported?
There are 6 Evaluating Statistical Claims problem sets. Each set has around ten questions like these, with a full explanation for every answer.
A university randomly selects 600 students from its full enrollment to survey about dining hall satisfaction. What does the random sampling most directly support?
Practice 2
Researchers randomly assign volunteers to either take a new supplement or a placebo for 8 weeks, then compare energy levels. What does the random assignment support?
Practice 3
A news article states that “coffee drinkers live longer, so drinking coffee causes a longer life.” What is the flaw in this claim?
Practice 4
A city's park department wants feedback and posts a survey link only on its own social media page, which is followed mostly by frequent park users. What kind of bias does this introduce?
Practice 5
A study randomly samples patients from a hospital's full patient population and randomly assigns them to two treatments, then compares outcomes. If Treatment A shows better outcomes, what can be concluded?
07
Frequently asked questions
What is the difference between random sampling and random assignment?
Random sampling is about who gets studied: picking participants at random from a population lets you extend the results to that population. Random assignment is about which treatment each participant gets: assigning groups at random is what lets an experiment support a cause-and-effect conclusion. A study can use one, both or neither, and many SAT questions turn on which one is present.
When does a study show cause and effect on the SAT?
Only when the researchers randomly assigned participants to the groups being compared. College Board's framework says students should understand why random assignment provides evidence for a causal relationship in an experimental study. In an observational study, people end up in groups through their own choices or circumstances, so it can show an association but not that one variable causes the other.
Which population can a study's results be extended to?
Only the population the random sample was drawn from. College Board's framework puts it as understanding why a result can be extended only to the population from which the sample was selected. A random sample of adults in one county supports conclusions about adults in that county, not teenagers there or adults in another state, and a sample that wasn't random supports no such conclusion at all.
What are common mistakes on SAT statistical claims questions?
The one we see most is accepting a causal claim (“causes,” “leads to,” “improves”) from a study with no random assignment. Next is generalizing too far, either to a broader population than the one sampled or from a self-selected group such as people who chose to answer a survey. A third is treating a large sample as proof of a good one: size can't fix a sample that wasn't random.
Is evaluating statistical claims on the PSAT?
No. College Board's Assessment Framework lists “Evaluating statistical claims: observational studies and experiments” as an SAT skill only; PSAT/NMSQT, PSAT 10 and PSAT 8/9 don't include it. Skills Insight also marks the related statement, identifying the population a study's results can reasonably be extended to, as SAT only.
How many SAT questions test statistical claims, and how hard are they?
College Board doesn't give a count for this skill alone. It shares Problem-Solving and Data Analysis, about 15% of the scored Math questions or 5 to 7 questions, with six other skills. In Skills Insight, identifying or describing the population to which a research study's results can reasonably be extended sits in the top Math score band, 680–800.
Next up
Keep going in SAT Math.
Data inference and probability round out Problem-Solving and Data Analysis.