Evaluating Statistical Evidence in Passages: Assessing Data Claims on the SAT

Statistics describe patterns in data but do not automatically prove causation. If 80% of successful athletes trained in childhood, the statistic shows a correlation, not proof that childhood training CAUSES success. Other factors (genetics, privilege, motivation, opportunity) might explain the correlation. SAT reading tests whether you recognize this limitation. An author claiming "statistics prove X causes Y" when showing only correlation is making an unsupported leap. Evaluate each statistical claim by asking: does this statistic actually prove what the author claims, or just suggest a pattern?

Build a statistics-evaluation checklist: (1) what exactly does the statistic measure?, (2) what is the author claiming it proves?, (3) could other explanations account for the pattern?, (4) is the sample size adequate? (one person's experience is not a statistic), (5) could the sample be biased?. Use this checklist for every statistical claim in a passage.

Statistics from small or biased samples are unreliable. A statistic from 50 people is more reliable than from 5; a statistic from a random sample is more reliable than from a self-selected group. If a passage claims "most people prefer Product A" based on surveying loyal customers of Product A, the sample is biased (self-selected enthusiasts). A truly representative sample would randomly survey all consumers. SAT passages sometimes hide sample bias in their descriptions; watch for clues like "We surveyed our subscribers" (biased toward current users) versus "We randomly surveyed 1,000 residents" (more reliable).

When you encounter a statistic, note the sample description and flag any obvious biases. If the passage does not describe the sample, that is a red flag; the author may be hiding a biased source. This awareness prevents accepting weak claims as strong evidence.

Correlation does not imply causation. If sales of ice cream correlate with drowning deaths, neither causes the other; both are caused by a third factor (summer season). SAT reading passages often confuse correlation with causation, and you must catch this error. When an author claims a statistic proves causation but only shows correlation, that is a critical flaw in reasoning. Evaluate: does the author present a mechanism explaining HOW one causes the other? If not, they are overreaching.

Create an example from the ice cream/drowning case to remember this principle. Whenever you see an author link two statistics, ask: "Could a third factor explain both?" If yes, the causation claim is unsupported. Flag this on the test; questions about passage reasoning frequently test causation misunderstandings.

Percentages are meaningless without context (the baseline). "Unemployment increased 50%" sounds dramatic but could mean rising from 2% to 3% (a 50% relative increase but only 1 percentage point). Similarly, absolute numbers tell a different story: "1 million people" sounds large until you learn the population is 10 billion (0.01%). SAT passages sometimes manipulate perception by using percentages or raw numbers strategically. Evaluate numbers by converting them to the opposite form: if told a percentage, calculate the absolute number; if told an absolute number, calculate the percentage. This reveals whether a statistic is actually impressive or merely appears so.

Practice with five examples daily: given a percentage, calculate absolute values and vice versa. Build speed so you can instantly assess whether statistics are exaggerated or understated. This critical reading prevents being misled by statistical claims.