Free lesson

Every lesson is free, no account needed. Make a free account to save your progress.

Live classGet practice + mocks
  1. Home
  2. Grade 7-12 Math Review
  3. Evaluating Statistical Reports
Grade 7-12 Math Review · Grade 10 · Quarter 4

Evaluating Statistical Reports

The numbers are usually true. It is the sentence built around them that needs checking.

Judge the claim

A report states: "Learners who own a calculator score 12 points higher in maths, so buying a calculator raises a learner's score." What is wrong with it?

Four questions, in this order.

AskBecause
Who was asked, and how many?a biased or tiny sample cannot represent anyone
Which average was used?mean, median and mode can tell different stories
What does the graph's scale do?a cut axis exaggerates small differences
Is a cause being claimed?a link is not proof of a cause

Notice that none of these questions is about arithmetic. A statistical report almost never fails because someone added up wrongly.

Choosing the average that flatters.

"Average salary" is meaningless until you know which average.

StaffMonthly salary
Owner₱300,000
Manager₱45,000
Six workers₱18,000 each

total = 300,000 + 45,000 + 108,000

= ₱453,000 over 8 people

mean ≈ ₱56,625

what the advert would quote

median = ₱18,000

what most people earn

Seven of the eight earn below the mean

Nobody lied. "Average salary ₱56,625" is arithmetically correct and gives an entirely false impression, because one enormous value pulled the mean upwards. With skewed data, the median is the honest choice.

Percentages without the base number.

"80% preferred our brand" of 10 people? that is 8 people
"Cases doubled!" from 2 to 4? technically true, barely news
"Risk rises 50%" from 2 in 10,000 to 3 a relative rise, a tiny absolute one

A percentage always hides the number it came from. Ask for the raw count before being impressed by it.

Who asked, and who answered.

ProblemExample
Self-selected samplean online poll only strong opinions bother to answer
Interested partya drinks company funding research on its own drink
Leading question"Do you agree the unfair fee should be scrapped?"
Wrong populationasking commuters about car ownership

Funding does not make a study false, and plenty of company research is careful. But it is a reason to read the method rather than the headline.

Correlation and cause.

Two things moving together has at least four explanations.

A causes B studying raises marks plausible
B causes A doing well makes study enjoyable also plausible
Something else causes both ice cream sales and drowning both rise in summer the weather
Coincidence enough data sets, enough accidents it happens

Only a properly controlled experiment can separate these. A survey, however large, can show that two things travel together and nothing more.

Remember the flow

Who was asked · Which average · What the scale does · Whether a cause is claimed

Most misleading statistics contain no false numbers at all.

What a fair study adds: a comparison group and a margin of error.

A vitamin trial: 60 of 100 learners who took it got over a cold within a week. Does the vitamin work?

treated group: 60 of 100 = 60%

sounds impressive alone

control group, no vitamin: 58 of 100 = 58%

most colds clear up anyway

difference = 2 percentage points

almost no effect

"60% got better" proves nothing on its own

Without a control group, the 60% is credited to the vitamin even though 58% recover with nothing at all. The evidence is the difference between the groups, not the success rate of one.

A poll of 400 voters: 52% support a candidate, margin of error ±5 percentage points. Is she sure to win a majority?

52 − 5 = 47, 52 + 5 = 57

the plausible range

47% to 57% includes values below 50%

not sure

The margin of error tells how precise an estimate from a sample is. A lead smaller than the margin is not a clear lead.

Variations: three averages at once, a cut axis in numbers, a rise then a fall.

The same questions, answered with a little arithmetic.

Three averages: weekly allowances of ₱150, ₱150, ₱150, ₱200, ₱250, ₱300, ₱900

mode = ₱150, median = ₱200

most common; middle of seven

mean = 2,100 ÷ 7 = ₱300

pulled up by ₱900

Different: one data set, three honest "averages" — ₱150, ₱200 or ₱300 — so a report must say which.

A cut axis in numbers: bars of 96 and 98, axis starting at 95

drawn heights: 96 − 95 = 1 and 98 − 95 = 3

what the eye compares

looks 3 times as tall; really 98 ÷ 96 ≈ 1.02

about 2% more

Different: we can measure the exaggeration, not just describe it. An axis with no numbers at all is worse still: without a scale we cannot judge the size of the change — a steep line could be a rise of 2 or of 2,000.

A rise then a fall: a ₱20 snack rises 25%, then falls 25%

20 × 1.25 = ₱25

25% of 20 is 5

25 × 0.75 = ₱18.75

25% of 25 is 6.25

Different: the two 25%s have different bases, so "up 25%, down 25%" does not bring the price back to ₱20.

On the exam

Expect a claim or a graph to judge: a missing sample size, a biased sample, the wrong average, a cut axis, or a cause read into a correlation. The fastest route is to run the four questions — who was asked, which average, what the scale does, is a cause claimed — and stop at the first that fails. The 10-second check: the right choice names a flaw in how the data was gathered or read, not a flaw in the arithmetic.

Now you try

Practice problem

Choose the honest figure

Eight houses on a street sold for ₱1.2M, ₱1.3M, ₱1.3M, ₱1.4M, ₱1.5M, ₱1.5M, ₱1.6M and ₱14M. Which figure best describes a typical sale price?

Hint: check your chosen figure against the actual list. If most of the data sits below the "typical" value, it is not typical.