
pose a question that calls for a significance test, carry out and interpret the test with an interval for the effect, and defend the conclusion and its scope.
Instruction
The task. Pose a question, choose and carry out a significance test, and report the evidence, the size of the effect and the scope of the conclusion.
Question options.
- Two stations, same years (paired t): is one Missouri station wetter, warmer or cooler than another? (NOAA Global Summary of the Year.)
- Two eras (two-sample t): do annual values at a station differ between 1950-1979 and 1995-2024?
- A proportion (one- or two-proportion z): is the fraction of summer days at or above 100°F in Kansas City or St. Louis different in the 2010s than in the 2000s? (NOAA daily data.)
- A randomized experiment (two-sample t or randomization test): an experiment you design and run with willing family members or friends, with a parent or guardian’s approval and the ethics rules from RLP Statistics A.
- A CDC comparison: for example, whether the average yearly change in a Missouri age-adjusted death rate differs between two causes (paired by year, from data.cdc.gov dataset bi63-dtpu; the Lesson 3.5 reading prints the Missouri table).
Required elements.
- The parameter, defined in words and symbols, and hypotheses written before you analyze the data, with α chosen and justified by the consequences of each error type.
- The test chosen and justified: proportion or mean, one sample, two samples or paired.
- Conditions checked with evidence: a graph of the data or differences, the counts, and an honest note on independence (consecutive years or days are not independent random draws).
- The test statistic and P-value computed by hand, then confirmed with technology.
- A conclusion in context at your α, using the language “convincing evidence” or “not convincing evidence”.
- A 95% confidence interval for the effect, and a judgment of practical significance.
- The error that could have occurred (Type I if you rejected, Type II if you did not), with its consequence. If you failed to reject, an estimate of whether your sample had reasonable power.
- A scope statement placed in the scope-of-inference table, with at least one alternative explanation.
A model conclusion. “In the same 30 years (1995-2024), Springfield-Branson National Airport recorded more precipitation than Kansas City International Airport by an average of 5.34 inches a year (paired t = 4.06, df = 29, P = 0.0003). At α = 0.05, this is convincing evidence of a real difference in the stations’ mean annual totals. A 95% interval puts the difference between about 2.65 and 8.03 inches, a sizable share of Kansas City’s annual total of about 39 inches. The data are observational records from two fixed stations, so the result describes these locations over this period and says nothing about why they differ.”
The defense. Four minutes: question, test, result, effect size and scope. Expect one question about a condition or about your choice of test, from a parent or guardian or from the question you write down for yourself.
📖 Read for this lesson
The reading opens over the lesson; close it to come back to exactly where you were. The checks below draw on it.
Formative check
Work through these before moving on. They are not graded — they tell you whether the standard below has landed yet.
Your test fails to reject H₀ with P = 0.21. Which error might you have made?
Reporting a confidence interval alongside the test shows the size of the effect, which the P-value alone does not.
Stage 1 plan (submit before analyzing): state your question and data source, define the parameter, write H₀ and Hₐ, choose α and justify it by the consequences of each error type, and name the test you expect to use.
How confident are you that you can plan, carry out and defend a significance test with an effect size and a correct scope?
Unit 3 checkpoint
Do this before you start the task. It covers the whole unit and tells you what to review first.
Which hypothesis pair is correctly written?
With H₀: p = 0.60, n = 150 and p̂ = 0.52, the test statistic is z = .
A P-value is the probability that the null hypothesis is true.
P = 0.59. The correct conclusion is…
For paired data with d̄ = 5.339, s_d = 7.204 and n = 30, t ≈ .
A two-sided test at α = 0.05 rejects H₀: μ = 65 if 65 lies outside the 95% t-interval.
Rejecting a true H₀ is a…
Which increases power?
Twenty independent tests at α = 0.05 with all nulls true: P(at least one false positive) ≈ .
With 100,000 people per group, a 0.5-point difference can be statistically significant but practically unimportant.
A randomized experiment gives P = 0.018. What can be concluded?
The pooled proportion is used in the standard error of a two-proportion confidence interval.
Submit: Significance Test Investigation (1,300-1,600 words) + four-minute defense
Task: Investigate a question with a significance test on NOAA or CDC data, or on a randomized experiment you run yourself, reporting the P-value, a confidence interval for the effect, error analysis and scope. Tools: spreadsheet (T.TEST, T.DIST.2T, NORM.S.DIST), GeoGebra Probability (https://www.geogebra.org/probability), CODAP, or optionally Python in JupyterLite. Hand computation with printed tables earns full credit.
Submission workflow
- Stage 1 — Plan. Question, data source, parameter, hypotheses, α with its justification, and the test you expect to use — written before analysis.
- Stage 2 — Self-checked draft. Recompute your test statistic, check each condition and challenge your scope statement yourself from your notes, or ask a parent or guardian to repeat one calculation and read your conditions and interpretations; submit those notes and your revision plan.
- Stage 3 — Final report. 1,300-1,600 words with all eight required elements.
- Stage 4 — Defense. Four minutes, recorded or live for a parent or guardian, answering a question about a condition or the choice of test.
How it is scored
| Criterion | What proficient looks like |
|---|---|
| Test and P-value (PS.18) | Appropriate test; statistic and P-value correct by hand and technology. |
| Model reasoning (A2.DS.A.2) | Explains what H₀ models and whether the data are consistent with it. |
| Comparison and design (A2.DS.A.2, A2.DS.A.3) | Two-group or paired structure handled correctly; scope matches the design. |
| Effect size (PS.17) | Confidence interval for the effect; practical significance judged in context. |
| Critical evaluation (A2.DS.A.7) | Possible error type and its consequence discussed; conditions assessed honestly. |
| Argument (MP.3) | Conclusion stated precisely and defended against a challenge. |
Nineteen Years of Missouri Death Rates: The CDC Table Behind Three Lessons
CDC NCHS, NCHS – Leading Causes of Death: United States, data.cdc.gov dataset bi63-dtpu, Missouri rows, 1999-2017, age-adjusted death rates per 100,000 and deaths; retrieved 2026-11-10 · Public domain (works of the United States government), with SLS original worked computation
Why this reading. Three lessons point at one CDC dataset. The significance-test investigation offers “a CDC comparison” of yearly changes in two causes of death, paired by year; the procedure workshop asks whether Missouri’s unintentional-injury death rate trended upward from 2010 to 2017; and the capstone lists the same table as a health data source. The lessons name the dataset (data.cdc.gov, bi63-dtpu) and never print it. Here it is for Missouri: eight series over nineteen years, with two of the analyses worked so that yours can be checked.
What the numbers are
The National Center for Health Statistics compiles death certificates from every state. This dataset gives, for each state and year from 1999 to 2017, the number of deaths from each of the leading causes and the age-adjusted death rate per 100,000 population. Age adjustment matters: Missouri’s population aged over these years, and an older population dies more often from most causes whatever else is happening. The rate is what the state’s deaths would be if its age mix matched a fixed standard population, so rates from different years can be compared. The dataset also holds chronic lower respiratory disease, influenza and pneumonia, and kidney disease; they are in the source and not printed here. Retrieved 2026-11-10.
Table 1. Missouri, age-adjusted deaths per 100,000, 1999–2017
| Year | All causes | Heart disease | Cancer | Stroke | Unintentional injuries | Alzheimer’s | Diabetes | Suicide |
|---|---|---|---|---|---|---|---|---|
| 1999 | 945.0 | 300.5 | 207.9 | 65.6 | 43.2 | 15.0 | 26.3 | 12.6 |
| 2000 | 920.8 | 286.0 | 205.9 | 65.1 | 41.9 | 17.8 | 24.6 | 12.5 |
| 2001 | 913.4 | 273.4 | 207.1 | 62.0 | 42.5 | 17.8 | 25.6 | 12.8 |
| 2002 | 922.3 | 272.7 | 204.1 | 63.1 | 45.6 | 19.0 | 26.8 | 12.1 |
| 2003 | 907.0 | 264.9 | 202.1 | 57.7 | 47.6 | 20.6 | 27.1 | 11.8 |
| 2004 | 872.7 | 248.5 | 201.1 | 56.1 | 46.4 | 21.9 | 23.6 | 12.4 |
| 2005 | 873.3 | 236.8 | 198.0 | 52.9 | 47.8 | 25.6 | 24.8 | 12.5 |
| 2006 | 859.0 | 228.8 | 195.8 | 50.5 | 50.1 | 25.1 | 23.5 | 13.5 |
| 2007 | 837.7 | 218.9 | 190.9 | 49.4 | 48.8 | 25.5 | 22.4 | 13.5 |
| 2008 | 861.3 | 219.8 | 189.5 | 49.2 | 48.9 | 30.0 | 20.4 | 13.0 |
| 2009 | 815.3 | 206.1 | 185.7 | 44.9 | 47.5 | 25.5 | 19.8 | 14.3 |
| 2010 | 819.5 | 201.8 | 185.6 | 44.0 | 47.9 | 28.8 | 21.2 | 14.0 |
| 2011 | 812.0 | 197.4 | 179.4 | 43.4 | 50.5 | 27.4 | 20.8 | 15.3 |
| 2012 | 803.0 | 193.4 | 182.3 | 42.2 | 47.8 | 25.9 | 19.6 | 14.9 |
| 2013 | 807.7 | 194.7 | 179.4 | 40.6 | 47.0 | 27.5 | 20.5 | 15.6 |
| 2014 | 807.0 | 194.7 | 177.7 | 41.0 | 48.7 | 27.4 | 19.4 | 16.3 |
| 2015 | 816.9 | 197.9 | 173.4 | 40.8 | 50.9 | 28.7 | 19.7 | 17.1 |
| 2016 | 808.2 | 192.1 | 167.0 | 40.4 | 57.0 | 30.0 | 20.1 | 18.4 |
| 2017 | 820.1 | 191.1 | 167.3 | 41.0 | 58.8 | 32.3 | 21.0 | 18.5 |
For scale, the 2017 counts behind the rates:
| Cause (2017) | All causes | Heart disease | Cancer | Stroke | Unintentional injuries | Alzheimer’s disease | Diabetes | Suicide |
|---|---|---|---|---|---|---|---|---|
| Deaths | 61,876 | 14,820 | 12,971 | 3,159 | 3,776 | 2,545 | 1,605 | 1,151 |
| Age-adjusted rate | 820.1 | 191.1 | 167.3 | 41.0 | 58.8 | 32.3 | 21.0 | 18.5 |
Worked: do two causes decline at different rates? (paired by year)
Cancer and heart disease both fell over these 19 years (heart disease from 300.5 to 191.1, cancer from 207.9 to 167.3). The question is whether the yearly change differs between them. Compute each cause’s change from one year to the next (18 changes), then the difference between the two changes for the same interval, which pairs them by year:
| Interval | Cancer change | Heart disease change | Difference (cancer − heart) |
|---|---|---|---|
| 1999–2000 | −2.0 | −14.5 | +12.5 |
| 2000–2001 | +1.2 | −12.6 | +13.8 |
| 2001–2002 | −3.0 | −0.7 | −2.3 |
| 2002–2003 | −2.0 | −7.8 | +5.8 |
| 2003–2004 | −1.0 | −16.4 | +15.4 |
| 2004–2005 | −3.1 | −11.7 | +8.6 |
| 2005–2006 | −2.2 | −8.0 | +5.8 |
| 2006–2007 | −4.9 | −9.9 | +5.0 |
| 2007–2008 | −1.4 | +0.9 | −2.3 |
| 2008–2009 | −3.8 | −13.7 | +9.9 |
| 2009–2010 | −0.1 | −4.3 | +4.2 |
| 2010–2011 | −6.2 | −4.4 | −1.8 |
| 2011–2012 | +2.9 | −4.0 | +6.9 |
| 2012–2013 | −2.9 | +1.3 | −4.2 |
| 2013–2014 | −1.7 | +0.0 | −1.7 |
| 2014–2015 | −4.3 | +3.2 | −7.5 |
| 2015–2016 | −6.4 | −5.8 | −0.6 |
| 2016–2017 | +0.3 | −1.0 | +1.3 |
The 18 paired differences have mean d̄ = 3.822 and sd = 6.611. H0: μd = 0. SE = 6.611/√18 = 1.558; t = 3.822/1.558 = 2.45, df = 17. From the df-17 row of the critical-values reading, the tail beyond 2.0 is 0.0309 and beyond 2.5 is 0.0115, so 0.023 < P < 0.062, and technology gives 0.0253. Interval: 3.82 ± 2.110(1.558) = 0.53 to 7.11 deaths per 100,000 per year. Heart disease fell faster than cancer by about 3.8 deaths per 100,000 each year, on average.
Now the conditions, honestly. The changes are not a random sample; they are the entire record. The heart-disease changes are more variable than the cancer changes (sd 6.0 against 2.4), and a dot plot of the differences shows large values at 2003–2004 and 2000–2001 that drive the result. Consecutive changes may be related (a big drop is often followed by a small one). All of that makes the P-value an approximation. The size of the interval is the more reliable part of the answer.
Worked: did the unintentional-injury rate trend upward, 2010–2017?
Eight points: 47.9, 50.5, 47.8, 47.0, 48.7, 50.9, 57.0, 58.8. Least squares against year gives slope b = 1.426 per 100,000 per year, SEb = 0.458, t = 3.12 on 6 df, P = 0.0207, r = 0.786. The rate rose by about 1.4 deaths per 100,000 each year. Lesson 4.3 gives the method and its conditions; with eight consecutive years the residuals are not independent, so treat the P-value as an approximation and the direction as the finding. (The national rise in these deaths over the same years is documented by CDC; this table lets you compare Missouri’s rate with the United States rate by downloading the “United States” rows of the same dataset.)
When is inference meaningful here at all?
These are essentially complete counts of a whole state, not samples. Lesson 4.4 says: if the question is about these years in this state, compute and describe; there is nothing to infer. Inference becomes meaningful when the question is about a process: is the underlying risk changing, as opposed to the recorded rate wobbling? A test then treats each year’s rate as the process plus year-to-year noise, and asks whether the trend or difference is larger than that noise. State which question you are asking before you choose a procedure.
Sources: CDC NCHS, Leading Causes of Death: United States (dataset bi63-dtpu) (data.cdc.gov); data.cdc.gov API (the query used here) (data.cdc.gov)