THE VR SCHOOL
  • Schools & Districts
    • License the academy
    • Free program for your students
    • Request a demo
  • Catalog
    • AI & Data
    • Cybersecurity & Web
    • Programming
    • Health Science
    • All Guilds
    • All courses
  • Families
  • Accreditation
  • Log In
  • Request a demo
  • Home
  • Courses

RLP Statistics B — Probability Models and Statistical Inference

Curriculum

  • 4 Sections
  • 20 Lessons
  • 10 Weeks
Expand all sectionsCollapse all sections
  • Unit 1: Continuous Distributions and Sampling Distributions
    5
    • 1.1
      Continuous Random Variables and Density Curves
      50 mins
    • 1.2
      The Normal Distribution
      50 mins
    • 1.3
      When Is a Normal Model Appropriate?
      50 mins
    • 1.4
      Sampling Distributions and the Central Limit Theorem
      50 mins
    • 1.5
      Performance Task — Sampling Distribution Simulation Study
      150 mins
  • Unit 2: Estimating with Confidence
    5
    • 2.1
      Estimating a Proportion with Confidence
      50 mins
    • 2.2
      Confidence Intervals for a Mean
      50 mins
    • 2.3
      What Confidence Means, and What It Does Not
      50 mins
    • 2.4
      Comparing Two Groups with Confidence Intervals
      50 mins
    • 2.5
      Performance Task — Estimation Study
      150 mins
  • Unit 3: Testing Claims: Significance Tests
    5
    • 3.1
      The Logic of a Significance Test
      50 mins
    • 3.2
      t-Tests for Means and Paired Data
      50 mins
    • 3.3
      Errors, Power and Significance in the Real World
      50 mins
    • 3.4
      Two-Sample Tests from Experiments and Observational Data
      50 mins
    • 3.5
      Performance Task — Significance Test Investigation
      150 mins
  • Unit 4: Chi-Square, Regression Inference and the Capstone Study
    5
    • 4.1
      Chi-Square Goodness of Fit
      50 mins
    • 4.2
      Chi-Square Tests for Two-Way Tables
      50 mins
    • 4.3
      Inference for the Slope of a Regression Line
      50 mins
    • 4.4
      Choosing the Right Procedure and Writing It Up
      50 mins
    • 4.5
      Capstone — Full Statistical Inference Study
      200 mins

Performance Task — Significance Test Investigation

Unit 3  ·  Culminating Performance Task  ·  Lesson 15 of 20

Performance Task — Significance Test Investigation

PS.18RLP-STATSB
Hands compare paired measurements from two weather stations with abstract data dots and an uncertainty interval.
By the end of this lesson I can…

pose a question that calls for a significance test, carry out and interpret the test with an interval for the effect, and defend the conclusion and its scope.

Instruction

The task. Pose a question, choose and carry out a significance test, and report the evidence, the size of the effect and the scope of the conclusion.

Question options.

  • Two stations, same years (paired t): is one Missouri station wetter, warmer or cooler than another? (NOAA Global Summary of the Year.)
  • Two eras (two-sample t): do annual values at a station differ between 1950-1979 and 1995-2024?
  • A proportion (one- or two-proportion z): is the fraction of summer days at or above 100°F in Kansas City or St. Louis different in the 2010s than in the 2000s? (NOAA daily data.)
  • A randomized experiment (two-sample t or randomization test): an experiment you design and run with willing family members or friends, with a parent or guardian’s approval and the ethics rules from RLP Statistics A.
  • A CDC comparison: for example, whether the average yearly change in a Missouri age-adjusted death rate differs between two causes (paired by year, from data.cdc.gov dataset bi63-dtpu; the Lesson 3.5 reading prints the Missouri table).

Required elements.

  1. The parameter, defined in words and symbols, and hypotheses written before you analyze the data, with α chosen and justified by the consequences of each error type.
  2. The test chosen and justified: proportion or mean, one sample, two samples or paired.
  3. Conditions checked with evidence: a graph of the data or differences, the counts, and an honest note on independence (consecutive years or days are not independent random draws).
  4. The test statistic and P-value computed by hand, then confirmed with technology.
  5. A conclusion in context at your α, using the language “convincing evidence” or “not convincing evidence”.
  6. A 95% confidence interval for the effect, and a judgment of practical significance.
  7. The error that could have occurred (Type I if you rejected, Type II if you did not), with its consequence. If you failed to reject, an estimate of whether your sample had reasonable power.
  8. A scope statement placed in the scope-of-inference table, with at least one alternative explanation.

A model conclusion. “In the same 30 years (1995-2024), Springfield-Branson National Airport recorded more precipitation than Kansas City International Airport by an average of 5.34 inches a year (paired t = 4.06, df = 29, P = 0.0003). At α = 0.05, this is convincing evidence of a real difference in the stations’ mean annual totals. A 95% interval puts the difference between about 2.65 and 8.03 inches, a sizable share of Kansas City’s annual total of about 39 inches. The data are observational records from two fixed stations, so the result describes these locations over this period and says nothing about why they differ.”

The defense. Four minutes: question, test, result, effect size and scope. Expect one question about a condition or about your choice of test, from a parent or guardian or from the question you write down for yourself.

📖 Read for this lesson

The reading opens over the lesson; close it to come back to exactly where you were. The checks below draw on it.

  • Nineteen Years of Missouri Death Rates: The CDC Table Behind Three LessonsCDC NCHS, NCHS – Leading Causes of Death: United States, data.cdc.gov dataset bi63-dtpu, Missouri rows, 1999-2017, age-adjusted death rates per 100,000 and deaths; retrieved 2026-11-10 · about 5 min

    The CDC table the task names and never prints: Missouri’s age-adjusted death rates for eight series over nineteen years, with the paired-changes comparison worked so yours can be checked, and an honest note on what inference means for a state’s complete record.

Vocabulary in context

  • pre-registration — Writing hypotheses and the analysis plan before seeing the data, to prevent choosing tests after the fact.
  • effect size — How large a difference or effect is, reported in context units, ideally with a confidence interval.
  • convincing evidence — The standard phrasing when P ≤ α: the data are unlikely under H₀.

Formative check

Work through these before moving on. They are not graded — they tell you whether the standard below has landed yet.

+50 XP

Your test fails to reject H₀ with P = 0.21. Which error might you have made?

If H₀ is actually false, failing to reject it is a Type II error; discuss power.
Myth or Fact?

Reporting a confidence interval alongside the test shows the size of the effect, which the P-value alone does not.

The P-value measures evidence against H₀; the interval shows which effect sizes are plausible.

Stage 1 plan (submit before analyzing): state your question and data source, define the parameter, write H₀ and Hₐ, choose α and justify it by the consequences of each error type, and name the test you expect to use.

0 words
Quick self-check

How confident are you that you can plan, carry out and defend a significance test with an effect size and a correct scope?

Not yetVery confident

Unit 3 checkpoint

Do this before you start the task. It covers the whole unit and tells you what to review first.

+50 XP

Which hypothesis pair is correctly written?

Parameters, with a single value in H₀.
Fill in the blank

With H₀: p = 0.60, n = 150 and p̂ = 0.52, the test statistic is z = .

Myth or Fact?

A P-value is the probability that the null hypothesis is true.

It is computed assuming H₀ is true.
+50 XP

P = 0.59. The correct conclusion is…

Never ‘accept’.
Fill in the blank

For paired data with d̄ = 5.339, s_d = 7.204 and n = 30, t ≈ .

Myth or Fact?

A two-sided test at α = 0.05 rejects H₀: μ = 65 if 65 lies outside the 95% t-interval.

Duality of tests and intervals.
+50 XP

Rejecting a true H₀ is a…

False alarm.
+50 XP

Which increases power?

Fill in the blank

Twenty independent tests at α = 0.05 with all nulls true: P(at least one false positive) ≈ .

Myth or Fact?

With 100,000 people per group, a 0.5-point difference can be statistically significant but practically unimportant.

Report effect size.
+50 XP

A randomized experiment gives P = 0.018. What can be concluded?

Random assignment, volunteers.
Myth or Fact?

The pooled proportion is used in the standard error of a two-proportion confidence interval.

Pooling is for the test, under H₀: p₁ = p₂.

Submit: Significance Test Investigation (1,300-1,600 words) + four-minute defense

Task: Investigate a question with a significance test on NOAA or CDC data, or on a randomized experiment you run yourself, reporting the P-value, a confidence interval for the effect, error analysis and scope. Tools: spreadsheet (T.TEST, T.DIST.2T, NORM.S.DIST), GeoGebra Probability (https://www.geogebra.org/probability), CODAP, or optionally Python in JupyterLite. Hand computation with printed tables earns full credit.

Submission workflow

  1. Stage 1 — Plan. Question, data source, parameter, hypotheses, α with its justification, and the test you expect to use — written before analysis.
  2. Stage 2 — Self-checked draft. Recompute your test statistic, check each condition and challenge your scope statement yourself from your notes, or ask a parent or guardian to repeat one calculation and read your conditions and interpretations; submit those notes and your revision plan.
  3. Stage 3 — Final report. 1,300-1,600 words with all eight required elements.
  4. Stage 4 — Defense. Four minutes, recorded or live for a parent or guardian, answering a question about a condition or the choice of test.

How it is scored

CriterionWhat proficient looks like
Test and P-value (PS.18)Appropriate test; statistic and P-value correct by hand and technology.
Model reasoning (A2.DS.A.2)Explains what H₀ models and whether the data are consistent with it.
Comparison and design (A2.DS.A.2, A2.DS.A.3)Two-group or paired structure handled correctly; scope matches the design.
Effect size (PS.17)Confidence interval for the effect; practical significance judged in context.
Critical evaluation (A2.DS.A.7)Possible error type and its consequence discussed; conditions assessed honestly.
Argument (MP.3)Conclusion stated precisely and defended against a challenge.

Missouri Learning Standards — Mathematics (data and probability) addressed: A2.DS.A.2, A2.DS.A.3, A2.DS.A.7, A2.DS.A.4, MP.3

Extends beyond Missouri Statistics (enrichment): content Missouri places after Statistics

Instructional focus: Original investigation using a significance test, with effect size and scope

Reading

Nineteen Years of Missouri Death Rates: The CDC Table Behind Three Lessons

CDC NCHS, NCHS – Leading Causes of Death: United States, data.cdc.gov dataset bi63-dtpu, Missouri rows, 1999-2017, age-adjusted death rates per 100,000 and deaths; retrieved 2026-11-10 · Public domain (works of the United States government), with SLS original worked computation

Why this reading. Three lessons point at one CDC dataset. The significance-test investigation offers “a CDC comparison” of yearly changes in two causes of death, paired by year; the procedure workshop asks whether Missouri’s unintentional-injury death rate trended upward from 2010 to 2017; and the capstone lists the same table as a health data source. The lessons name the dataset (data.cdc.gov, bi63-dtpu) and never print it. Here it is for Missouri: eight series over nineteen years, with two of the analyses worked so that yours can be checked.

What the numbers are

The National Center for Health Statistics compiles death certificates from every state. This dataset gives, for each state and year from 1999 to 2017, the number of deaths from each of the leading causes and the age-adjusted death rate per 100,000 population. Age adjustment matters: Missouri’s population aged over these years, and an older population dies more often from most causes whatever else is happening. The rate is what the state’s deaths would be if its age mix matched a fixed standard population, so rates from different years can be compared. The dataset also holds chronic lower respiratory disease, influenza and pneumonia, and kidney disease; they are in the source and not printed here. Retrieved 2026-11-10.

Table 1. Missouri, age-adjusted deaths per 100,000, 1999–2017

YearAll causesHeart diseaseCancerStrokeUnintentional injuriesAlzheimer’sDiabetesSuicide
1999945.0300.5207.965.643.215.026.312.6
2000920.8286.0205.965.141.917.824.612.5
2001913.4273.4207.162.042.517.825.612.8
2002922.3272.7204.163.145.619.026.812.1
2003907.0264.9202.157.747.620.627.111.8
2004872.7248.5201.156.146.421.923.612.4
2005873.3236.8198.052.947.825.624.812.5
2006859.0228.8195.850.550.125.123.513.5
2007837.7218.9190.949.448.825.522.413.5
2008861.3219.8189.549.248.930.020.413.0
2009815.3206.1185.744.947.525.519.814.3
2010819.5201.8185.644.047.928.821.214.0
2011812.0197.4179.443.450.527.420.815.3
2012803.0193.4182.342.247.825.919.614.9
2013807.7194.7179.440.647.027.520.515.6
2014807.0194.7177.741.048.727.419.416.3
2015816.9197.9173.440.850.928.719.717.1
2016808.2192.1167.040.457.030.020.118.4
2017820.1191.1167.341.058.832.321.018.5

For scale, the 2017 counts behind the rates:

Cause (2017)All causesHeart diseaseCancerStrokeUnintentional injuriesAlzheimer’s diseaseDiabetesSuicide
Deaths61,87614,82012,9713,1593,7762,5451,6051,151
Age-adjusted rate820.1191.1167.341.058.832.321.018.5

Worked: do two causes decline at different rates? (paired by year)

Cancer and heart disease both fell over these 19 years (heart disease from 300.5 to 191.1, cancer from 207.9 to 167.3). The question is whether the yearly change differs between them. Compute each cause’s change from one year to the next (18 changes), then the difference between the two changes for the same interval, which pairs them by year:

IntervalCancer changeHeart disease changeDifference (cancer − heart)
1999–2000−2.0−14.5+12.5
2000–2001+1.2−12.6+13.8
2001–2002−3.0−0.7−2.3
2002–2003−2.0−7.8+5.8
2003–2004−1.0−16.4+15.4
2004–2005−3.1−11.7+8.6
2005–2006−2.2−8.0+5.8
2006–2007−4.9−9.9+5.0
2007–2008−1.4+0.9−2.3
2008–2009−3.8−13.7+9.9
2009–2010−0.1−4.3+4.2
2010–2011−6.2−4.4−1.8
2011–2012+2.9−4.0+6.9
2012–2013−2.9+1.3−4.2
2013–2014−1.7+0.0−1.7
2014–2015−4.3+3.2−7.5
2015–2016−6.4−5.8−0.6
2016–2017+0.3−1.0+1.3

The 18 paired differences have mean d̄ = 3.822 and sd = 6.611. H0: μd = 0. SE = 6.611/√18 = 1.558; t = 3.822/1.558 = 2.45, df = 17. From the df-17 row of the critical-values reading, the tail beyond 2.0 is 0.0309 and beyond 2.5 is 0.0115, so 0.023 < P < 0.062, and technology gives 0.0253. Interval: 3.82 ± 2.110(1.558) = 0.53 to 7.11 deaths per 100,000 per year. Heart disease fell faster than cancer by about 3.8 deaths per 100,000 each year, on average.

Now the conditions, honestly. The changes are not a random sample; they are the entire record. The heart-disease changes are more variable than the cancer changes (sd 6.0 against 2.4), and a dot plot of the differences shows large values at 2003–2004 and 2000–2001 that drive the result. Consecutive changes may be related (a big drop is often followed by a small one). All of that makes the P-value an approximation. The size of the interval is the more reliable part of the answer.

Worked: did the unintentional-injury rate trend upward, 2010–2017?

Eight points: 47.9, 50.5, 47.8, 47.0, 48.7, 50.9, 57.0, 58.8. Least squares against year gives slope b = 1.426 per 100,000 per year, SEb = 0.458, t = 3.12 on 6 df, P = 0.0207, r = 0.786. The rate rose by about 1.4 deaths per 100,000 each year. Lesson 4.3 gives the method and its conditions; with eight consecutive years the residuals are not independent, so treat the P-value as an approximation and the direction as the finding. (The national rise in these deaths over the same years is documented by CDC; this table lets you compare Missouri’s rate with the United States rate by downloading the “United States” rows of the same dataset.)

When is inference meaningful here at all?

These are essentially complete counts of a whole state, not samples. Lesson 4.4 says: if the question is about these years in this state, compute and describe; there is nothing to infer. Inference becomes meaningful when the question is about a process: is the underlying risk changing, as opposed to the recorded rate wobbling? A test then treats each year’s rate as the process plus year-to-year noise, and asks whether the trend or difference is larger than that noise. State which question you are asking before you choose a procedure.

Sources: CDC NCHS, Leading Causes of Death: United States (dataset bi63-dtpu) (data.cdc.gov); data.cdc.gov API (the query used here) (data.cdc.gov)

Up NextComplete & Continue →

Leave a Reply Cancel reply

Two-Sample Tests from Experiments and Observational Data
Prev
Chi-Square Goodness of Fit
Next

© 2026 The VR School | Career content by Wiley | Powered by Sejal Learning Systems.

Join free · Accreditation · Privacy Policy · Terms of Service

Modal title

Main Content