decide whether a sample is random, and explain how convenience and volunteer samples can give a biased picture of a population.
Phase 2: Investigate
Do Now. Sample situation: to find out whether students want more after-school sports, Jordan asks the first 20 students who walk into the gym after basketball practice. What might go wrong? Write one sentence.
Compared with the whole school, what will Jordan's sample probably show?
The reading opens over the lesson; close it to come back to exactly where you were.
Bias. A sample is biased when the way it was chosen makes some answers more likely than they are in the whole population. Jordan’s gym sample is biased toward students who like sports. A bigger biased sample does not fix the problem; it only repeats it with more people.
Three ways to choose a sample. A convenience sample asks whoever is easy to reach, like the people near you. A voluntary response sample lets people choose to answer, like an online poll; people with strong feelings answer most. A random sample uses chance, so every member of the population has the same chance to be chosen.
The test question. To decide whether a sample is random, ask: “Did every member of the population have the same chance to be picked, and did chance, not a person, make the choice?” If the answer is no, look for the group that is left out or overcounted.
Worked example 1: the lunch-line survey. Sample situation: Mei wants to know the favorite school lunch. She asks the first 25 students in the pizza line. Step 1: population = all students who eat school lunch. Step 2: who had a chance? Only students in the pizza line. Step 3: is it random? No, it is a convenience sample. Step 4: bias: pizza will look more popular than it really is.
Worked example 2: the hallway poster. Sample situation: Tyrell hangs a poster: “Scan this code to vote for a later start time!” 90 students vote and 80 say yes. Step 1: who answered? Only students who chose to. Step 2: it is a voluntary response sample. Step 3: 80/90 is about 89%, but students who care most, often those who want the change, are the most likely to vote. Step 4: we cannot trust 89% for the whole school.
How NAEP avoids this. Our reading shows a national test that uses chance to choose schools and then students, so that every student has a chance. That is the standard our School Survey Report will aim for.
Today’s hands-on test. Each team gets a sample-school bag of 40 student cards. You will choose a sample two ways and see which one looks more like the whole bag.
Hands-on. Your bag holds 40 sample-school cards: 10 say plays a sport and 30 say does not play a sport. Teammates who play a sport sat near the door, so the 8 cards on top of the stack are all sport cards. (1) Take the top 8 cards: that is a convenience sample. (2) Return them, shake the bag, and draw 8 without looking: that is a random sample. Record how many sport cards are in each.
Be the sample inspector. For each plan, name the method and any bias.
Plan A: to learn how much time students spend reading, ask everyone in the library during lunch. Plan B: draw 30 student ID numbers from a hat that holds every ID. Which is random? What bias might the other have?
A website asks visitors to rate a movie, and 2,000 people do. What kind of sample is this?
Rewrite Mei's lunch survey plan so that it uses a random sample.
We can spot biased samples. Next time we draw random samples ourselves, using cards and random digits.
Exit ticket: explain in two sentences why a bigger sample does not fix a biased method.
Pacing: Do Now 5 min, reading 7, mini lesson 10, bag activity and guided practice 13, independent practice and exit ticket 5.
Materials: per team, a paper bag and 40 index cards (10 marked sport, 30 marked no sport), with the 8 sport cards stacked on top before the activity. Random draws will vary; most teams get 1 to 3 sport cards out of 8 (the true share is 2 of 8).
Accuracy: representative sample, probability sample, known chance of selection, sorting by location type, larger schools more likely to be chosen (probability proportional to size), random choice of students in grades 4, 8 and 12, the 85 percent participation rule and no individual scores are from the NAEP page opened 2026-11-20. Checked: 10/40 = 25%; 8/8 = 100%; 80/90 = 88.9%, which rounds to 89%.
Likely misconceptions: “random” means “whoever I happen to bump into”; a large sample is automatically fair. Stress the two tests: same chance for everyone, and chance makes the choice.
Supports: a sorting mat with three columns (convenience, voluntary, random). Stretch: why does NAEP give bigger schools a bigger chance to be chosen? (So that each student, not each school, has a fair chance.)
Answer guide: Plan B is random; Plan A over-represents students who like reading or spend lunch in the library. Mei’s fix: put every lunch student’s name or number in a box and draw 25.
National Center for Education Statistics, NAEP Assessment Process: Select the Participants · U.S. government work, public domain
The National Assessment of Educational Progress, or NAEP, is a test that shows how students across the United States are doing in subjects like math and reading. It does not test every student. It tests a representative sample, a group that looks like the whole student population.
NAEP uses a probability sample. That means every school and every student has a known chance of being chosen. First, schools are sorted into groups by kind of place (city, suburb, town or rural) and other traits. Then schools are drawn from each group. Bigger schools have a bigger chance to be picked, because they hold more students.
Inside each chosen school, students in the tested grade (4, 8 or 12) are chosen at random. The page says every student has a chance of being chosen, no matter their background, disability or whether they are learning English.
NAEP also checks that enough chosen schools take part. If fewer than 85 percent of the sampled schools participate, the results cannot be reported. Results are never reported for single students, only for groups.
Source: National Center for Education Statistics, NAEP Assessment Process: Select the Participants (nces.ed.gov)