Study Guide

Sampling methods and bias

IB Mathematics: Applications and Interpretation SL· Unit 4: Statistics and Probability, Topic 4.1· 14 min read

1. Populations, Samples and Types of Data★☆☆☆☆⏱ 4 min

📘 Definition

Population and Sample

The population is the entire group you want to draw conclusions about. A sample is a subset of that population that you actually collect data from, because measuring the whole population is usually too expensive or impractical.

Example:

To find the average height of all 1200 students in a school (the population), you might measure only 60 of them (the sample).

We collect a sample because studying an entire population is often impossible. The key requirement is that the sample should be representative: it should reflect the whole population so that conclusions we make from the sample are trustworthy. A poorly chosen sample can mislead us even if all the arithmetic afterwards is correct.

📘 Definition

Discrete and Continuous Data

Discrete data can only take separate, countable values (often whole numbers). Continuous data can take any value within a range and comes from measuring on a scale.

Example:

Number of siblings (0, 1, 2, ...) is discrete; the time a runner takes to finish a race (12.47 s) is continuous.

Knowing whether data is discrete or continuous matters later on: it affects how you group data and which graphs are appropriate. For example, continuous data such as mass or time is usually grouped into class intervals, while discrete counts can be listed value by value.

Exam tip:

Discrete data take values from a countable set, even if some are fractions. Continuous data can take any real value in an interval, although recorded measurements are rounded.

2. The Five Sampling Methods★★☆☆☆⏱ 6 min

Simple random sampling uses random selection across the population. Stratified random sampling selects randomly within each stratum, and systematic sampling uses a random start. Convenience and quota sampling generally use non-random selection.

📘 Definition

Simple Random Sampling

Every possible sample of size has an equal chance of selection

In simple random sampling, every possible group of the required sample size has an equal chance of selection. Members are not selected independently when sampling without replacement.

Example:

Assign each of 1200 students a number 1-1200, then use a calculator's random number generator to pick 60 distinct numbers.

📘 Definition

Convenience Sampling

The sample is made up of the members who are easiest to access. It is quick and cheap but often unrepresentative and highly prone to bias.

Example:

Surveying only the students who happen to be in the library at lunchtime.

📘 Definition

Systematic Sampling

Order the population in a list, choose a random starting point, then select every k-th member, where k = population size divided by the desired sample size.

Example:

From a list of 1200 students, to get 60 you take every 20th student (since 1200 / 60 = 20), starting from a random position in the first 20.

📘 Definition

Quota Sampling

The population is split into groups and the researcher selects members non-randomly until a set quota for each group is filled.

Example:

An interviewer is told to survey 20 teenagers and 20 adults, and simply approaches people until each quota is reached.

📘 Definition

Stratified Sampling

, where is the stratum population, is the total population, and is the total sample size.

The population is divided into distinct subgroups (strata) and a number is randomly sampled from each stratum in proportion to the stratum's size in the population.

Example:

If a school is 60% girls and 40% boys, a stratified sample of 60 would contain 36 girls and 24 boys, each chosen randomly within their group.

📐 Worked Example

A school has 1200 students: 500 in the junior years and 700 in the senior years. A stratified sample of 60 students is to be taken. How many should be selected from each group?

  1. 1

    Find the sampling fraction: the sample size divided by the population size.

  2. 2
    601200=120\frac{60}{1200} = \frac{1}{20}
  3. 3

    Apply this fraction to each stratum to keep the sample proportional:

  4. 4
    Junior: 500×120=25;Senior: 700×120=35\text{Junior: } 500 \times \tfrac{1}{20} = 25; \quad \text{Senior: } 700 \times \tfrac{1}{20} = 35
  5. 5

    Check the parts add to the total sample: 25 + 35 = 60. So select 25 juniors and 35 seniors, each at random within their group.

Exam tip:

When asked to name the sampling method from a description, look for the trigger phrase: 'every 10th' means systematic, 'proportional to group size' means stratified, 'until we had enough of each type' means quota, and 'whoever was nearby' means convenience.

3. Reliability, Sampling Bias and Outliers★★☆☆☆⏱ 4 min

📘 Definition

Sampling Bias

Sampling bias occurs when the way a sample is chosen makes some members of the population more likely to be included than others, so the sample does not represent the population. Biased samples lead to misleading conclusions.

Example:

Asking only gym members whether people exercise regularly will overestimate exercise levels in the whole town.

Closely linked to bias is the reliability of a data source. When judging whether data can be trusted, ask: Who collected it and might they be biased? How large was the sample? How was the sample selected? A large, well-chosen sample from a neutral source is far more reliable than a small, self-selected one from an interested party.

📘 Definition

Outlier

or

An outlier is a value below or above , where . It may be a genuine extreme observation or an error; investigate its context.

Example:

In the ages 12, 13, 12, 14, 13, 65, the value 65 is an outlier. Check the original records and who was included to determine whether it is a genuine age or a recording error.

When you spot an outlier, do not automatically delete it. First consider its cause: if it is clearly an error (a typo, a faulty instrument) it may be reasonable to remove or correct it, but if it is a genuine observation it should be kept, since it may carry important information. Always state your reasoning rather than removing values silently.

Exam tip:

If a question asks you to 'comment' on a survey, mention the sampling method, whether the sample size is adequate, and any reason the source might be biased. One clear sentence on each usually earns the marks.

4. Common Pitfalls

Wrong move:

Confusing systematic sampling with simple random sampling

Why:

Both use a random element, so students assume they are the same, but systematic sampling only randomises the starting point, not every choice

Correct move:

State that systematic sampling picks every k-th member from an ordered list, with only the start chosen randomly

Wrong move:

Rounding stratum sizes so the parts no longer add to the total sample size

Why:

Careless rounding of each stratum independently can make the totals disagree with the required sample size

Correct move:

Use the sampling fraction consistently and check that all stratum sizes add up to the required total

Wrong move:

Assuming a large sample automatically removes bias

Why:

Size and bias are different issues: a huge but self-selected sample is still biased

Correct move:

Judge bias by how the sample was selected, not just by how big it is

Wrong move:

Deleting any outlier automatically

Why:

Genuine extreme values carry real information and should not be discarded without reason

Correct move:

Investigate the cause first; only remove or correct an outlier if it is clearly an error, and state your reasoning

5. Quick Reference Cheatsheet

Sampling Method

How It Works

Main Advantage

Main Drawback

Simple random

Every member equally likely (random numbers)

Unbiased, fair

Needs a full list of the population

Convenience

Choose whoever is easiest to reach

Fast and cheap

Highly prone to bias

Systematic

Every k-th member of an ordered list

Simple and quick

Bias if the list has a repeating pattern

Quota

Fill fixed group quotas non-randomly

Ensures each group is present

Selection within groups is not random

Stratified

Random sample from each group in proportion

Representative of every subgroup

Needs known group sizes

Going deeper

What's Next

Sampling is the first step in any statistical study, so this sub-topic underpins everything else in Unit 4. Once you can collect a representative sample, the next stage is to summarise and display that data using measures of central tendency and spread and the standard data representations, and later to analyse relationships between variables through correlation and regression. Understanding where data comes from also helps you judge how far you can trust any statistical conclusion.

Finished the guide? Put it into practice.

Choose your course to revise with illustrated notes and concept cards, then test what you know with a quiz.

Choose your course and start learning