What to Know About 2B: Sampling Bias

learning GOALS

At the end of this page, you should feel comfortable performing these skills:

  • Define sample vs. population.
  • Identify the different sampling methods.

In the previous section, Random Sampling, you learned that some sampling methods were biased, and can produced samples unrepresentative of the population from which they are selected. In the next activity, you will need to be able to distinguish between a sample and a population and identify different sampling methods. Prepare for that now by formally defining the population and sample, then learning about four common sampling methods.

Sampling Methods

In a moment, you’ll learn about four sampling methods commonly used in research. It is important to note that not all statistical questions can be investigated using purely unbiased methods.  Therefore, acknowledging bias in the sampling method is crucial to interpreting the analysis. Before we introduce these methods, let’s formally define what we mean by populations and samples.

Population vs. Sample

In the previous section, Random Sampling, you identified populations and parameters from descriptions of studies. The population was the entire group of interest and the parameter was a numerical summary describing a characteristic of that group.

In real life, it is usually hard to collect data on an entire population. Therefore, samples are used in research studies to collect data to make inferences about a population. Collecting data from a sample is less time consuming and less costly than collecting data from an entire population.

Answer Questions 1 and 2 now to define the terms population and sample. 

Question 1

What is the entire group of individuals/animals/items that we want to draw conclusions about during a research study?

  1. a) Population
  2. b) Sample

question 2

What is the specific group of individuals/animals/items that we collect data from for a research study?

  1. a) Population
  2. b) Sample

Sampling Methods

There are four common sampling methods used in research. These sampling methods include: simple random sampling, systematic sampling, stratified sampling, and convenience sampling.

Simple Random Sampling: In simple random sampling, every sample of a given size has the same chance of being selected; this results in every individual of the population having an equal chance of being selected. Recall that random number generators are used to select samples. In the following figure, the random number generator selected numbers 24, 22, 27, 25, and 13, resulting in the highlighted individuals being selected for the sample.

[See the original DC page for how the images below need to convey the information]

A blue icon of a person's sillhouette1 A blue icon of a person's sillhouette2 A blue icon of a person's sillhouette3 A blue icon of a person's sillhouette4 A blue icon of a person's sillhouette5 A blue icon of a person's sillhouette6 A blue icon of a person's sillhouette7 A blue icon of a person's sillhouette8 A blue icon of a person's sillhouette9
A blue icon of a person's sillhouette10 A blue icon of a person's sillhouette11 A blue icon of a person's sillhouette12 A blue icon of a person's sillhouette13 A blue icon of a person's sillhouette14 A blue icon of a person's sillhouette15 A blue icon of a person's sillhouette16 A blue icon of a person's sillhouette17 A blue icon of a person's sillhouette18
A blue icon of a person's sillhouette19 A blue icon of a person's sillhouette20 A blue icon of a person's sillhouette21 A blue icon of a person's sillhouette22 A blue icon of a person's sillhouette23 A blue icon of a person's sillhouette24 A blue icon of a person's sillhouette25 A blue icon of a person's sillhouette26 A blue icon of a person's sillhouette27

Video Placement

Simple Random Sampling – a very brief demonstration

Systematic Sampling: In systematic sampling, every individual in the population is given a number and individuals are chosen at regular intervals, with a random starting point (usually among the first several). The following figure illustrates a systematic sample where every 4th individual is selected, starting at the 3rd individual (starting point selected at random). The individuals selected for the sample are highlighted.

A blue icon of a person's sillhouette

1

A blue icon of a person's sillhouette

2

A blue icon of a person's sillhouette

3

A blue icon of a person's sillhouette

4

A blue icon of a person's sillhouette

5

A blue icon of a person's sillhouette

6

A blue icon of a person's sillhouette

7

A blue icon of a person's sillhouette

8

A blue icon of a person's sillhouette

9

A blue icon of a person's sillhouette

10

A blue icon of a person's sillhouette

11

A blue icon of a person's sillhouette

12

A blue icon of a person's sillhouette

13

A blue icon of a person's sillhouette

14

A blue icon of a person's sillhouette

15

A blue icon of a person's sillhouette

16

A blue icon of a person's sillhouette

17

A blue icon of a person's sillhouette

18

A blue icon of a person's sillhouette

19

A blue icon of a person's sillhouette

20

A blue icon of a person's sillhouette

21

A blue icon of a person's sillhouette

22

A blue icon of a person's sillhouette

23

A blue icon of a person's sillhouette

24

A blue icon of a person's sillhouette

25

A blue icon of a person's sillhouette

26

A blue icon of a person's sillhouette

27

Video Placement

Systematic Sampling – a very brief demonstration

Stratified Sampling: In stratified sampling, a population is divided into two or more groups (called strata) according to some criterion (i.e., geographic location, grade level, age group, income group, etc.), and a sample is selected from each strata using simple random sampling or systematic sampling.

A blue icon of a person's sillhouette

1

A blue icon of a person's sillhouette

2

A blue icon of a person's sillhouette

3

A blue icon of a person's sillhouette

4

A blue icon of a person's sillhouette

5

A blue icon of a person's sillhouette

6

A blue icon of a person's sillhouette

7

A blue icon of a person's sillhouette

8

A blue icon of a person's sillhouette

9

A blue icon of a person's sillhouette

10

A blue icon of a person's sillhouette

11

A blue icon of a person's sillhouette

12

A blue icon of a person's sillhouette

13

A blue icon of a person's sillhouette

14

A blue icon of a person's sillhouette

15

A blue icon of a person's sillhouette

16

A blue icon of a person's sillhouette

17

A blue icon of a person's sillhouette

18

A green icon of a person's sillhouette

1

A green icon of a person's sillhouette

2

A green icon of a person's sillhouette

3

A green icon of a person's sillhouette

4

A green icon of a person's sillhouette

5

A green icon of a person's sillhouette

6

A green icon of a person's sillhouette

7

A green icon of a person's sillhouette

8

A green icon of a person's sillhouette

9

A green icon of a person's sillhouette

10

A green icon of a person's sillhouette

11

A green icon of a person's sillhouette

12

A green icon of a person's sillhouette

13

A green icon of a person's sillhouette

14

A green icon of a person's sillhouette

15

A green icon of a person's sillhouette

16

A green icon of a person's sillhouette

17

A green icon of a person's sillhouette

18

Video Placement

Stratified Sampling – a very brief demonstration

Convenience Sampling: A convenience sample is a sample of individuals who are most accessible to the researcher. A convenience sample is usually not random or representative of the population. This is an example of a biased sampling method because it has a tendency to produce samples that are not representative of the population. For example, you take a sample of your friends because it is easy to collect information about them.

Video Placement

Convenience Sampling – a very brief demonstration

Identifying Sampling Methods

In Questions 3–7, you’ll read a brief description of a study, then identify the sampling method used. See the video below for a demonstration of how to differentiate between the methods in a description of a study.

Video Placement

[worked example: a 3-instructor video that offers examples of the four sampling methods and clues that will help distinguish which is being used.]

Let’s summarize key features of each of the four common sampling methods we discussed.

  • Simple random sampling assigns a number to every member of the population then uses a random number generator to select a sample.
  • Systematic sampling assigns a number to every member of the population then choses individuals from the population at regular intervals (e.g. every 4th individual from a randomly selected starting point).
  • Stratified sampling divides a population into groups via some criterion then uses simple random selection or systematic selection to collect a sample from each group.
  • Convenience sampling selects a sample most accessible to the researcher.

Now you try the questions below. Be sure to check the feedback to assess your understanding.

question 3

3) A college instructor wants to know what students think of her teaching methods, so she surveys the 10 students who sit in the front row. What kind of sample is this?

  1. a) Stratified sample
  2. b) Simple random sample
  3. c) Convenience sample
  4. d) Systematic sample

question 4

4) At a high school assembly, you need to sample students to understand their views about the new school uniforms. You decide to group students by grade (9th, 10th, 11th, and 12th) and then sample students within each grade using a random number generator. What kind of sample is this?

  1. a) Stratified sample
  2. b) Simple random sample
  3. c) Convenience sample
  4. d) Systematic sample

question 5

5) A research team wants to determine the GPA of college students at a university. The team samples 20 students at random from each of the following majors: English, Science, Computer Science, Engineering, Math, and Fine Arts. What kind of sample is this?

  1. a) Stratified sample
  2. b) Simple random sample
  3. c) Convenience sample
  4. d) Systematic sample

question 6

6) A company that makes hand sanitizer is interested in understanding the work/life balance culture of the company from the perspective of the employees. Each employee is assigned a number in the company database from 1 to 1,200. A random number generator is used to select 75 numbers, and the employees with those numbers are asked to take part in a focus group. What kind of sample is this?

  1. a) Stratified sample
  2. b) Simple random sample
  3. c) Convenience sample
  4. d) Systematic sample

question 7

7) The same hand sanitizer company is interested in conducting focus groups of employees to better understand the work/life balance culture of the company. They decided to create a list in alphabetical order of all their employees by their last name. Then, they select a sample of employees by selecting every 8th person on the list for the sample. What kind of sample is this?

  1. a) Stratified sample
  2. b) Simple random sample
  3. c) Convenience sample
  4. d) Systematic sample

Summary

In this What to Know page, you defined the terms population and sample to understand that in statistics, data is collected on a sample drawn from a population because it is often impossible due to time and financial constraints to collect data on an entire population.  You also learned to identify four common sampling methods and saw that convenience sampling is usually a biased method. Let’s summarize where these concepts appeared in the questions for this page.

  • In Questions 1 – 2, you defined sample vs. population.
  • In Questions 3 – 7, you identified the 4 different common sampling methods.

Hopefully, you have a basic understanding of these ideas now. You can come back to this page any time to refresh the definitions and methods. Now it’s time to move on to Forming Connections!