{"id":75,"date":"2018-05-16T14:13:29","date_gmt":"2018-05-16T14:13:29","guid":{"rendered":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/chapter\/sampling\/"},"modified":"2018-05-16T20:10:22","modified_gmt":"2018-05-16T20:10:22","slug":"sampling","status":"publish","type":"chapter","link":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/chapter\/sampling\/","title":{"raw":"Chapter 7: Sampling","rendered":"Chapter 7: Sampling"},"content":{"raw":"<div id=\"navbar-top\" class=\"navbar\">\r\n<div class=\"navbar-part left\"><\/div>\r\n<div class=\"navbar-part right\">\r\n\r\n&nbsp;\r\n\r\n<\/div>\r\n<\/div>\r\n<div id=\"book-content\">\r\n<div id=\"blackstone_1.0-ch07\" class=\"chapter\" xml:lang=\"en\">\r\n<h1 class=\"title editable block\"><span class=\"title-prefix\">Chapter 7<\/span> Sampling<\/h1>\r\n<div id=\"blackstone_1.0-ch07_s00\" class=\"section\">\r\n<h2 class=\"title editable block\">Who or What?<\/h2>\r\n<p id=\"blackstone_1.0-ch07_s00_p01\" class=\"para editable block\">Remember back in <a class=\"xref\" href=\"blackstone_1.0-ch01#blackstone_1.0-ch01\">Chapter 1 \"Introduction\"<\/a> when we saw the cute photo of the babies hanging out together and one of them was wearing a green onesie? I mentioned there that if we were to conclude that all babies wore green based on the photo that we would have committed selective observation. In that example of informal observation, our sampling strategy (just observing the baby in green) was of course faulty, but we nevertheless would have engaged in sampling. Sampling has to do with selecting some subset of one\u2019s group of interest (in this case, babies) and drawing conclusions from that subset. How we sample and who we sample shapes what sorts of conclusions we are able to draw. Ultimately, this chapter focuses on questions about the who or the what that you want to be able to make claims about in your research. In the following sections we\u2019ll define sampling, discuss different types of sampling strategies, and consider how to judge the quality of samples as consumers of social scientific research.<\/p>\r\n\r\n<\/div>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s01\" class=\"section\" xml:lang=\"en\">\r\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.1<\/span> Populations Versus Samples<\/h2>\r\n<div id=\"blackstone_1.0-ch07_s01_n01\" class=\"learning_objectives editable block\">\r\n<h3 class=\"title\">Learning Objective<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s01_l01\" class=\"orderedlist\">\r\n \t<li>Understand the difference between populations and samples.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s01_p01\" class=\"para editable block\">When I teach research methods, my students are sometimes disheartened to discover that the research projects they complete during the course will not make it possible for them to make sweeping claims about \u201call\u201d of whomever it is that they\u2019re interested in studying. What they fail to realize, however, is that they are not alone. One of the most surprising and frustrating lessons research methods students learn is that there is a difference between one\u2019s population of interest and one\u2019s study sample. While there are certainly exceptions, more often than not a researcher\u2019s population and her or his sample are not the same.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s01_p02\" class=\"para editable block\">In social scientific research, a <span class=\"margin_term\"><a class=\"glossterm\">population<\/a><span class=\"glossdef\">The group (be it people, events, etc.) that you want to be able to draw conclusions about at the end of your study.<\/span><\/span> is the cluster of people, events, things, or other phenomena that you are most interested in; it is often the \u201cwho\u201d or \u201cwhat\u201d that you want to be able to say something about at the end of your study. Populations in research may be rather large, such as \u201cthe American people,\u201d but they are more typically a little less vague than that. For example, a large study for which the population of interest really is the American people will likely specify which American people, such as adults over the age of 18 or citizens or legal residents. A <span class=\"margin_term\"><a class=\"glossterm\">sample<\/a><span class=\"glossdef\">The group (be it people, events, etc.) from which you actually collect data.<\/span><\/span>, on the other hand, is the cluster of people or events, for example, from or about which you will actually gather data. Some sampling strategies allow researchers to make claims about populations that are much larger than their actually sample with a fair amount of confidence. Other sampling strategies are designed to allow researchers to make theoretical contributions rather than to make sweeping claims about large populations. We\u2019ll discuss both types of strategies later in this chapter.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s01_p03\" class=\"para editable block\">As I\u2019ve now said a couple of times, it is quite rare for a researcher to gather data from their entire population of interest. This might sound surprising or disappointing until you think about the kinds of research questions that sociologists typically ask. For example, let\u2019s say we wish to answer the following research question: \u201cHow do men\u2019s and women\u2019s college experiences differ, and how are they similar?\u201d Would you expect to be able to collect data from all college students across all nations from all historical time periods? Unless you plan to make answering this research question your entire life\u2019s work (and then some), I\u2019m guessing your answer is a resounding no way. So what to do? Does not having the time or resources to gather data from every single person of interest mean having to give up your research interest? Absolutely not. It just means having to make some hard choices about sampling, and then being honest with yourself and your readers about the limitations of your study based on the sample from whom you were able to actually collect data.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s01_p04\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Sampling<\/a><span class=\"glossdef\">The process of selecting observations that will be analyzed for research purposes.<\/span><\/span> is the process of selecting observations that will be analyzed for research purposes. Both qualitative and quantitative researchers use sampling techniques to help them identify the what or whom from which they will collect their observations. Because the goals of qualitative and quantitative research differ, however, so, too, do the sampling procedures of the researchers employing these methods. First, we examine sampling types and techniques used in qualitative research. After that, we\u2019ll look at how sampling typically works in quantitative research.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s01_n02\" class=\"key_takeaways editable block\">\r\n<h3 class=\"title\">Key Takeaways<\/h3>\r\n<ul id=\"blackstone_1.0-ch07_s01_l02\" class=\"itemizedlist\">\r\n \t<li>A population is the group that is the main focus of a researcher\u2019s interest; a sample is the group from whom the researcher actually collects data.<\/li>\r\n \t<li>Populations and samples might be one and the same, but more often they are not.<\/li>\r\n \t<li>Sampling involves selecting the observations that you will analyze.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s01_n03\" class=\"exercises editable block\">\r\n<h3 class=\"title\">Exercises<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s01_l03\" class=\"orderedlist\">\r\n \t<li>Read through the methods section of a couple of scholarly articles describing empirical research. How do the authors talk about their populations and samples, if at all? What do the articles\u2019 abstracts suggest in terms of whom conclusions are being drawn about?<\/li>\r\n \t<li>Think of a research project you have envisioned conducting as you\u2019ve read this text. Would your population and sample be one and the same, or would they differ somehow? Explain.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s02\" class=\"section\" xml:lang=\"en\">\r\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.2<\/span> Sampling in Qualitative Research<\/h2>\r\n<div id=\"blackstone_1.0-ch07_s02_n01\" class=\"learning_objectives editable block\">\r\n<h3 class=\"title\">Learning Objectives<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s02_l01\" class=\"orderedlist\">\r\n \t<li>Define nonprobability sampling, and describe instances in which a researcher might choose a nonprobability sampling technique.<\/li>\r\n \t<li>Describe the different types of nonprobability samples.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s02_p01\" class=\"para editable block\">Qualitative researchers typically make sampling choices that enable them to deepen understanding of whatever phenomenon it is that they are studying. In this section we\u2019ll examine the strategies that qualitative researchers typically employ when sampling as well as the various types of samples that qualitative researchers are most likely to use in their work.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s02_s01\" class=\"section\">\r\n<h2 class=\"title editable block\">Nonprobability Sampling<\/h2>\r\n<p id=\"blackstone_1.0-ch07_s02_s01_p01\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Nonprobability sampling<\/a><span class=\"glossdef\">Sampling techniques for which a person\u2019s likelihood of being selected for membership in the sample is unknown.<\/span><\/span> refers to sampling techniques for which a person\u2019s (or event\u2019s or researcher\u2019s focus\u2019s) likelihood of being selected for membership in the sample is unknown. Because we don\u2019t know the likelihood of selection, we don\u2019t know with nonprobability samples whether a sample represents a larger population or not. But that\u2019s OK, because representing the population is not the goal with nonprobability samples. That said, the fact that nonprobability samples do not represent a larger population does not mean that they are drawn arbitrarily or without any specific purpose in mind (once again, that would mean committing one of the errors of informal inquiry discussed in <a class=\"xref\" href=\"blackstone_1.0-ch01#blackstone_1.0-ch01\">Chapter 1 \"Introduction\"<\/a>). In the following subsection, \u201cTypes of Nonprobability Samples,\u201d we\u2019ll take a closer look at the process of selecting research <span class=\"margin_term\"><a class=\"glossterm\">elements<\/a><span class=\"glossdef\">The individual unit that is the focus of a researcher\u2019s investigation; possible elements in social science include people, documents, organizations, groups, beliefs, or behaviors.<\/span><\/span> when drawing a nonprobability sample. But first, let\u2019s consider why a researcher might choose to use a nonprobability sample.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s01_p02\" class=\"para editable block\">So when are nonprobability samples ideal? One instance might be when we\u2019re designing a research project. For example, if we\u2019re conducting survey research, we may want to administer our survey to a few people who seem to resemble the folks we\u2019re interested in studying in order to help work out kinks in the survey. We might also use a nonprobability sample at the early stages of a research project, if we\u2019re conducting a pilot study or some exploratory research. This can be a quick way to gather some initial data and help us get some idea of the lay of the land before conducting a more extensive study. From these examples, we can see that nonprobability samples can be useful for setting up, framing, or beginning research. But it isn\u2019t just early stage research that relies on and benefits from nonprobability sampling techniques.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s01_p03\" class=\"para editable block\">Researchers also use nonprobability samples in full-blown research projects. These projects are usually qualitative in nature, where the researcher\u2019s goal is in-depth, idiographic understanding rather than more general, nomothetic understanding. Evaluation researchers whose aim is to describe some very specific small group might use nonprobability sampling techniques, for example. Researchers interested in contributing to our theoretical understanding of some phenomenon might also collect data from nonprobability samples. Maren Klawiter (1999)<span id=\"blackstone_1.0-fn07_001\" class=\"footnote\">Klawiter, M. (1999). Racing for the cure, walking women, and toxic touring: Mapping cultures of action within the Bay Area terrain of breast cancer. <em class=\"emphasis\">Social Problems, 46<\/em>, 104\u2013126.<\/span> relied on a nonprobability sample for her study of the role that culture plays in shaping social change. Klawiter conducted participant observation in three very different breast cancer organizations to understand \u201cthe bodily dimensions of cultural production and collective action.\u201d Her intensive study of these three organizations allowed Klawiter to deeply understand each organization\u2019s \u201cculture of action\u201d and, subsequently, to critique and contribute to broader theories of social change and social movement organization. Thus researchers interested in contributing to social theories, by either expanding on them, modifying them, or poking holes in their propositions, may use nonprobability sampling techniques to seek out cases that seem anomalous in order to understand how theories can be improved.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s01_p04\" class=\"para editable block\">In sum, there are a number and variety of instances in which the use of nonprobability samples makes sense. We\u2019ll examine several specific types of nonprobability samples in the next subsection.<\/p>\r\n\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s02_s02\" class=\"section\">\r\n<h2 class=\"title editable block\">Types of Nonprobability Samples<\/h2>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p01\" class=\"para editable block\">There are several types of nonprobability samples that researchers use. These include purposive samples, snowball samples, quota samples, and convenience samples. While the latter two strategies may be used by quantitative researchers from time to time, they are more typically employed in qualitative research, and because they are both nonprobability methods, we include them in this section of the chapter.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p02\" class=\"para editable block\">To draw a <span class=\"margin_term\"><a class=\"glossterm\">purposive sample<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher seeks out particular study elements that meet specific criteria that the researcher has identified.<\/span><\/span>, a researcher begins with specific perspectives in mind that he or she wishes to examine and then seeks out research participants who cover that full range of perspectives. For example, if you are studying students\u2019 satisfaction with their living quarters on campus, you\u2019ll want to be sure to include students who stay in each of the different types or locations of on-campus housing in your study. If you only include students from 1 of 10 dorms on campus, you may miss important details about the experiences of students who live in the 9 dorms you didn\u2019t include in your study. In my own interviews of young people about their workplace sexual harassment experiences, I and my coauthors used a purposive sampling strategy; we used participants\u2019 prior responses on a survey to ensure that we included both men and women in the interviews and that we included participants who\u2019d had a range of harassment experiences, from relatively minor experiences to much more severe harassment.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p03\" class=\"para editable block\">While purposive sampling is often used when one\u2019s goal is to include participants who represent a broad range of perspectives, purposive sampling may also be used when a researcher wishes to include only people who meet very narrow or specific criteria. For example, in their study of Japanese women\u2019s perceptions of intimate partner violence, Miyoko Nagae and Barbara L. Dancy (2010)<span id=\"blackstone_1.0-fn07_002\" class=\"footnote\">Nagae, M., &amp; Dancy, B. L. (2010). Japanese women\u2019s perceptions of intimate partner violence (IPV). <em class=\"emphasis\">Journal of Interpersonal Violence, 25<\/em>, 753\u2013766.<\/span> limited their study only to participants who had experienced intimate partner violence themselves, were at least 18 years old, had been married and living with their spouse at the time that the violence occurred, were heterosexual, and were willing to be interviewed. In this case, the researchers\u2019 goal was to find participants who had had very specific experiences rather than finding those who had had quite diverse experiences, as in the preceding example. In both cases, the researchers involved shared the goal of understanding the topic at hand in as much depth as possible.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p04\" class=\"para editable block\">Qualitative researchers sometimes rely on <span class=\"margin_term\"><a class=\"glossterm\">snowball sampling<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher recruits study participants by asking prior participants to refer others.<\/span><\/span> techniques to identify study participants. In this case, a researcher might know of one or two people she\u2019d like to include in her study but then relies on those initial participants to help identify additional study participants. Thus the researcher\u2019s sample builds and becomes larger as the study continues, much as a snowball builds and becomes larger as it rolls through the snow.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p05\" class=\"para editable block\">Snowball sampling is an especially useful strategy when a researcher wishes to study some stigmatized group or behavior. For example, a researcher who wanted to study how people with genital herpes cope with their medical condition would be unlikely to find many participants by posting a call for interviewees in the newspaper or making an announcement about the study at some large social gathering. Instead, the researcher might know someone with the condition, interview that person, and then be referred by the first interviewee to another potential subject. Having a previous participant vouch for the trustworthiness of the researcher may help new potential participants feel more comfortable about being included in the study.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p06\" class=\"para editable block\">Snowball sampling is sometimes referred to as chain referral sampling. One research participant refers another, and that person refers another, and that person refers another\u2014thus a chain of potential participants is identified. In addition to using this sampling strategy for potentially stigmatized populations, it is also a useful strategy to use when the researcher\u2019s group of interest is likely to be difficult to find, not only because of some stigma associated with the group, but also because the group may be relatively rare. This was the case for Steven M. Kogan and colleagues (Kogan, Wejnert, Chen, Brody, &amp; Slater, 2011)<span id=\"blackstone_1.0-fn07_003\" class=\"footnote\">Kogan, S. M., Wejnert, C., Chen, Y., Brody, G. H., &amp; Slater, L. M. (2011). Respondent-driven sampling with hard-to-reach emerging adults: An introduction and case study with rural African Americans. <em class=\"emphasis\">Journal of Adolescent Research, 26<\/em>, 30\u201360.<\/span> who wished to study the sexual behaviors of non-college-bound African American young adults who lived in high-poverty rural areas. The researchers first relied on their own networks to identify study participants, but because members of the study\u2019s target population were not easy to find, access to the networks of initial study participants was very important for identifying additional participants. Initial participants were given coupons to pass on to others they knew who qualified for the study. Participants were given an added incentive for referring eligible study participants; they received not only $50.00 for participating in the study but also $20.00 for each person they recruited who also participated in the study. Using this strategy, Kogan and colleagues succeeded in recruiting 292 study participants.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p07\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Quota sampling<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher identifies subgroups within a population of interest and then selects some predetermined number of elements from within each subgroup.<\/span><\/span> is another nonprobability sampling strategy. This type of sampling is actually employed by both qualitative and quantitative researchers, but because it is a nonprobability method, we\u2019ll discuss it in this section. When conducting quota sampling, a researcher identifies categories that are important to the study and for which there is likely to be some variation. Subgroups are created based on each category and the researcher decides how many people (or documents or whatever element happens to be the focus of the research) to include from each subgroup and collects data from that number for each subgroup.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p08\" class=\"para editable block\">Let\u2019s go back to the example we considered previously of student satisfaction with on-campus housing. Perhaps there are two types of housing on your campus: apartments that include full kitchens and dorm rooms where residents do not cook for themselves but eat in a dorm cafeteria. As a researcher, you might wish to understand how satisfaction varies across these two types of housing arrangements. Perhaps you have the time and resources to interview 20 campus residents, so you decide to interview 10 from each housing type. It is possible as well that your review of literature on the topic suggests that campus housing experiences vary by gender. If that is that case, perhaps you\u2019ll decide on four important subgroups: men who live in apartments, women who live in apartments, men who live in dorm rooms, and women who live in dorm rooms. Your quota sample would include five people from each subgroup.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p09\" class=\"para editable block\">In 1936, up-and-coming pollster George Gallup made history when he successfully predicted the outcome of the presidential election using quota sampling methods. The leading polling entity at the time, <em class=\"emphasis\">The Literary Digest<\/em>, predicted that Alfred Landon would beat Franklin Roosevelt in the presidential election by a landslide. When Gallup\u2019s prediction that Roosevelt would win, turned out to be correct, \u201cthe Gallup Poll was suddenly on the map\u201d (Van Allen, 2011).<span id=\"blackstone_1.0-fn07_004\" class=\"footnote\">Van Allen, S. (2011). Gallup corporate history. Retrieved from <a class=\"link\" href=\"http:\/\/www.gallup.com\/corporate\/1357\/Corporate-History.aspx#2\" target=\"_blank\" rel=\"noopener\">http:\/\/www.gallup.com\/corporate\/1357\/Corporate-History.aspx#2<\/a><\/span> Gallup successfully predicted subsequent elections based on quota samples, but in 1948, Gallup incorrectly predicted that Dewey would beat Truman in the US presidential election.<span id=\"blackstone_1.0-fn07_005\" class=\"footnote\">For more information about the 1948 election and other historically significant dates related to measurement, see the PBS timeline of \u201cThe first measured century\u201d at <a class=\"link\" href=\"http:\/\/www.pbs.org\/fmc\/timeline\/e1948election.htm\" target=\"_blank\" rel=\"noopener\">http:\/\/www.pbs.org\/fmc\/timeline\/e1948election.htm<\/a>.<\/span> Among other problems, the fact that Gallup\u2019s quota categories did not represent those who actually voted (Neuman, 2007)<span id=\"blackstone_1.0-fn07_006\" class=\"footnote\">Neuman, W. L. (2007). <em class=\"emphasis\">Basics of social research: Qualitative and quantitative approaches<\/em> (2nd ed.). Boston, MA: Pearson.<\/span> underscores the point that one should avoid attempting to make statistical generalizations from data collected using quota sampling methods.<span id=\"blackstone_1.0-fn07_007\" class=\"footnote\">If you are interested in the history of polling, I recommend a recent book: Fried, A. (2011). <em class=\"emphasis\">Pathways to polling: Crisis, cooperation, and the making of public opinion professions<\/em>. New York, NY: Routledge.<\/span> While quota sampling offers the strength of helping the researcher account for potentially relevant variation across study elements, it would be a mistake to think of this strategy as yielding statistically representative findings.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s02_s02_p10\" class=\"para editable block\">Finally, <span class=\"margin_term\"><a class=\"glossterm\">convenience sampling<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher gathers data from the elements that happen to be convenient; also referred to as haphazard sampling.<\/span><\/span> is another nonprobability sampling strategy that is employed by both qualitative and quantitative researchers. To draw a convenience sample, a researcher simply collects data from those people or other relevant elements to which he or she has most convenient access. This method, also sometimes referred to as haphazard sampling, is most useful in exploratory research. It is also often used by journalists who need quick and easy access to people from their population of interest. If you\u2019ve ever seen brief interviews of people on the street on the news, you\u2019ve probably seen a haphazard sample being interviewed. While convenience samples offer one major benefit\u2014convenience\u2014we should be cautious about generalizing from research that relies on convenience samples.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s02_s02_t01\" class=\"table block\">\r\n<p class=\"title\"><span class=\"title-prefix\">Table 7.1<\/span> Types of Nonprobability Samples<\/p>\r\n\r\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\r\n<thead>\r\n<tr>\r\n<th>Sample type<\/th>\r\n<th>Description<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>Purposive<\/td>\r\n<td>Researcher seeks out elements that meet specific criteria.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Snowball<\/td>\r\n<td>Researcher relies on participant referrals to recruit new participants.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Quota<\/td>\r\n<td>Researcher selects cases from within several different subgroups.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Convenience<\/td>\r\n<td>Researcher gathers data from whatever cases happen to be convenient.<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s02_s02_n01\" class=\"key_takeaways editable block\">\r\n<h3 class=\"title\">Key Takeaways<\/h3>\r\n<ul id=\"blackstone_1.0-ch07_s02_s02_l01\" class=\"itemizedlist\">\r\n \t<li>Nonprobability samples might be used when researchers are conducting exploratory research, by evaluation researchers, or by researchers whose aim is to make some theoretical contribution.<\/li>\r\n \t<li>There are several types of nonprobability samples including purposive samples, snowball samples, quota samples, and convenience samples.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s02_s02_n02\" class=\"exercises editable block\">\r\n<h3 class=\"title\">Exercises<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s02_s02_l02\" class=\"orderedlist\">\r\n \t<li>Imagine you are about to conduct a study of people\u2019s use of the public parks in your hometown. Explain how you could employ each of the nonprobability sampling techniques described previously to recruit a sample for your study.<\/li>\r\n \t<li>Of the four nonprobability sample types described, which seems strongest to you? Which seems weakest? Explain.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s03\" class=\"section\" xml:lang=\"en\">\r\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.3<\/span> Sampling in Quantitative Research<\/h2>\r\n<div id=\"blackstone_1.0-ch07_s03_n01\" class=\"learning_objectives editable block\">\r\n<h3 class=\"title\">Learning Objectives<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s03_l01\" class=\"orderedlist\">\r\n \t<li>Describe how probability sampling differs from nonprobability sampling.<\/li>\r\n \t<li>Define generalizability, and describe how it is achieved in probability samples.<\/li>\r\n \t<li>Identify the various types of probability samples, and provide a brief description of each.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s03_p01\" class=\"para editable block\">Quantitative researchers are often interested in being able to make generalizations about groups larger than their study samples. While there are certainly instances when quantitative researchers rely on nonprobability samples (e.g., when doing exploratory or evaluation research), quantitative researchers tend to rely on probability sampling techniques. The goals and techniques associated with probability samples differ from those of nonprobability samples. We\u2019ll explore those unique goals and techniques in this section.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s03_s01\" class=\"section\">\r\n<h2 class=\"title editable block\">Probability Sampling<\/h2>\r\n<p id=\"blackstone_1.0-ch07_s03_s01_p01\" class=\"para editable block\">Unlike nonprobability sampling, <span class=\"margin_term\"><a class=\"glossterm\">probability sampling<\/a><span class=\"glossdef\">Sampling techniques for which a person\u2019s likelihood of being selected for membership in the sample is known.<\/span><\/span> refers to sampling techniques for which a person\u2019s (or event\u2019s) likelihood of being selected for membership in the sample is known. You might ask yourself why we should care about a study element\u2019s likelihood of being selected for membership in a researcher\u2019s sample. The reason is that, in most cases, researchers who use probability sampling techniques are aiming to identify a <span class=\"margin_term\"><a class=\"glossterm\">representative sample<\/a><span class=\"glossdef\">A sample that resembles the population from which it was drawn in all the ways that are important for the research being conducted.<\/span><\/span> from which to collect data. A representative sample is one that resembles the population from which it was drawn in all the ways that are important for the research being conducted. If, for example, you wish to be able to say something about differences between men and women at the end of your study, you better make sure that your sample doesn\u2019t contain only women. That\u2019s a bit of an oversimplification, but the point with representativeness is that if your population varies in some way that is important to your study, your sample should contain the same sorts of variation.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s01_p02\" class=\"para editable block\">Obtaining a representative sample is important in probability sampling because a key goal of studies that rely on probability samples is <span class=\"margin_term\"><a class=\"glossterm\">generalizability<\/a><span class=\"glossdef\">The idea that a study\u2019s results will tell us something about a group larger than the sample from which the findings were generated.<\/span><\/span>. In fact, generalizability is perhaps the key feature that distinguishes probability samples from nonprobability samples. Generalizability refers to the idea that a study\u2019s results will tell us something about a group larger than the sample from which the findings were generated. In order to achieve generalizability, a core principle of probability sampling is that all elements in the researcher\u2019s target population have an equal chance of being selected for inclusion in the study. In research, this is the principle of <span class=\"margin_term\"><a class=\"glossterm\">random selection<\/a><span class=\"glossdef\">The principle that all elements in a researcher\u2019s target population have an equal chance of being selected for inclusion in the study.<\/span><\/span>. Random selection is a mathematical process that we won\u2019t go into too much depth about here, but if you have taken or plan to take a statistics course, you\u2019ll learn more about it there. The important thing to remember about random selection here is that, as previously noted, it is a core principal of probability sampling. If a researcher uses random selection techniques to draw a sample, he or she will be able to estimate how closely the sample represents the larger population from which it was drawn by estimating the sampling error. <span class=\"margin_term\"><a class=\"glossterm\">Sampling error<\/a><span class=\"glossdef\">The extent to which a sample represents its population on a particular parameter.<\/span><\/span> is a statistical calculation of the difference between results from a sample and the actual <span class=\"margin_term\"><a class=\"glossterm\">parameters<\/a><span class=\"glossdef\">The actual characteristics of a population on any given variable; determined by measuring all elements in a population (as opposed to measuring elements from a sample).<\/span><\/span> of a population.<\/p>\r\n\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s03_s02\" class=\"section\">\r\n<h2 class=\"title editable block\">Types of Probability Samples<\/h2>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p01\" class=\"para editable block\">There are a variety of probability samples that researchers may use. These include simple random samples, systematic samples, stratified samples, and cluster samples.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p02\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Simple random samples<\/a><span class=\"glossdef\">The most basic type of probability sample; a researcher begins with a list of every member of his or her population of interest, numbers each element sequentially, and then randomly selects the elements from which he or she will collect data.<\/span><\/span> are the most basic type of probability sample, but their use is not particularly common. Part of the reason for this may be the work involved in generating a simple random sample. To draw a simple random sample, a researcher starts with a list of every single member, or element, of his or her population of interest. This list is sometimes referred to as a <span class=\"margin_term\"><a class=\"glossterm\">sampling frame<\/a><span class=\"glossdef\">A list of all elements in a population.<\/span><\/span>. Once that list has been created, the researcher numbers each element sequentially and then randomly selects the elements from which he or she will collect data. To randomly select elements, researchers use a table of numbers that have been generated randomly. There are several possible sources for obtaining a random number table. Some statistics and research methods textbooks offer such tables as appendices to the text. Perhaps a more accessible source is one of the many free random number generators available on the Internet. A good online source is the website Stat Trek, which contains a random number generator that you can use to create a random number table of whatever size you might need (<a class=\"link\" href=\"http:\/\/stattrek.com\/Tables\/Random.aspx\" target=\"_blank\" rel=\"noopener\">http:\/\/stattrek.com\/Tables\/Random.aspx<\/a>). Randomizer.org also offers a useful random number generator (<a class=\"link\" href=\"http:\/\/randomizer.org\" target=\"_blank\" rel=\"noopener\">http:\/\/randomizer.org<\/a>).<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p03\" class=\"para editable block\">As you might have guessed, drawing a simple random sample can be quite tedious. <span class=\"margin_term\"><a class=\"glossterm\">Systematic sampling<\/a><span class=\"glossdef\">A researcher divides a study population into relevant subgroups then draws a sample from each subgroup.<\/span><\/span> techniques are somewhat less tedious but offer the benefits of a random sample. As with simple random samples, you must be able to produce a list of every one of your population elements. Once you\u2019ve done that, to draw a systematic sample you\u2019d simply select every <em class=\"emphasis\">k<\/em>th element on your list. But what is <em class=\"emphasis\">k<\/em>, and where on the list of population elements does one begin the selection process? <em class=\"emphasis\">k<\/em> is your <span class=\"margin_term\"><a class=\"glossterm\">selection interval<\/a><span class=\"glossdef\">The distance between elements selected for inclusion in a study.<\/span><\/span> or the distance between the elements you select for inclusion in your study. To begin the selection process, you\u2019ll need to figure out how many elements you wish to include in your sample. Let\u2019s say you want to interview 25 fraternity members on your campus, and there are 100 men on campus who are members of fraternities. In this case, your selection interval, or <em class=\"emphasis\">k<\/em>, is 4. To arrive at 4, simply divide the total number of population elements by your desired sample size. This process is represented in <a class=\"xref\" href=\"#blackstone_1.0-ch07_s03_s02_f02\">Figure 7.5 \"Formula for Determining Selection Interval for Systematic Sample\"<\/a>.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s03_s02_f02\" class=\"figure large editable block\">\r\n<p class=\"title\"><span class=\"title-prefix\">Figure 7.5<\/span> Formula for Determining Selection Interval for Systematic Sample<\/p>\r\n<img src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/3246\/2018\/05\/16141328\/ffba99f3272c4ab03383a3c484d2e046.jpg\" alt=\"image\" \/>\r\n\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p04\" class=\"para editable block\">To determine where on your list of population elements to begin selecting the names of the 25 men you will interview, select a random number between 1 and <em class=\"emphasis\">k<\/em>, and begin there. If we randomly select 3 as our starting point, we\u2019d begin by selecting the third fraternity member on the list and then select every fourth member from there. This might be easier to understand if you can see it visually. <a class=\"xref\" href=\"#blackstone_1.0-ch07_s03_s02_t01\">Table 7.2 \"Systematic Sample of 25 Fraternity Members\"<\/a> lists the names of our hypothetical 100 fraternity members on campus. You\u2019ll see that the third name on the list has been selected for inclusion in our hypothetical study, as has every fourth name after that. A total of 25 names have been selected.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s03_s02_t01\" class=\"table block\">\r\n<p class=\"title\"><span class=\"title-prefix\">Table 7.2<\/span> Systematic Sample of 25 Fraternity Members<\/p>\r\n\r\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\r\n<thead>\r\n<tr>\r\n<th>Number<\/th>\r\n<th>Name<\/th>\r\n<th>Include in study?<\/th>\r\n<th><\/th>\r\n<th>Number<\/th>\r\n<th>Name<\/th>\r\n<th>Include in study?<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>1<\/td>\r\n<td>Jacob<\/td>\r\n<td><\/td>\r\n<td rowspan=\"50\"><\/td>\r\n<td>51<\/td>\r\n<td>Blake<\/td>\r\n<td>Yes<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>2<\/td>\r\n<td>Ethan<\/td>\r\n<td><\/td>\r\n<td>52<\/td>\r\n<td>Oliver<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>3<\/td>\r\n<td>Michael<\/td>\r\n<td>Yes<\/td>\r\n<td>53<\/td>\r\n<td>Cole<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>4<\/td>\r\n<td>Jayden<\/td>\r\n<td><\/td>\r\n<td>54<\/td>\r\n<td>Carlos<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>5<\/td>\r\n<td>William<\/td>\r\n<td><\/td>\r\n<td>55<\/td>\r\n<td>Jaden<\/td>\r\n<td>Yes<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>6<\/td>\r\n<td>Alexander<\/td>\r\n<td><\/td>\r\n<td>56<\/td>\r\n<td>Jesus<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>7<\/td>\r\n<td>Noah<\/td>\r\n<td>Yes<\/td>\r\n<td>57<\/td>\r\n<td>Alex<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>8<\/td>\r\n<td>Daniel<\/td>\r\n<td><\/td>\r\n<td>58<\/td>\r\n<td>Aidan<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>9<\/td>\r\n<td>Aiden<\/td>\r\n<td><\/td>\r\n<td>59<\/td>\r\n<td>Eric<\/td>\r\n<td>Yes<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>10<\/td>\r\n<td>Anthony<\/td>\r\n<td><\/td>\r\n<td>60<\/td>\r\n<td>Hayden<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>11<\/td>\r\n<td>Joshua<\/td>\r\n<td>Yes<\/td>\r\n<td>61<\/td>\r\n<td>Brian<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>12<\/td>\r\n<td>Mason<\/td>\r\n<td><\/td>\r\n<td>62<\/td>\r\n<td>Max<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>13<\/td>\r\n<td>Christopher<\/td>\r\n<td><\/td>\r\n<td>63<\/td>\r\n<td>Jaxon<\/td>\r\n<td>Yes<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>14<\/td>\r\n<td>Andrew<\/td>\r\n<td><\/td>\r\n<td>64<\/td>\r\n<td>Brian<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s03_s02_t11\" class=\"informaltable editable block\">\r\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\r\n<thead>\r\n<tr>\r\n<th>Number<\/th>\r\n<th>Name<\/th>\r\n<th>Include in study?<\/th>\r\n<th><\/th>\r\n<th>Number<\/th>\r\n<th>Name<\/th>\r\n<th>Include in study?<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>15<\/td>\r\n<td>David<\/td>\r\n<td>Yes<\/td>\r\n<td>65<\/td>\r\n<td>Matthew<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>16<\/td>\r\n<td>Logan<\/td>\r\n<td><\/td>\r\n<td>66<\/td>\r\n<td>Elijah<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>17<\/td>\r\n<td>James<\/td>\r\n<td><\/td>\r\n<td>67<\/td>\r\n<td>Joseph<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>18<\/td>\r\n<td>Gabriel<\/td>\r\n<td><\/td>\r\n<td>68<\/td>\r\n<td>Benjamin<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>19<\/td>\r\n<td>Ryan<\/td>\r\n<td>Yes<\/td>\r\n<td>69<\/td>\r\n<td>Samuel<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>20<\/td>\r\n<td>Jackson<\/td>\r\n<td><\/td>\r\n<td>70<\/td>\r\n<td>John<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>21<\/td>\r\n<td>Nathan<\/td>\r\n<td><\/td>\r\n<td>71<\/td>\r\n<td>Jonathan<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>22<\/td>\r\n<td>Christian<\/td>\r\n<td><\/td>\r\n<td>72<\/td>\r\n<td>Liam<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>23<\/td>\r\n<td>Dylan<\/td>\r\n<td>Yes<\/td>\r\n<td>73<\/td>\r\n<td>Landon<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>24<\/td>\r\n<td>Caleb<\/td>\r\n<td><\/td>\r\n<td>74<\/td>\r\n<td>Tyler<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>25<\/td>\r\n<td>Lucas<\/td>\r\n<td><\/td>\r\n<td>75<\/td>\r\n<td>Evan<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>26<\/td>\r\n<td>Gavin<\/td>\r\n<td><\/td>\r\n<td>76<\/td>\r\n<td>Nicholas<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>27<\/td>\r\n<td>Isaac<\/td>\r\n<td>Yes<\/td>\r\n<td>77<\/td>\r\n<td>Braden<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>28<\/td>\r\n<td>Luke<\/td>\r\n<td><\/td>\r\n<td>78<\/td>\r\n<td>Angel<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>29<\/td>\r\n<td>Brandon<\/td>\r\n<td><\/td>\r\n<td>79<\/td>\r\n<td>Jack<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>30<\/td>\r\n<td>Isaiah<\/td>\r\n<td><\/td>\r\n<td>80<\/td>\r\n<td>Jordan<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>31<\/td>\r\n<td>Owen<\/td>\r\n<td>Yes<\/td>\r\n<td>81<\/td>\r\n<td>Carter<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>32<\/td>\r\n<td>Conner<\/td>\r\n<td><\/td>\r\n<td>82<\/td>\r\n<td>Justin<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>33<\/td>\r\n<td>Jose<\/td>\r\n<td><\/td>\r\n<td>83<\/td>\r\n<td>Jeremiah<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>34<\/td>\r\n<td>Julian<\/td>\r\n<td><\/td>\r\n<td>84<\/td>\r\n<td>Robert<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>35<\/td>\r\n<td>Aaron<\/td>\r\n<td>Yes<\/td>\r\n<td>85<\/td>\r\n<td>Adrian<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>36<\/td>\r\n<td>Wyatt<\/td>\r\n<td><\/td>\r\n<td>86<\/td>\r\n<td>Kevin<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>37<\/td>\r\n<td>Hunter<\/td>\r\n<td><\/td>\r\n<td>87<\/td>\r\n<td>Cameron<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>38<\/td>\r\n<td>Zachary<\/td>\r\n<td><\/td>\r\n<td>88<\/td>\r\n<td>Thomas<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>39<\/td>\r\n<td>Charles<\/td>\r\n<td>Yes<\/td>\r\n<td>89<\/td>\r\n<td>Austin<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>40<\/td>\r\n<td>Eli<\/td>\r\n<td><\/td>\r\n<td>90<\/td>\r\n<td>Chase<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>41<\/td>\r\n<td>Henry<\/td>\r\n<td><\/td>\r\n<td>91<\/td>\r\n<td>Sebastian<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>42<\/td>\r\n<td>Jason<\/td>\r\n<td><\/td>\r\n<td>92<\/td>\r\n<td>Levi<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>43<\/td>\r\n<td>Xavier<\/td>\r\n<td>Yes<\/td>\r\n<td>93<\/td>\r\n<td>Ian<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>44<\/td>\r\n<td>Colton<\/td>\r\n<td><\/td>\r\n<td>94<\/td>\r\n<td>Dominic<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>45<\/td>\r\n<td>Juan<\/td>\r\n<td><\/td>\r\n<td>95<\/td>\r\n<td>Cooper<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>46<\/td>\r\n<td>Josiah<\/td>\r\n<td><\/td>\r\n<td>96<\/td>\r\n<td>Luis<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>47<\/td>\r\n<td>Ayden<\/td>\r\n<td>Yes<\/td>\r\n<td>97<\/td>\r\n<td>Carson<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>48<\/td>\r\n<td>Adam<\/td>\r\n<td><\/td>\r\n<td>98<\/td>\r\n<td>Nathaniel<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>49<\/td>\r\n<td>Brody<\/td>\r\n<td><\/td>\r\n<td>99<\/td>\r\n<td>Tristan<\/td>\r\n<td>Yes<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>50<\/td>\r\n<td>Diego<\/td>\r\n<td><\/td>\r\n<td>100<\/td>\r\n<td>Parker<\/td>\r\n<td><\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<tfoot>\r\n<tr>\r\n<th colspan=\"7\"><em class=\"emphasis\">Note:<\/em> In case you\u2019re wondering how I came up with 100 unique names for this table, I\u2019ll let you in on a little secret: lists of popular baby names can be great resources for researchers. I used the list of top 100 names for boys based on Social Security Administration statistics for this table. I often use baby name lists to come up with pseudonyms for field research subjects and interview participants. See Family Education. (n.d.). Name lab. Retrieved from <a class=\"link\" href=\"http:\/\/baby-names.familyeducation.com\/popular-names\/boys\" target=\"_blank\" rel=\"noopener\">http:\/\/baby-names.familyeducation.com\/popular-names\/boys<\/a>.<\/th>\r\n<\/tr>\r\n<\/tfoot>\r\n<\/table>\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p05\" class=\"para editable block\">There is one clear instance in which systematic sampling should not be employed. If your sampling frame has any pattern to it, you could inadvertently introduce bias into your sample by using a systemic sampling strategy. This is sometimes referred to as the problem of <span class=\"margin_term\"><a class=\"glossterm\">periodicity<\/a><span class=\"glossdef\">The tendency for a pattern to occur at regular intervals.<\/span><\/span>. Periodicity refers to the tendency for a pattern to occur at regular intervals. Let\u2019s say, for example, that you wanted to observe how people use the outdoor public spaces on your campus. Perhaps you need to have your observations completed within 28 days and you wish to conduct four observations on randomly chosen days. <a class=\"xref\" href=\"#blackstone_1.0-ch07_s03_s02_t02\">Table 7.3 \"Systematic Sample of Observation Days\"<\/a> shows a list of the population elements for this example. To determine which days we\u2019ll conduct our observations, we\u2019ll need to determine our selection interval. As you\u2019ll recall from the preceding paragraphs, to do so we must divide our population size, in this case 28 days, by our desired sample size, in this case 4 days. This formula leads us to a selection interval of 7. If we randomly select 2 as our starting point and select every seventh day after that, we\u2019ll wind up with a total of 4 days on which to conduct our observations. You\u2019ll see how that works out in the following table.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s03_s02_t02\" class=\"table block\">\r\n<p class=\"title\"><span class=\"title-prefix\">Table 7.3<\/span> Systematic Sample of Observation Days<\/p>\r\n\r\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\r\n<thead>\r\n<tr>\r\n<th>Number<\/th>\r\n<th>Day<\/th>\r\n<th>Include in study?<\/th>\r\n<th><\/th>\r\n<th>Number<\/th>\r\n<th>Day<\/th>\r\n<th>Include in study?<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>1<\/td>\r\n<td>Monday<\/td>\r\n<td><\/td>\r\n<td rowspan=\"14\"><\/td>\r\n<td>15<\/td>\r\n<td>Monday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>2<\/td>\r\n<td>Tuesday<\/td>\r\n<td>Yes<\/td>\r\n<td>16<\/td>\r\n<td>Tuesday<\/td>\r\n<td>Yes<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>3<\/td>\r\n<td>Wednesday<\/td>\r\n<td><\/td>\r\n<td>17<\/td>\r\n<td>Wednesday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>4<\/td>\r\n<td>Thursday<\/td>\r\n<td><\/td>\r\n<td>18<\/td>\r\n<td>Thursday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>5<\/td>\r\n<td>Friday<\/td>\r\n<td><\/td>\r\n<td>19<\/td>\r\n<td>Friday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>6<\/td>\r\n<td>Saturday<\/td>\r\n<td><\/td>\r\n<td>20<\/td>\r\n<td>Saturday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>7<\/td>\r\n<td>Sunday<\/td>\r\n<td><\/td>\r\n<td>21<\/td>\r\n<td>Sunday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>8<\/td>\r\n<td>Monday<\/td>\r\n<td><\/td>\r\n<td>22<\/td>\r\n<td>Monday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>9<\/td>\r\n<td>Tuesday<\/td>\r\n<td>Yes<\/td>\r\n<td>23<\/td>\r\n<td>Tuesday<\/td>\r\n<td>Yes<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>10<\/td>\r\n<td>Wednesday<\/td>\r\n<td><\/td>\r\n<td>24<\/td>\r\n<td>Wednesday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>11<\/td>\r\n<td>Thursday<\/td>\r\n<td><\/td>\r\n<td>25<\/td>\r\n<td>Thursday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>12<\/td>\r\n<td>Friday<\/td>\r\n<td><\/td>\r\n<td>26<\/td>\r\n<td>Friday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>13<\/td>\r\n<td>Saturday<\/td>\r\n<td><\/td>\r\n<td>27<\/td>\r\n<td>Saturday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>14<\/td>\r\n<td>Sunday<\/td>\r\n<td><\/td>\r\n<td>28<\/td>\r\n<td>Sunday<\/td>\r\n<td><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p06\" class=\"para editable block\">Do you notice any problems with our selection of observation days? Apparently we\u2019ll only be observing on Tuesdays. As you have probably figured out, that isn\u2019t such a good plan if we really wish to understand how public spaces on campus are used. My guess is that weekend use probably differs from weekday use, and that use may even vary during the week, just as class schedules do. In cases such as this, where the sampling frame is cyclical, it would be better to use a <span class=\"margin_term\"><a class=\"glossterm\">stratified sampling technique<\/a><span class=\"glossdef\">A researcher divides the study population into relevant subgroups then draws a sample from within each subgroup.<\/span><\/span>. In stratified sampling, a researcher will divide the study population into relevant subgroups and <em class=\"emphasis\">then<\/em> draw a sample from each subgroup. In this example, we might wish to first divide our sampling frame into two lists: weekend days and weekdays. Once we have our two lists, we can then apply either simple random or systematic sampling techniques to each subgroup.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p07\" class=\"para editable block\">Stratified sampling is a good technique to use when, as in our example, a subgroup of interest makes up a relatively small proportion of the overall sample. In our example of a study of use of public space on campus, we want to be sure to include weekdays and weekends in our sample, but because weekends make up less than a third of an entire week, there\u2019s a chance that a simple random or systematic strategy would not yield sufficient weekend observation days. As you might imagine, stratified sampling is even more useful in cases where a subgroup makes up an even smaller proportion of the study population, say, for example, if we want to be sure to include both men\u2019s and women\u2019s perspectives in a study, but men make up only a small percentage of the population. There\u2019s a chance simple random or systematic sampling strategy might not yield any male participants, but by using stratified sampling, we could ensure that our sample contained the proportion of men that is reflective of the larger population.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p08\" class=\"para editable block\">Up to this point in our discussion of probability samples, we\u2019ve assumed that researchers will be able to access a list of population elements in order to create a sampling frame. This, as you might imagine, is not always the case. Let\u2019s say, for example, that you wish to conduct a study of hairstyle preferences across the United States. Just imagine trying to create a list of every single person with (and without) hair in the country. Basically, we\u2019re talking about a list of every person in the country. Even if you could find a way to generate such a list, attempting to do so might not be the most practical use of your time or resources. When this is the case, researchers turn to cluster sampling. <span class=\"margin_term\"><a class=\"glossterm\">Cluster sampling<\/a><span class=\"glossdef\">A researcher begins by sampling groups of population elements and then selects elements from within those groups.<\/span><\/span> occurs when a researcher begins by sampling groups (or clusters) of population elements and then selects elements from within those groups.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p09\" class=\"para editable block\">Let\u2019s take a look at a couple more examples. Perhaps you are interested in the workplace experiences of public librarians. Chances are good that obtaining a list of all librarians that work for public libraries would be rather difficult. But I\u2019ll bet you could come up with a list of all public libraries without too much hassle. Thus you could draw a random sample of libraries (your cluster) and then draw another random sample of elements (in this case, librarians) from within the libraries you initially selected. Cluster sampling works in stages. In this example, we sampled in two stages. As you might have guessed, sampling in multiple stages does introduce the possibility of greater error (each stage is subject to its own sampling error), but it is nevertheless a highly efficient method.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s03_s02_p10\" class=\"para editable block\">Jessica Holt and Wayne Gillespie (2008)<span id=\"blackstone_1.0-fn07_008\" class=\"footnote\">Holt, J. L., &amp; Gillespie, W. (2008). Intergenerational transmission of violence, threatened egoism, and reciprocity: A test of multiple pychosocial factors affecting intimate partner violence. <em class=\"emphasis\">American Journal of Criminal Justice, 33<\/em>, 252\u2013266.<\/span> used cluster sampling in their study of students\u2019 experiences with violence in intimate relationships. Specifically, the researchers randomly selected 14 classes on their campus and then drew a random subsample of students from those classes. But you probably know from your experience with college classes that not all classes are the same size. So if Holt and Gillespie had simply randomly selected 14 classes and then selected the same number of students from each class to complete their survey, then students in the smaller of those classes would have had a greater chance of being selected for the study than students in the larger classes. Keep in mind with random sampling the goal is to make sure that each element has the same chance of being selected. When clusters are of different sizes, as in the example of sampling college classes, researchers often use a method called <span class=\"margin_term\"><a class=\"glossterm\">probability proportionate to size<\/a><span class=\"glossdef\">A cluster sampling technique in which each cluster is given a chance of selection based on its size.<\/span><\/span> (PPS). This means that they take into account that their clusters are of different sizes. They do this by giving clusters different chances of being selected based on their size so that each element within those clusters winds up having an equal chance of being selected.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s03_s02_t03\" class=\"table block\">\r\n<p class=\"title\"><span class=\"title-prefix\">Table 7.4<\/span> Types of Probability Samples<\/p>\r\n\r\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\r\n<thead>\r\n<tr>\r\n<th>Sample type<\/th>\r\n<th>Description<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td>Simple random<\/td>\r\n<td>Researcher randomly selects elements from sampling frame.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Systematic<\/td>\r\n<td>Researcher selects every <em class=\"emphasis\">k<\/em>th element from sampling frame.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Stratified<\/td>\r\n<td>Researcher creates subgroups then randomly selects elements from each subgroup.<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>Cluster<\/td>\r\n<td>Researcher randomly selects clusters then randomly selects elements from selected clusters.<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s03_s02_n01\" class=\"key_takeaways editable block\">\r\n<h3 class=\"title\">Key Takeaways<\/h3>\r\n<ul id=\"blackstone_1.0-ch07_s03_s02_l01\" class=\"itemizedlist\">\r\n \t<li>In probability sampling, the aim is to identify a sample that resembles the population from which it was drawn.<\/li>\r\n \t<li>There are several types of probability samples including simple random samples, systematic samples, stratified samples, and cluster samples.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s03_s02_n02\" class=\"exercises editable block\">\r\n<h3 class=\"title\">Exercises<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s03_s02_l02\" class=\"orderedlist\">\r\n \t<li>Imagine that you are about to conduct a study of people\u2019s use of public parks. Explain how you could employ each of the probability sampling techniques described earlier to recruit a sample for your study.<\/li>\r\n \t<li>Of the four probability sample types described, which seems strongest to you? Which seems weakest? Explain.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s04\" class=\"section\" xml:lang=\"en\">\r\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.4<\/span> A Word of Caution: Questions to Ask About Samples<\/h2>\r\n<div id=\"blackstone_1.0-ch07_s04_n01\" class=\"learning_objectives editable block\">\r\n<h3 class=\"title\">Learning Objectives<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s04_l01\" class=\"orderedlist\">\r\n \t<li>Identify several questions we should ask about samples when reading the results of research.<\/li>\r\n \t<li>Name some tenets worth keeping in mind with respect to responsibly reading research findings.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<p id=\"blackstone_1.0-ch07_s04_p01\" class=\"para editable block\">We read and hear about research results so often that we might overlook the need to ask important questions about where research participants come from and how they are identified for inclusion in a research project. It is easy to focus only on findings when we\u2019re busy and when the really interesting stuff is in a study\u2019s conclusions, not its procedures. But now that you have some familiarity with the variety of procedures for selecting study participants, you are equipped to ask some very important questions about the findings you read and to be a more responsible consumer of research.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s04_s01\" class=\"section\">\r\n<h2 class=\"title editable block\">Who Sampled, How Sampled, and for What Purpose?<\/h2>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p01\" class=\"para editable block\">Have you ever been a participant in someone\u2019s research? If you have ever taken an introductory psychology or sociology class at a large university, that\u2019s probably a silly question to ask. Social science researchers on college campuses have a luxury that researchers elsewhere may not share\u2014they have access to a whole bunch of (presumably) willing and able human guinea pigs. But that luxury comes at a cost\u2014sample representativeness. One study of top academic journals in psychology found that over two-thirds (68%) of participants in studies published by those journals were based on samples drawn in the United States (Arnett, 2008).<span id=\"blackstone_1.0-fn07_009\" class=\"footnote\">Arnett, J. J. (2008). The neglected 95%: Why American psychology needs to become less American. <em class=\"emphasis\">American Psychologist, 63<\/em>, 602\u2013614.<\/span> Further, the study found that two-thirds of the work that derived from US samples published in the <em class=\"emphasis\">Journal of Personality and Social Psychology<\/em> was based on samples made up entirely of American undergraduates taking psychology courses.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p02\" class=\"para editable block\">These findings certainly beg the question: What do we actually learn from social scientific studies and about whom do we learn it? That is exactly the concern raised by Joseph Henrich and colleagues (Henrich, Heine, &amp; Norenzayan, 2010),<span id=\"blackstone_1.0-fn07_010\" class=\"footnote\">Henrich, J., Heine, S. J., &amp; Norenzayan, A. (2010). The weirdest people in the world? <em class=\"emphasis\">Behavioral and Brain Sciences, 33<\/em>, 61\u2013135.<\/span> authors of the article \u201cThe Weirdest People in the World?\u201d In their piece, Henrich and colleagues point out that behavioral scientists very commonly make sweeping claims about human nature based on samples drawn only from WEIRD (Western, educated, industrialized, rich, and democratic) societies, and often based on even narrower samples, as is the case with many studies relying on samples drawn from college classrooms. As it turns out, many robust findings about the nature of human behavior when it comes to fairness, cooperation, visual perception, trust, and other behaviors are based on studies that excluded participants from outside the United States and sometimes excluded anyone outside the college classroom (Begley, 2010).<span id=\"blackstone_1.0-fn07_011\" class=\"footnote\"><em class=\"emphasis\">Newsweek<\/em> magazine published an interesting story about Henrich and his colleague\u2019s study: Begley, S. (2010). What\u2019s really human? The trouble with student guinea pigs. Retrieved from <a class=\"link\" href=\"http:\/\/www.newsweek.com\/2010\/07\/23\/what-s-really-human.html\" target=\"_blank\" rel=\"noopener\">http:\/\/www.newsweek.com\/2010\/07\/23\/what-s-really-human.html<\/a><\/span> This certainly raises questions about what we really know about human behavior as opposed to US resident or US undergraduate behavior. Of course not all research findings are based on samples of WEIRD folks like college students. But even then it would behoove us to pay attention to the population on which studies are based and the claims that are being made about to whom those studies apply.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p03\" class=\"para editable block\">In the preceding discussion, the concern is with researchers making claims about populations other than those from which their samples were drawn. A related, but slightly different, potential concern is <span class=\"margin_term\"><a class=\"glossterm\">sampling bias<\/a><span class=\"glossdef\">Occurs when the elements selected for inclusion in a study do not represent the larger population from which they were drawn.<\/span><\/span>. Bias in sampling occurs when the elements selected for inclusion in a study do not represent the larger population from which they were drawn. For example, a poll conducted online by a newspaper asking for the public\u2019s opinion about some local issue will certainly not represent the public since those without access to computers or the Internet, those who do not read that paper\u2019s website, and those who do not have the time or interest will not answer the question.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p04\" class=\"para editable block\">Another thing to keep in mind is that just because a sample may be representative in all respects that a researcher thinks are relevant, there may be aspects that are relevant that didn\u2019t occur to the researcher when she was drawing her sample. You might not think that a person\u2019s phone would have much to do with their voting preferences, for example. But had pollsters making predictions about the results of the 2008 presidential election not been careful to include both cell phone\u2013only and landline households in their surveys, it is possible that their predictions would have underestimated Barack Obama\u2019s lead over John McCain because Obama was much more popular among cell-only users than McCain (Keeter, Dimock, &amp; Christian, 2008).<span id=\"blackstone_1.0-fn07_012\" class=\"footnote\">Keeter, S., Dimock, M., &amp; Christian, L. (2008). Calling cell phones in \u201908 pre-election polls. <em class=\"emphasis\">The Pew Research Center for the People and the Press<\/em>. Retrieved from <a class=\"link\" href=\"http:\/\/people-press.org\/http:\/\/people-press.org\/files\/legacy-pdf\/cell-phone-commentary.pdf\" target=\"_blank\" rel=\"noopener\">http:\/\/people-press.org\/http:\/\/people-press.org\/files\/legacy-pdf\/cell-phone-commentary.pdf<\/a><\/span><\/p>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p05\" class=\"para editable block\">So how do we know when we can count on results that are being reported to us? While there might not be any magic or always-true rules we can apply, there are a couple of things we can keep in mind as we read the claims researchers make about their findings. First, remember that sample quality is determined only by the sample actually obtained, not by the sampling method itself. A researcher may set out to administer a survey to a representative sample by correctly employing a random selection technique, but if only a handful of the people sampled actually respond to the survey, the researcher will have to be very careful about the claims he can make about his survey findings. Another thing to keep in mind, as demonstrated by the preceding discussion, is that researchers may be drawn to talking about implications of their findings as though they apply to some group other than the population actually sampled. Though this tendency is usually quite innocent and does not come from a place of malice, it is all too tempting a way to talk about findings; as consumers of those findings, it is our responsibility to be attentive to this sort of (likely unintentional) bait and switch.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p06\" class=\"para editable block\">Finally, keep in mind that a sample that allows for comparisons of theoretically important concepts or variables is certainly better than one that does not allow for such comparisons. In a study based on a nonrepresentative sample, for example, we can learn about the strength of our social theories by comparing relevant aspects of social processes. Klawiter\u2019s previously mentioned study (1999)<span id=\"blackstone_1.0-fn07_013\" class=\"footnote\">Klawiter, M. (1999). Racing for the cure, walking women, and toxic touring: Mapping cultures of action within the Bay Area terrain of breast cancer. <em class=\"emphasis\">Social Problems, 46<\/em>, 104\u2013126.<\/span> of three carefully chosen breast cancer activist groups allowed her to contribute to our understandings of activism by addressing potential weaknesses in theories of social change.<\/p>\r\n<p id=\"blackstone_1.0-ch07_s04_s01_p07\" class=\"para editable block\">At their core, questions about sample quality should address who has been sampled, how they were sampled, and for what purpose they were sampled. Being able to answer those questions will help you better understand, and more responsibly read, research results.<\/p>\r\n\r\n<div id=\"blackstone_1.0-ch07_s04_s01_n01\" class=\"key_takeaways editable block\">\r\n<h3 class=\"title\">Key Takeaways<\/h3>\r\n<ul id=\"blackstone_1.0-ch07_s04_s01_l01\" class=\"itemizedlist\">\r\n \t<li>Sometimes researchers may make claims about populations other than those from whom their samples were drawn; other times they may make claims about a population based on a sample that is not representative. As consumers of research, we should be attentive to both possibilities.<\/li>\r\n \t<li>A researcher\u2019s findings need not be generalizable to be valuable; samples that allow for comparisons of theoretically important concepts or variables may yield findings that contribute to our social theories and our understandings of social processes.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<div id=\"blackstone_1.0-ch07_s04_s01_n02\" class=\"exercises editable block\">\r\n<h3 class=\"title\">Exercise<\/h3>\r\n<ol id=\"blackstone_1.0-ch07_s04_s01_l02\" class=\"orderedlist\">\r\n \t<li>Find any news story or blog entry that describes results from any social scientific study. How much detail is reported about the study\u2019s sample? What sorts of claims are being made about the study\u2019s findings, and to whom do they apply?<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>","rendered":"<div id=\"navbar-top\" class=\"navbar\">\n<div class=\"navbar-part left\"><\/div>\n<div class=\"navbar-part right\">\n<p>&nbsp;<\/p>\n<\/div>\n<\/div>\n<div id=\"book-content\">\n<div id=\"blackstone_1.0-ch07\" class=\"chapter\" xml:lang=\"en\">\n<h1 class=\"title editable block\"><span class=\"title-prefix\">Chapter 7<\/span> Sampling<\/h1>\n<div id=\"blackstone_1.0-ch07_s00\" class=\"section\">\n<h2 class=\"title editable block\">Who or What?<\/h2>\n<p id=\"blackstone_1.0-ch07_s00_p01\" class=\"para editable block\">Remember back in <a class=\"xref\" href=\"blackstone_1.0-ch01#blackstone_1.0-ch01\">Chapter 1 &#8220;Introduction&#8221;<\/a> when we saw the cute photo of the babies hanging out together and one of them was wearing a green onesie? I mentioned there that if we were to conclude that all babies wore green based on the photo that we would have committed selective observation. In that example of informal observation, our sampling strategy (just observing the baby in green) was of course faulty, but we nevertheless would have engaged in sampling. Sampling has to do with selecting some subset of one\u2019s group of interest (in this case, babies) and drawing conclusions from that subset. How we sample and who we sample shapes what sorts of conclusions we are able to draw. Ultimately, this chapter focuses on questions about the who or the what that you want to be able to make claims about in your research. In the following sections we\u2019ll define sampling, discuss different types of sampling strategies, and consider how to judge the quality of samples as consumers of social scientific research.<\/p>\n<\/div>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s01\" class=\"section\" xml:lang=\"en\">\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.1<\/span> Populations Versus Samples<\/h2>\n<div id=\"blackstone_1.0-ch07_s01_n01\" class=\"learning_objectives editable block\">\n<h3 class=\"title\">Learning Objective<\/h3>\n<ol id=\"blackstone_1.0-ch07_s01_l01\" class=\"orderedlist\">\n<li>Understand the difference between populations and samples.<\/li>\n<\/ol>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s01_p01\" class=\"para editable block\">When I teach research methods, my students are sometimes disheartened to discover that the research projects they complete during the course will not make it possible for them to make sweeping claims about \u201call\u201d of whomever it is that they\u2019re interested in studying. What they fail to realize, however, is that they are not alone. One of the most surprising and frustrating lessons research methods students learn is that there is a difference between one\u2019s population of interest and one\u2019s study sample. While there are certainly exceptions, more often than not a researcher\u2019s population and her or his sample are not the same.<\/p>\n<p id=\"blackstone_1.0-ch07_s01_p02\" class=\"para editable block\">In social scientific research, a <span class=\"margin_term\"><a class=\"glossterm\">population<\/a><span class=\"glossdef\">The group (be it people, events, etc.) that you want to be able to draw conclusions about at the end of your study.<\/span><\/span> is the cluster of people, events, things, or other phenomena that you are most interested in; it is often the \u201cwho\u201d or \u201cwhat\u201d that you want to be able to say something about at the end of your study. Populations in research may be rather large, such as \u201cthe American people,\u201d but they are more typically a little less vague than that. For example, a large study for which the population of interest really is the American people will likely specify which American people, such as adults over the age of 18 or citizens or legal residents. A <span class=\"margin_term\"><a class=\"glossterm\">sample<\/a><span class=\"glossdef\">The group (be it people, events, etc.) from which you actually collect data.<\/span><\/span>, on the other hand, is the cluster of people or events, for example, from or about which you will actually gather data. Some sampling strategies allow researchers to make claims about populations that are much larger than their actually sample with a fair amount of confidence. Other sampling strategies are designed to allow researchers to make theoretical contributions rather than to make sweeping claims about large populations. We\u2019ll discuss both types of strategies later in this chapter.<\/p>\n<p id=\"blackstone_1.0-ch07_s01_p03\" class=\"para editable block\">As I\u2019ve now said a couple of times, it is quite rare for a researcher to gather data from their entire population of interest. This might sound surprising or disappointing until you think about the kinds of research questions that sociologists typically ask. For example, let\u2019s say we wish to answer the following research question: \u201cHow do men\u2019s and women\u2019s college experiences differ, and how are they similar?\u201d Would you expect to be able to collect data from all college students across all nations from all historical time periods? Unless you plan to make answering this research question your entire life\u2019s work (and then some), I\u2019m guessing your answer is a resounding no way. So what to do? Does not having the time or resources to gather data from every single person of interest mean having to give up your research interest? Absolutely not. It just means having to make some hard choices about sampling, and then being honest with yourself and your readers about the limitations of your study based on the sample from whom you were able to actually collect data.<\/p>\n<p id=\"blackstone_1.0-ch07_s01_p04\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Sampling<\/a><span class=\"glossdef\">The process of selecting observations that will be analyzed for research purposes.<\/span><\/span> is the process of selecting observations that will be analyzed for research purposes. Both qualitative and quantitative researchers use sampling techniques to help them identify the what or whom from which they will collect their observations. Because the goals of qualitative and quantitative research differ, however, so, too, do the sampling procedures of the researchers employing these methods. First, we examine sampling types and techniques used in qualitative research. After that, we\u2019ll look at how sampling typically works in quantitative research.<\/p>\n<div id=\"blackstone_1.0-ch07_s01_n02\" class=\"key_takeaways editable block\">\n<h3 class=\"title\">Key Takeaways<\/h3>\n<ul id=\"blackstone_1.0-ch07_s01_l02\" class=\"itemizedlist\">\n<li>A population is the group that is the main focus of a researcher\u2019s interest; a sample is the group from whom the researcher actually collects data.<\/li>\n<li>Populations and samples might be one and the same, but more often they are not.<\/li>\n<li>Sampling involves selecting the observations that you will analyze.<\/li>\n<\/ul>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s01_n03\" class=\"exercises editable block\">\n<h3 class=\"title\">Exercises<\/h3>\n<ol id=\"blackstone_1.0-ch07_s01_l03\" class=\"orderedlist\">\n<li>Read through the methods section of a couple of scholarly articles describing empirical research. How do the authors talk about their populations and samples, if at all? What do the articles\u2019 abstracts suggest in terms of whom conclusions are being drawn about?<\/li>\n<li>Think of a research project you have envisioned conducting as you\u2019ve read this text. Would your population and sample be one and the same, or would they differ somehow? Explain.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s02\" class=\"section\" xml:lang=\"en\">\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.2<\/span> Sampling in Qualitative Research<\/h2>\n<div id=\"blackstone_1.0-ch07_s02_n01\" class=\"learning_objectives editable block\">\n<h3 class=\"title\">Learning Objectives<\/h3>\n<ol id=\"blackstone_1.0-ch07_s02_l01\" class=\"orderedlist\">\n<li>Define nonprobability sampling, and describe instances in which a researcher might choose a nonprobability sampling technique.<\/li>\n<li>Describe the different types of nonprobability samples.<\/li>\n<\/ol>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s02_p01\" class=\"para editable block\">Qualitative researchers typically make sampling choices that enable them to deepen understanding of whatever phenomenon it is that they are studying. In this section we\u2019ll examine the strategies that qualitative researchers typically employ when sampling as well as the various types of samples that qualitative researchers are most likely to use in their work.<\/p>\n<div id=\"blackstone_1.0-ch07_s02_s01\" class=\"section\">\n<h2 class=\"title editable block\">Nonprobability Sampling<\/h2>\n<p id=\"blackstone_1.0-ch07_s02_s01_p01\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Nonprobability sampling<\/a><span class=\"glossdef\">Sampling techniques for which a person\u2019s likelihood of being selected for membership in the sample is unknown.<\/span><\/span> refers to sampling techniques for which a person\u2019s (or event\u2019s or researcher\u2019s focus\u2019s) likelihood of being selected for membership in the sample is unknown. Because we don\u2019t know the likelihood of selection, we don\u2019t know with nonprobability samples whether a sample represents a larger population or not. But that\u2019s OK, because representing the population is not the goal with nonprobability samples. That said, the fact that nonprobability samples do not represent a larger population does not mean that they are drawn arbitrarily or without any specific purpose in mind (once again, that would mean committing one of the errors of informal inquiry discussed in <a class=\"xref\" href=\"blackstone_1.0-ch01#blackstone_1.0-ch01\">Chapter 1 &#8220;Introduction&#8221;<\/a>). In the following subsection, \u201cTypes of Nonprobability Samples,\u201d we\u2019ll take a closer look at the process of selecting research <span class=\"margin_term\"><a class=\"glossterm\">elements<\/a><span class=\"glossdef\">The individual unit that is the focus of a researcher\u2019s investigation; possible elements in social science include people, documents, organizations, groups, beliefs, or behaviors.<\/span><\/span> when drawing a nonprobability sample. But first, let\u2019s consider why a researcher might choose to use a nonprobability sample.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s01_p02\" class=\"para editable block\">So when are nonprobability samples ideal? One instance might be when we\u2019re designing a research project. For example, if we\u2019re conducting survey research, we may want to administer our survey to a few people who seem to resemble the folks we\u2019re interested in studying in order to help work out kinks in the survey. We might also use a nonprobability sample at the early stages of a research project, if we\u2019re conducting a pilot study or some exploratory research. This can be a quick way to gather some initial data and help us get some idea of the lay of the land before conducting a more extensive study. From these examples, we can see that nonprobability samples can be useful for setting up, framing, or beginning research. But it isn\u2019t just early stage research that relies on and benefits from nonprobability sampling techniques.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s01_p03\" class=\"para editable block\">Researchers also use nonprobability samples in full-blown research projects. These projects are usually qualitative in nature, where the researcher\u2019s goal is in-depth, idiographic understanding rather than more general, nomothetic understanding. Evaluation researchers whose aim is to describe some very specific small group might use nonprobability sampling techniques, for example. Researchers interested in contributing to our theoretical understanding of some phenomenon might also collect data from nonprobability samples. Maren Klawiter (1999)<span id=\"blackstone_1.0-fn07_001\" class=\"footnote\">Klawiter, M. (1999). Racing for the cure, walking women, and toxic touring: Mapping cultures of action within the Bay Area terrain of breast cancer. <em class=\"emphasis\">Social Problems, 46<\/em>, 104\u2013126.<\/span> relied on a nonprobability sample for her study of the role that culture plays in shaping social change. Klawiter conducted participant observation in three very different breast cancer organizations to understand \u201cthe bodily dimensions of cultural production and collective action.\u201d Her intensive study of these three organizations allowed Klawiter to deeply understand each organization\u2019s \u201cculture of action\u201d and, subsequently, to critique and contribute to broader theories of social change and social movement organization. Thus researchers interested in contributing to social theories, by either expanding on them, modifying them, or poking holes in their propositions, may use nonprobability sampling techniques to seek out cases that seem anomalous in order to understand how theories can be improved.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s01_p04\" class=\"para editable block\">In sum, there are a number and variety of instances in which the use of nonprobability samples makes sense. We\u2019ll examine several specific types of nonprobability samples in the next subsection.<\/p>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s02_s02\" class=\"section\">\n<h2 class=\"title editable block\">Types of Nonprobability Samples<\/h2>\n<p id=\"blackstone_1.0-ch07_s02_s02_p01\" class=\"para editable block\">There are several types of nonprobability samples that researchers use. These include purposive samples, snowball samples, quota samples, and convenience samples. While the latter two strategies may be used by quantitative researchers from time to time, they are more typically employed in qualitative research, and because they are both nonprobability methods, we include them in this section of the chapter.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p02\" class=\"para editable block\">To draw a <span class=\"margin_term\"><a class=\"glossterm\">purposive sample<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher seeks out particular study elements that meet specific criteria that the researcher has identified.<\/span><\/span>, a researcher begins with specific perspectives in mind that he or she wishes to examine and then seeks out research participants who cover that full range of perspectives. For example, if you are studying students\u2019 satisfaction with their living quarters on campus, you\u2019ll want to be sure to include students who stay in each of the different types or locations of on-campus housing in your study. If you only include students from 1 of 10 dorms on campus, you may miss important details about the experiences of students who live in the 9 dorms you didn\u2019t include in your study. In my own interviews of young people about their workplace sexual harassment experiences, I and my coauthors used a purposive sampling strategy; we used participants\u2019 prior responses on a survey to ensure that we included both men and women in the interviews and that we included participants who\u2019d had a range of harassment experiences, from relatively minor experiences to much more severe harassment.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p03\" class=\"para editable block\">While purposive sampling is often used when one\u2019s goal is to include participants who represent a broad range of perspectives, purposive sampling may also be used when a researcher wishes to include only people who meet very narrow or specific criteria. For example, in their study of Japanese women\u2019s perceptions of intimate partner violence, Miyoko Nagae and Barbara L. Dancy (2010)<span id=\"blackstone_1.0-fn07_002\" class=\"footnote\">Nagae, M., &amp; Dancy, B. L. (2010). Japanese women\u2019s perceptions of intimate partner violence (IPV). <em class=\"emphasis\">Journal of Interpersonal Violence, 25<\/em>, 753\u2013766.<\/span> limited their study only to participants who had experienced intimate partner violence themselves, were at least 18 years old, had been married and living with their spouse at the time that the violence occurred, were heterosexual, and were willing to be interviewed. In this case, the researchers\u2019 goal was to find participants who had had very specific experiences rather than finding those who had had quite diverse experiences, as in the preceding example. In both cases, the researchers involved shared the goal of understanding the topic at hand in as much depth as possible.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p04\" class=\"para editable block\">Qualitative researchers sometimes rely on <span class=\"margin_term\"><a class=\"glossterm\">snowball sampling<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher recruits study participants by asking prior participants to refer others.<\/span><\/span> techniques to identify study participants. In this case, a researcher might know of one or two people she\u2019d like to include in her study but then relies on those initial participants to help identify additional study participants. Thus the researcher\u2019s sample builds and becomes larger as the study continues, much as a snowball builds and becomes larger as it rolls through the snow.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p05\" class=\"para editable block\">Snowball sampling is an especially useful strategy when a researcher wishes to study some stigmatized group or behavior. For example, a researcher who wanted to study how people with genital herpes cope with their medical condition would be unlikely to find many participants by posting a call for interviewees in the newspaper or making an announcement about the study at some large social gathering. Instead, the researcher might know someone with the condition, interview that person, and then be referred by the first interviewee to another potential subject. Having a previous participant vouch for the trustworthiness of the researcher may help new potential participants feel more comfortable about being included in the study.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p06\" class=\"para editable block\">Snowball sampling is sometimes referred to as chain referral sampling. One research participant refers another, and that person refers another, and that person refers another\u2014thus a chain of potential participants is identified. In addition to using this sampling strategy for potentially stigmatized populations, it is also a useful strategy to use when the researcher\u2019s group of interest is likely to be difficult to find, not only because of some stigma associated with the group, but also because the group may be relatively rare. This was the case for Steven M. Kogan and colleagues (Kogan, Wejnert, Chen, Brody, &amp; Slater, 2011)<span id=\"blackstone_1.0-fn07_003\" class=\"footnote\">Kogan, S. M., Wejnert, C., Chen, Y., Brody, G. H., &amp; Slater, L. M. (2011). Respondent-driven sampling with hard-to-reach emerging adults: An introduction and case study with rural African Americans. <em class=\"emphasis\">Journal of Adolescent Research, 26<\/em>, 30\u201360.<\/span> who wished to study the sexual behaviors of non-college-bound African American young adults who lived in high-poverty rural areas. The researchers first relied on their own networks to identify study participants, but because members of the study\u2019s target population were not easy to find, access to the networks of initial study participants was very important for identifying additional participants. Initial participants were given coupons to pass on to others they knew who qualified for the study. Participants were given an added incentive for referring eligible study participants; they received not only $50.00 for participating in the study but also $20.00 for each person they recruited who also participated in the study. Using this strategy, Kogan and colleagues succeeded in recruiting 292 study participants.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p07\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Quota sampling<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher identifies subgroups within a population of interest and then selects some predetermined number of elements from within each subgroup.<\/span><\/span> is another nonprobability sampling strategy. This type of sampling is actually employed by both qualitative and quantitative researchers, but because it is a nonprobability method, we\u2019ll discuss it in this section. When conducting quota sampling, a researcher identifies categories that are important to the study and for which there is likely to be some variation. Subgroups are created based on each category and the researcher decides how many people (or documents or whatever element happens to be the focus of the research) to include from each subgroup and collects data from that number for each subgroup.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p08\" class=\"para editable block\">Let\u2019s go back to the example we considered previously of student satisfaction with on-campus housing. Perhaps there are two types of housing on your campus: apartments that include full kitchens and dorm rooms where residents do not cook for themselves but eat in a dorm cafeteria. As a researcher, you might wish to understand how satisfaction varies across these two types of housing arrangements. Perhaps you have the time and resources to interview 20 campus residents, so you decide to interview 10 from each housing type. It is possible as well that your review of literature on the topic suggests that campus housing experiences vary by gender. If that is that case, perhaps you\u2019ll decide on four important subgroups: men who live in apartments, women who live in apartments, men who live in dorm rooms, and women who live in dorm rooms. Your quota sample would include five people from each subgroup.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p09\" class=\"para editable block\">In 1936, up-and-coming pollster George Gallup made history when he successfully predicted the outcome of the presidential election using quota sampling methods. The leading polling entity at the time, <em class=\"emphasis\">The Literary Digest<\/em>, predicted that Alfred Landon would beat Franklin Roosevelt in the presidential election by a landslide. When Gallup\u2019s prediction that Roosevelt would win, turned out to be correct, \u201cthe Gallup Poll was suddenly on the map\u201d (Van Allen, 2011).<span id=\"blackstone_1.0-fn07_004\" class=\"footnote\">Van Allen, S. (2011). Gallup corporate history. Retrieved from <a class=\"link\" href=\"http:\/\/www.gallup.com\/corporate\/1357\/Corporate-History.aspx#2\" target=\"_blank\" rel=\"noopener\">http:\/\/www.gallup.com\/corporate\/1357\/Corporate-History.aspx#2<\/a><\/span> Gallup successfully predicted subsequent elections based on quota samples, but in 1948, Gallup incorrectly predicted that Dewey would beat Truman in the US presidential election.<span id=\"blackstone_1.0-fn07_005\" class=\"footnote\">For more information about the 1948 election and other historically significant dates related to measurement, see the PBS timeline of \u201cThe first measured century\u201d at <a class=\"link\" href=\"http:\/\/www.pbs.org\/fmc\/timeline\/e1948election.htm\" target=\"_blank\" rel=\"noopener\">http:\/\/www.pbs.org\/fmc\/timeline\/e1948election.htm<\/a>.<\/span> Among other problems, the fact that Gallup\u2019s quota categories did not represent those who actually voted (Neuman, 2007)<span id=\"blackstone_1.0-fn07_006\" class=\"footnote\">Neuman, W. L. (2007). <em class=\"emphasis\">Basics of social research: Qualitative and quantitative approaches<\/em> (2nd ed.). Boston, MA: Pearson.<\/span> underscores the point that one should avoid attempting to make statistical generalizations from data collected using quota sampling methods.<span id=\"blackstone_1.0-fn07_007\" class=\"footnote\">If you are interested in the history of polling, I recommend a recent book: Fried, A. (2011). <em class=\"emphasis\">Pathways to polling: Crisis, cooperation, and the making of public opinion professions<\/em>. New York, NY: Routledge.<\/span> While quota sampling offers the strength of helping the researcher account for potentially relevant variation across study elements, it would be a mistake to think of this strategy as yielding statistically representative findings.<\/p>\n<p id=\"blackstone_1.0-ch07_s02_s02_p10\" class=\"para editable block\">Finally, <span class=\"margin_term\"><a class=\"glossterm\">convenience sampling<\/a><span class=\"glossdef\">A nonprobability sample type for which a researcher gathers data from the elements that happen to be convenient; also referred to as haphazard sampling.<\/span><\/span> is another nonprobability sampling strategy that is employed by both qualitative and quantitative researchers. To draw a convenience sample, a researcher simply collects data from those people or other relevant elements to which he or she has most convenient access. This method, also sometimes referred to as haphazard sampling, is most useful in exploratory research. It is also often used by journalists who need quick and easy access to people from their population of interest. If you\u2019ve ever seen brief interviews of people on the street on the news, you\u2019ve probably seen a haphazard sample being interviewed. While convenience samples offer one major benefit\u2014convenience\u2014we should be cautious about generalizing from research that relies on convenience samples.<\/p>\n<div id=\"blackstone_1.0-ch07_s02_s02_t01\" class=\"table block\">\n<p class=\"title\"><span class=\"title-prefix\">Table 7.1<\/span> Types of Nonprobability Samples<\/p>\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\n<thead>\n<tr>\n<th>Sample type<\/th>\n<th>Description<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Purposive<\/td>\n<td>Researcher seeks out elements that meet specific criteria.<\/td>\n<\/tr>\n<tr>\n<td>Snowball<\/td>\n<td>Researcher relies on participant referrals to recruit new participants.<\/td>\n<\/tr>\n<tr>\n<td>Quota<\/td>\n<td>Researcher selects cases from within several different subgroups.<\/td>\n<\/tr>\n<tr>\n<td>Convenience<\/td>\n<td>Researcher gathers data from whatever cases happen to be convenient.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s02_s02_n01\" class=\"key_takeaways editable block\">\n<h3 class=\"title\">Key Takeaways<\/h3>\n<ul id=\"blackstone_1.0-ch07_s02_s02_l01\" class=\"itemizedlist\">\n<li>Nonprobability samples might be used when researchers are conducting exploratory research, by evaluation researchers, or by researchers whose aim is to make some theoretical contribution.<\/li>\n<li>There are several types of nonprobability samples including purposive samples, snowball samples, quota samples, and convenience samples.<\/li>\n<\/ul>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s02_s02_n02\" class=\"exercises editable block\">\n<h3 class=\"title\">Exercises<\/h3>\n<ol id=\"blackstone_1.0-ch07_s02_s02_l02\" class=\"orderedlist\">\n<li>Imagine you are about to conduct a study of people\u2019s use of the public parks in your hometown. Explain how you could employ each of the nonprobability sampling techniques described previously to recruit a sample for your study.<\/li>\n<li>Of the four nonprobability sample types described, which seems strongest to you? Which seems weakest? Explain.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s03\" class=\"section\" xml:lang=\"en\">\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.3<\/span> Sampling in Quantitative Research<\/h2>\n<div id=\"blackstone_1.0-ch07_s03_n01\" class=\"learning_objectives editable block\">\n<h3 class=\"title\">Learning Objectives<\/h3>\n<ol id=\"blackstone_1.0-ch07_s03_l01\" class=\"orderedlist\">\n<li>Describe how probability sampling differs from nonprobability sampling.<\/li>\n<li>Define generalizability, and describe how it is achieved in probability samples.<\/li>\n<li>Identify the various types of probability samples, and provide a brief description of each.<\/li>\n<\/ol>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s03_p01\" class=\"para editable block\">Quantitative researchers are often interested in being able to make generalizations about groups larger than their study samples. While there are certainly instances when quantitative researchers rely on nonprobability samples (e.g., when doing exploratory or evaluation research), quantitative researchers tend to rely on probability sampling techniques. The goals and techniques associated with probability samples differ from those of nonprobability samples. We\u2019ll explore those unique goals and techniques in this section.<\/p>\n<div id=\"blackstone_1.0-ch07_s03_s01\" class=\"section\">\n<h2 class=\"title editable block\">Probability Sampling<\/h2>\n<p id=\"blackstone_1.0-ch07_s03_s01_p01\" class=\"para editable block\">Unlike nonprobability sampling, <span class=\"margin_term\"><a class=\"glossterm\">probability sampling<\/a><span class=\"glossdef\">Sampling techniques for which a person\u2019s likelihood of being selected for membership in the sample is known.<\/span><\/span> refers to sampling techniques for which a person\u2019s (or event\u2019s) likelihood of being selected for membership in the sample is known. You might ask yourself why we should care about a study element\u2019s likelihood of being selected for membership in a researcher\u2019s sample. The reason is that, in most cases, researchers who use probability sampling techniques are aiming to identify a <span class=\"margin_term\"><a class=\"glossterm\">representative sample<\/a><span class=\"glossdef\">A sample that resembles the population from which it was drawn in all the ways that are important for the research being conducted.<\/span><\/span> from which to collect data. A representative sample is one that resembles the population from which it was drawn in all the ways that are important for the research being conducted. If, for example, you wish to be able to say something about differences between men and women at the end of your study, you better make sure that your sample doesn\u2019t contain only women. That\u2019s a bit of an oversimplification, but the point with representativeness is that if your population varies in some way that is important to your study, your sample should contain the same sorts of variation.<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s01_p02\" class=\"para editable block\">Obtaining a representative sample is important in probability sampling because a key goal of studies that rely on probability samples is <span class=\"margin_term\"><a class=\"glossterm\">generalizability<\/a><span class=\"glossdef\">The idea that a study\u2019s results will tell us something about a group larger than the sample from which the findings were generated.<\/span><\/span>. In fact, generalizability is perhaps the key feature that distinguishes probability samples from nonprobability samples. Generalizability refers to the idea that a study\u2019s results will tell us something about a group larger than the sample from which the findings were generated. In order to achieve generalizability, a core principle of probability sampling is that all elements in the researcher\u2019s target population have an equal chance of being selected for inclusion in the study. In research, this is the principle of <span class=\"margin_term\"><a class=\"glossterm\">random selection<\/a><span class=\"glossdef\">The principle that all elements in a researcher\u2019s target population have an equal chance of being selected for inclusion in the study.<\/span><\/span>. Random selection is a mathematical process that we won\u2019t go into too much depth about here, but if you have taken or plan to take a statistics course, you\u2019ll learn more about it there. The important thing to remember about random selection here is that, as previously noted, it is a core principal of probability sampling. If a researcher uses random selection techniques to draw a sample, he or she will be able to estimate how closely the sample represents the larger population from which it was drawn by estimating the sampling error. <span class=\"margin_term\"><a class=\"glossterm\">Sampling error<\/a><span class=\"glossdef\">The extent to which a sample represents its population on a particular parameter.<\/span><\/span> is a statistical calculation of the difference between results from a sample and the actual <span class=\"margin_term\"><a class=\"glossterm\">parameters<\/a><span class=\"glossdef\">The actual characteristics of a population on any given variable; determined by measuring all elements in a population (as opposed to measuring elements from a sample).<\/span><\/span> of a population.<\/p>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s03_s02\" class=\"section\">\n<h2 class=\"title editable block\">Types of Probability Samples<\/h2>\n<p id=\"blackstone_1.0-ch07_s03_s02_p01\" class=\"para editable block\">There are a variety of probability samples that researchers may use. These include simple random samples, systematic samples, stratified samples, and cluster samples.<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s02_p02\" class=\"para editable block\"><span class=\"margin_term\"><a class=\"glossterm\">Simple random samples<\/a><span class=\"glossdef\">The most basic type of probability sample; a researcher begins with a list of every member of his or her population of interest, numbers each element sequentially, and then randomly selects the elements from which he or she will collect data.<\/span><\/span> are the most basic type of probability sample, but their use is not particularly common. Part of the reason for this may be the work involved in generating a simple random sample. To draw a simple random sample, a researcher starts with a list of every single member, or element, of his or her population of interest. This list is sometimes referred to as a <span class=\"margin_term\"><a class=\"glossterm\">sampling frame<\/a><span class=\"glossdef\">A list of all elements in a population.<\/span><\/span>. Once that list has been created, the researcher numbers each element sequentially and then randomly selects the elements from which he or she will collect data. To randomly select elements, researchers use a table of numbers that have been generated randomly. There are several possible sources for obtaining a random number table. Some statistics and research methods textbooks offer such tables as appendices to the text. Perhaps a more accessible source is one of the many free random number generators available on the Internet. A good online source is the website Stat Trek, which contains a random number generator that you can use to create a random number table of whatever size you might need (<a class=\"link\" href=\"http:\/\/stattrek.com\/Tables\/Random.aspx\" target=\"_blank\" rel=\"noopener\">http:\/\/stattrek.com\/Tables\/Random.aspx<\/a>). Randomizer.org also offers a useful random number generator (<a class=\"link\" href=\"http:\/\/randomizer.org\" target=\"_blank\" rel=\"noopener\">http:\/\/randomizer.org<\/a>).<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s02_p03\" class=\"para editable block\">As you might have guessed, drawing a simple random sample can be quite tedious. <span class=\"margin_term\"><a class=\"glossterm\">Systematic sampling<\/a><span class=\"glossdef\">A researcher divides a study population into relevant subgroups then draws a sample from each subgroup.<\/span><\/span> techniques are somewhat less tedious but offer the benefits of a random sample. As with simple random samples, you must be able to produce a list of every one of your population elements. Once you\u2019ve done that, to draw a systematic sample you\u2019d simply select every <em class=\"emphasis\">k<\/em>th element on your list. But what is <em class=\"emphasis\">k<\/em>, and where on the list of population elements does one begin the selection process? <em class=\"emphasis\">k<\/em> is your <span class=\"margin_term\"><a class=\"glossterm\">selection interval<\/a><span class=\"glossdef\">The distance between elements selected for inclusion in a study.<\/span><\/span> or the distance between the elements you select for inclusion in your study. To begin the selection process, you\u2019ll need to figure out how many elements you wish to include in your sample. Let\u2019s say you want to interview 25 fraternity members on your campus, and there are 100 men on campus who are members of fraternities. In this case, your selection interval, or <em class=\"emphasis\">k<\/em>, is 4. To arrive at 4, simply divide the total number of population elements by your desired sample size. This process is represented in <a class=\"xref\" href=\"#blackstone_1.0-ch07_s03_s02_f02\">Figure 7.5 &#8220;Formula for Determining Selection Interval for Systematic Sample&#8221;<\/a>.<\/p>\n<div id=\"blackstone_1.0-ch07_s03_s02_f02\" class=\"figure large editable block\">\n<p class=\"title\"><span class=\"title-prefix\">Figure 7.5<\/span> Formula for Determining Selection Interval for Systematic Sample<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/3246\/2018\/05\/16141328\/ffba99f3272c4ab03383a3c484d2e046.jpg\" alt=\"image\" \/><\/p>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s03_s02_p04\" class=\"para editable block\">To determine where on your list of population elements to begin selecting the names of the 25 men you will interview, select a random number between 1 and <em class=\"emphasis\">k<\/em>, and begin there. If we randomly select 3 as our starting point, we\u2019d begin by selecting the third fraternity member on the list and then select every fourth member from there. This might be easier to understand if you can see it visually. <a class=\"xref\" href=\"#blackstone_1.0-ch07_s03_s02_t01\">Table 7.2 &#8220;Systematic Sample of 25 Fraternity Members&#8221;<\/a> lists the names of our hypothetical 100 fraternity members on campus. You\u2019ll see that the third name on the list has been selected for inclusion in our hypothetical study, as has every fourth name after that. A total of 25 names have been selected.<\/p>\n<div id=\"blackstone_1.0-ch07_s03_s02_t01\" class=\"table block\">\n<p class=\"title\"><span class=\"title-prefix\">Table 7.2<\/span> Systematic Sample of 25 Fraternity Members<\/p>\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\n<thead>\n<tr>\n<th>Number<\/th>\n<th>Name<\/th>\n<th>Include in study?<\/th>\n<th><\/th>\n<th>Number<\/th>\n<th>Name<\/th>\n<th>Include in study?<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>1<\/td>\n<td>Jacob<\/td>\n<td><\/td>\n<td rowspan=\"50\"><\/td>\n<td>51<\/td>\n<td>Blake<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>Ethan<\/td>\n<td><\/td>\n<td>52<\/td>\n<td>Oliver<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>Michael<\/td>\n<td>Yes<\/td>\n<td>53<\/td>\n<td>Cole<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>Jayden<\/td>\n<td><\/td>\n<td>54<\/td>\n<td>Carlos<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>William<\/td>\n<td><\/td>\n<td>55<\/td>\n<td>Jaden<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td>6<\/td>\n<td>Alexander<\/td>\n<td><\/td>\n<td>56<\/td>\n<td>Jesus<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>7<\/td>\n<td>Noah<\/td>\n<td>Yes<\/td>\n<td>57<\/td>\n<td>Alex<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>8<\/td>\n<td>Daniel<\/td>\n<td><\/td>\n<td>58<\/td>\n<td>Aidan<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>9<\/td>\n<td>Aiden<\/td>\n<td><\/td>\n<td>59<\/td>\n<td>Eric<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td>10<\/td>\n<td>Anthony<\/td>\n<td><\/td>\n<td>60<\/td>\n<td>Hayden<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>11<\/td>\n<td>Joshua<\/td>\n<td>Yes<\/td>\n<td>61<\/td>\n<td>Brian<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>12<\/td>\n<td>Mason<\/td>\n<td><\/td>\n<td>62<\/td>\n<td>Max<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>13<\/td>\n<td>Christopher<\/td>\n<td><\/td>\n<td>63<\/td>\n<td>Jaxon<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td>14<\/td>\n<td>Andrew<\/td>\n<td><\/td>\n<td>64<\/td>\n<td>Brian<\/td>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s03_s02_t11\" class=\"informaltable editable block\">\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\n<thead>\n<tr>\n<th>Number<\/th>\n<th>Name<\/th>\n<th>Include in study?<\/th>\n<th><\/th>\n<th>Number<\/th>\n<th>Name<\/th>\n<th>Include in study?<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>15<\/td>\n<td>David<\/td>\n<td>Yes<\/td>\n<td>65<\/td>\n<td>Matthew<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>16<\/td>\n<td>Logan<\/td>\n<td><\/td>\n<td>66<\/td>\n<td>Elijah<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>17<\/td>\n<td>James<\/td>\n<td><\/td>\n<td>67<\/td>\n<td>Joseph<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>18<\/td>\n<td>Gabriel<\/td>\n<td><\/td>\n<td>68<\/td>\n<td>Benjamin<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>19<\/td>\n<td>Ryan<\/td>\n<td>Yes<\/td>\n<td>69<\/td>\n<td>Samuel<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>20<\/td>\n<td>Jackson<\/td>\n<td><\/td>\n<td>70<\/td>\n<td>John<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>21<\/td>\n<td>Nathan<\/td>\n<td><\/td>\n<td>71<\/td>\n<td>Jonathan<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>22<\/td>\n<td>Christian<\/td>\n<td><\/td>\n<td>72<\/td>\n<td>Liam<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>23<\/td>\n<td>Dylan<\/td>\n<td>Yes<\/td>\n<td>73<\/td>\n<td>Landon<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>24<\/td>\n<td>Caleb<\/td>\n<td><\/td>\n<td>74<\/td>\n<td>Tyler<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>25<\/td>\n<td>Lucas<\/td>\n<td><\/td>\n<td>75<\/td>\n<td>Evan<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>26<\/td>\n<td>Gavin<\/td>\n<td><\/td>\n<td>76<\/td>\n<td>Nicholas<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>27<\/td>\n<td>Isaac<\/td>\n<td>Yes<\/td>\n<td>77<\/td>\n<td>Braden<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>28<\/td>\n<td>Luke<\/td>\n<td><\/td>\n<td>78<\/td>\n<td>Angel<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>29<\/td>\n<td>Brandon<\/td>\n<td><\/td>\n<td>79<\/td>\n<td>Jack<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>30<\/td>\n<td>Isaiah<\/td>\n<td><\/td>\n<td>80<\/td>\n<td>Jordan<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>31<\/td>\n<td>Owen<\/td>\n<td>Yes<\/td>\n<td>81<\/td>\n<td>Carter<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>32<\/td>\n<td>Conner<\/td>\n<td><\/td>\n<td>82<\/td>\n<td>Justin<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>33<\/td>\n<td>Jose<\/td>\n<td><\/td>\n<td>83<\/td>\n<td>Jeremiah<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>34<\/td>\n<td>Julian<\/td>\n<td><\/td>\n<td>84<\/td>\n<td>Robert<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>35<\/td>\n<td>Aaron<\/td>\n<td>Yes<\/td>\n<td>85<\/td>\n<td>Adrian<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>36<\/td>\n<td>Wyatt<\/td>\n<td><\/td>\n<td>86<\/td>\n<td>Kevin<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>37<\/td>\n<td>Hunter<\/td>\n<td><\/td>\n<td>87<\/td>\n<td>Cameron<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>38<\/td>\n<td>Zachary<\/td>\n<td><\/td>\n<td>88<\/td>\n<td>Thomas<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>39<\/td>\n<td>Charles<\/td>\n<td>Yes<\/td>\n<td>89<\/td>\n<td>Austin<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>40<\/td>\n<td>Eli<\/td>\n<td><\/td>\n<td>90<\/td>\n<td>Chase<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>41<\/td>\n<td>Henry<\/td>\n<td><\/td>\n<td>91<\/td>\n<td>Sebastian<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>42<\/td>\n<td>Jason<\/td>\n<td><\/td>\n<td>92<\/td>\n<td>Levi<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>43<\/td>\n<td>Xavier<\/td>\n<td>Yes<\/td>\n<td>93<\/td>\n<td>Ian<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>44<\/td>\n<td>Colton<\/td>\n<td><\/td>\n<td>94<\/td>\n<td>Dominic<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>45<\/td>\n<td>Juan<\/td>\n<td><\/td>\n<td>95<\/td>\n<td>Cooper<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>46<\/td>\n<td>Josiah<\/td>\n<td><\/td>\n<td>96<\/td>\n<td>Luis<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>47<\/td>\n<td>Ayden<\/td>\n<td>Yes<\/td>\n<td>97<\/td>\n<td>Carson<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>48<\/td>\n<td>Adam<\/td>\n<td><\/td>\n<td>98<\/td>\n<td>Nathaniel<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>49<\/td>\n<td>Brody<\/td>\n<td><\/td>\n<td>99<\/td>\n<td>Tristan<\/td>\n<td>Yes<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>50<\/td>\n<td>Diego<\/td>\n<td><\/td>\n<td>100<\/td>\n<td>Parker<\/td>\n<td><\/td>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<tfoot>\n<tr>\n<th colspan=\"7\"><em class=\"emphasis\">Note:<\/em> In case you\u2019re wondering how I came up with 100 unique names for this table, I\u2019ll let you in on a little secret: lists of popular baby names can be great resources for researchers. I used the list of top 100 names for boys based on Social Security Administration statistics for this table. I often use baby name lists to come up with pseudonyms for field research subjects and interview participants. See Family Education. (n.d.). Name lab. Retrieved from <a class=\"link\" href=\"http:\/\/baby-names.familyeducation.com\/popular-names\/boys\" target=\"_blank\" rel=\"noopener\">http:\/\/baby-names.familyeducation.com\/popular-names\/boys<\/a>.<\/th>\n<\/tr>\n<\/tfoot>\n<\/table>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s03_s02_p05\" class=\"para editable block\">There is one clear instance in which systematic sampling should not be employed. If your sampling frame has any pattern to it, you could inadvertently introduce bias into your sample by using a systemic sampling strategy. This is sometimes referred to as the problem of <span class=\"margin_term\"><a class=\"glossterm\">periodicity<\/a><span class=\"glossdef\">The tendency for a pattern to occur at regular intervals.<\/span><\/span>. Periodicity refers to the tendency for a pattern to occur at regular intervals. Let\u2019s say, for example, that you wanted to observe how people use the outdoor public spaces on your campus. Perhaps you need to have your observations completed within 28 days and you wish to conduct four observations on randomly chosen days. <a class=\"xref\" href=\"#blackstone_1.0-ch07_s03_s02_t02\">Table 7.3 &#8220;Systematic Sample of Observation Days&#8221;<\/a> shows a list of the population elements for this example. To determine which days we\u2019ll conduct our observations, we\u2019ll need to determine our selection interval. As you\u2019ll recall from the preceding paragraphs, to do so we must divide our population size, in this case 28 days, by our desired sample size, in this case 4 days. This formula leads us to a selection interval of 7. If we randomly select 2 as our starting point and select every seventh day after that, we\u2019ll wind up with a total of 4 days on which to conduct our observations. You\u2019ll see how that works out in the following table.<\/p>\n<div id=\"blackstone_1.0-ch07_s03_s02_t02\" class=\"table block\">\n<p class=\"title\"><span class=\"title-prefix\">Table 7.3<\/span> Systematic Sample of Observation Days<\/p>\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\n<thead>\n<tr>\n<th>Number<\/th>\n<th>Day<\/th>\n<th>Include in study?<\/th>\n<th><\/th>\n<th>Number<\/th>\n<th>Day<\/th>\n<th>Include in study?<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>1<\/td>\n<td>Monday<\/td>\n<td><\/td>\n<td rowspan=\"14\"><\/td>\n<td>15<\/td>\n<td>Monday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>Tuesday<\/td>\n<td>Yes<\/td>\n<td>16<\/td>\n<td>Tuesday<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>Wednesday<\/td>\n<td><\/td>\n<td>17<\/td>\n<td>Wednesday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>Thursday<\/td>\n<td><\/td>\n<td>18<\/td>\n<td>Thursday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>Friday<\/td>\n<td><\/td>\n<td>19<\/td>\n<td>Friday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>6<\/td>\n<td>Saturday<\/td>\n<td><\/td>\n<td>20<\/td>\n<td>Saturday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>7<\/td>\n<td>Sunday<\/td>\n<td><\/td>\n<td>21<\/td>\n<td>Sunday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>8<\/td>\n<td>Monday<\/td>\n<td><\/td>\n<td>22<\/td>\n<td>Monday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>9<\/td>\n<td>Tuesday<\/td>\n<td>Yes<\/td>\n<td>23<\/td>\n<td>Tuesday<\/td>\n<td>Yes<\/td>\n<\/tr>\n<tr>\n<td>10<\/td>\n<td>Wednesday<\/td>\n<td><\/td>\n<td>24<\/td>\n<td>Wednesday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>11<\/td>\n<td>Thursday<\/td>\n<td><\/td>\n<td>25<\/td>\n<td>Thursday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>12<\/td>\n<td>Friday<\/td>\n<td><\/td>\n<td>26<\/td>\n<td>Friday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>13<\/td>\n<td>Saturday<\/td>\n<td><\/td>\n<td>27<\/td>\n<td>Saturday<\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td>14<\/td>\n<td>Sunday<\/td>\n<td><\/td>\n<td>28<\/td>\n<td>Sunday<\/td>\n<td><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s03_s02_p06\" class=\"para editable block\">Do you notice any problems with our selection of observation days? Apparently we\u2019ll only be observing on Tuesdays. As you have probably figured out, that isn\u2019t such a good plan if we really wish to understand how public spaces on campus are used. My guess is that weekend use probably differs from weekday use, and that use may even vary during the week, just as class schedules do. In cases such as this, where the sampling frame is cyclical, it would be better to use a <span class=\"margin_term\"><a class=\"glossterm\">stratified sampling technique<\/a><span class=\"glossdef\">A researcher divides the study population into relevant subgroups then draws a sample from within each subgroup.<\/span><\/span>. In stratified sampling, a researcher will divide the study population into relevant subgroups and <em class=\"emphasis\">then<\/em> draw a sample from each subgroup. In this example, we might wish to first divide our sampling frame into two lists: weekend days and weekdays. Once we have our two lists, we can then apply either simple random or systematic sampling techniques to each subgroup.<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s02_p07\" class=\"para editable block\">Stratified sampling is a good technique to use when, as in our example, a subgroup of interest makes up a relatively small proportion of the overall sample. In our example of a study of use of public space on campus, we want to be sure to include weekdays and weekends in our sample, but because weekends make up less than a third of an entire week, there\u2019s a chance that a simple random or systematic strategy would not yield sufficient weekend observation days. As you might imagine, stratified sampling is even more useful in cases where a subgroup makes up an even smaller proportion of the study population, say, for example, if we want to be sure to include both men\u2019s and women\u2019s perspectives in a study, but men make up only a small percentage of the population. There\u2019s a chance simple random or systematic sampling strategy might not yield any male participants, but by using stratified sampling, we could ensure that our sample contained the proportion of men that is reflective of the larger population.<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s02_p08\" class=\"para editable block\">Up to this point in our discussion of probability samples, we\u2019ve assumed that researchers will be able to access a list of population elements in order to create a sampling frame. This, as you might imagine, is not always the case. Let\u2019s say, for example, that you wish to conduct a study of hairstyle preferences across the United States. Just imagine trying to create a list of every single person with (and without) hair in the country. Basically, we\u2019re talking about a list of every person in the country. Even if you could find a way to generate such a list, attempting to do so might not be the most practical use of your time or resources. When this is the case, researchers turn to cluster sampling. <span class=\"margin_term\"><a class=\"glossterm\">Cluster sampling<\/a><span class=\"glossdef\">A researcher begins by sampling groups of population elements and then selects elements from within those groups.<\/span><\/span> occurs when a researcher begins by sampling groups (or clusters) of population elements and then selects elements from within those groups.<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s02_p09\" class=\"para editable block\">Let\u2019s take a look at a couple more examples. Perhaps you are interested in the workplace experiences of public librarians. Chances are good that obtaining a list of all librarians that work for public libraries would be rather difficult. But I\u2019ll bet you could come up with a list of all public libraries without too much hassle. Thus you could draw a random sample of libraries (your cluster) and then draw another random sample of elements (in this case, librarians) from within the libraries you initially selected. Cluster sampling works in stages. In this example, we sampled in two stages. As you might have guessed, sampling in multiple stages does introduce the possibility of greater error (each stage is subject to its own sampling error), but it is nevertheless a highly efficient method.<\/p>\n<p id=\"blackstone_1.0-ch07_s03_s02_p10\" class=\"para editable block\">Jessica Holt and Wayne Gillespie (2008)<span id=\"blackstone_1.0-fn07_008\" class=\"footnote\">Holt, J. L., &amp; Gillespie, W. (2008). Intergenerational transmission of violence, threatened egoism, and reciprocity: A test of multiple pychosocial factors affecting intimate partner violence. <em class=\"emphasis\">American Journal of Criminal Justice, 33<\/em>, 252\u2013266.<\/span> used cluster sampling in their study of students\u2019 experiences with violence in intimate relationships. Specifically, the researchers randomly selected 14 classes on their campus and then drew a random subsample of students from those classes. But you probably know from your experience with college classes that not all classes are the same size. So if Holt and Gillespie had simply randomly selected 14 classes and then selected the same number of students from each class to complete their survey, then students in the smaller of those classes would have had a greater chance of being selected for the study than students in the larger classes. Keep in mind with random sampling the goal is to make sure that each element has the same chance of being selected. When clusters are of different sizes, as in the example of sampling college classes, researchers often use a method called <span class=\"margin_term\"><a class=\"glossterm\">probability proportionate to size<\/a><span class=\"glossdef\">A cluster sampling technique in which each cluster is given a chance of selection based on its size.<\/span><\/span> (PPS). This means that they take into account that their clusters are of different sizes. They do this by giving clusters different chances of being selected based on their size so that each element within those clusters winds up having an equal chance of being selected.<\/p>\n<div id=\"blackstone_1.0-ch07_s03_s02_t03\" class=\"table block\">\n<p class=\"title\"><span class=\"title-prefix\">Table 7.4<\/span> Types of Probability Samples<\/p>\n<table style=\"border-spacing: 0px\" cellpadding=\"0\">\n<thead>\n<tr>\n<th>Sample type<\/th>\n<th>Description<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Simple random<\/td>\n<td>Researcher randomly selects elements from sampling frame.<\/td>\n<\/tr>\n<tr>\n<td>Systematic<\/td>\n<td>Researcher selects every <em class=\"emphasis\">k<\/em>th element from sampling frame.<\/td>\n<\/tr>\n<tr>\n<td>Stratified<\/td>\n<td>Researcher creates subgroups then randomly selects elements from each subgroup.<\/td>\n<\/tr>\n<tr>\n<td>Cluster<\/td>\n<td>Researcher randomly selects clusters then randomly selects elements from selected clusters.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s03_s02_n01\" class=\"key_takeaways editable block\">\n<h3 class=\"title\">Key Takeaways<\/h3>\n<ul id=\"blackstone_1.0-ch07_s03_s02_l01\" class=\"itemizedlist\">\n<li>In probability sampling, the aim is to identify a sample that resembles the population from which it was drawn.<\/li>\n<li>There are several types of probability samples including simple random samples, systematic samples, stratified samples, and cluster samples.<\/li>\n<\/ul>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s03_s02_n02\" class=\"exercises editable block\">\n<h3 class=\"title\">Exercises<\/h3>\n<ol id=\"blackstone_1.0-ch07_s03_s02_l02\" class=\"orderedlist\">\n<li>Imagine that you are about to conduct a study of people\u2019s use of public parks. Explain how you could employ each of the probability sampling techniques described earlier to recruit a sample for your study.<\/li>\n<li>Of the four probability sample types described, which seems strongest to you? Which seems weakest? Explain.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s04\" class=\"section\" xml:lang=\"en\">\n<h2 class=\"title editable block\"><span class=\"title-prefix\">7.4<\/span> A Word of Caution: Questions to Ask About Samples<\/h2>\n<div id=\"blackstone_1.0-ch07_s04_n01\" class=\"learning_objectives editable block\">\n<h3 class=\"title\">Learning Objectives<\/h3>\n<ol id=\"blackstone_1.0-ch07_s04_l01\" class=\"orderedlist\">\n<li>Identify several questions we should ask about samples when reading the results of research.<\/li>\n<li>Name some tenets worth keeping in mind with respect to responsibly reading research findings.<\/li>\n<\/ol>\n<\/div>\n<p id=\"blackstone_1.0-ch07_s04_p01\" class=\"para editable block\">We read and hear about research results so often that we might overlook the need to ask important questions about where research participants come from and how they are identified for inclusion in a research project. It is easy to focus only on findings when we\u2019re busy and when the really interesting stuff is in a study\u2019s conclusions, not its procedures. But now that you have some familiarity with the variety of procedures for selecting study participants, you are equipped to ask some very important questions about the findings you read and to be a more responsible consumer of research.<\/p>\n<div id=\"blackstone_1.0-ch07_s04_s01\" class=\"section\">\n<h2 class=\"title editable block\">Who Sampled, How Sampled, and for What Purpose?<\/h2>\n<p id=\"blackstone_1.0-ch07_s04_s01_p01\" class=\"para editable block\">Have you ever been a participant in someone\u2019s research? If you have ever taken an introductory psychology or sociology class at a large university, that\u2019s probably a silly question to ask. Social science researchers on college campuses have a luxury that researchers elsewhere may not share\u2014they have access to a whole bunch of (presumably) willing and able human guinea pigs. But that luxury comes at a cost\u2014sample representativeness. One study of top academic journals in psychology found that over two-thirds (68%) of participants in studies published by those journals were based on samples drawn in the United States (Arnett, 2008).<span id=\"blackstone_1.0-fn07_009\" class=\"footnote\">Arnett, J. J. (2008). The neglected 95%: Why American psychology needs to become less American. <em class=\"emphasis\">American Psychologist, 63<\/em>, 602\u2013614.<\/span> Further, the study found that two-thirds of the work that derived from US samples published in the <em class=\"emphasis\">Journal of Personality and Social Psychology<\/em> was based on samples made up entirely of American undergraduates taking psychology courses.<\/p>\n<p id=\"blackstone_1.0-ch07_s04_s01_p02\" class=\"para editable block\">These findings certainly beg the question: What do we actually learn from social scientific studies and about whom do we learn it? That is exactly the concern raised by Joseph Henrich and colleagues (Henrich, Heine, &amp; Norenzayan, 2010),<span id=\"blackstone_1.0-fn07_010\" class=\"footnote\">Henrich, J., Heine, S. J., &amp; Norenzayan, A. (2010). The weirdest people in the world? <em class=\"emphasis\">Behavioral and Brain Sciences, 33<\/em>, 61\u2013135.<\/span> authors of the article \u201cThe Weirdest People in the World?\u201d In their piece, Henrich and colleagues point out that behavioral scientists very commonly make sweeping claims about human nature based on samples drawn only from WEIRD (Western, educated, industrialized, rich, and democratic) societies, and often based on even narrower samples, as is the case with many studies relying on samples drawn from college classrooms. As it turns out, many robust findings about the nature of human behavior when it comes to fairness, cooperation, visual perception, trust, and other behaviors are based on studies that excluded participants from outside the United States and sometimes excluded anyone outside the college classroom (Begley, 2010).<span id=\"blackstone_1.0-fn07_011\" class=\"footnote\"><em class=\"emphasis\">Newsweek<\/em> magazine published an interesting story about Henrich and his colleague\u2019s study: Begley, S. (2010). What\u2019s really human? The trouble with student guinea pigs. Retrieved from <a class=\"link\" href=\"http:\/\/www.newsweek.com\/2010\/07\/23\/what-s-really-human.html\" target=\"_blank\" rel=\"noopener\">http:\/\/www.newsweek.com\/2010\/07\/23\/what-s-really-human.html<\/a><\/span> This certainly raises questions about what we really know about human behavior as opposed to US resident or US undergraduate behavior. Of course not all research findings are based on samples of WEIRD folks like college students. But even then it would behoove us to pay attention to the population on which studies are based and the claims that are being made about to whom those studies apply.<\/p>\n<p id=\"blackstone_1.0-ch07_s04_s01_p03\" class=\"para editable block\">In the preceding discussion, the concern is with researchers making claims about populations other than those from which their samples were drawn. A related, but slightly different, potential concern is <span class=\"margin_term\"><a class=\"glossterm\">sampling bias<\/a><span class=\"glossdef\">Occurs when the elements selected for inclusion in a study do not represent the larger population from which they were drawn.<\/span><\/span>. Bias in sampling occurs when the elements selected for inclusion in a study do not represent the larger population from which they were drawn. For example, a poll conducted online by a newspaper asking for the public\u2019s opinion about some local issue will certainly not represent the public since those without access to computers or the Internet, those who do not read that paper\u2019s website, and those who do not have the time or interest will not answer the question.<\/p>\n<p id=\"blackstone_1.0-ch07_s04_s01_p04\" class=\"para editable block\">Another thing to keep in mind is that just because a sample may be representative in all respects that a researcher thinks are relevant, there may be aspects that are relevant that didn\u2019t occur to the researcher when she was drawing her sample. You might not think that a person\u2019s phone would have much to do with their voting preferences, for example. But had pollsters making predictions about the results of the 2008 presidential election not been careful to include both cell phone\u2013only and landline households in their surveys, it is possible that their predictions would have underestimated Barack Obama\u2019s lead over John McCain because Obama was much more popular among cell-only users than McCain (Keeter, Dimock, &amp; Christian, 2008).<span id=\"blackstone_1.0-fn07_012\" class=\"footnote\">Keeter, S., Dimock, M., &amp; Christian, L. (2008). Calling cell phones in \u201908 pre-election polls. <em class=\"emphasis\">The Pew Research Center for the People and the Press<\/em>. Retrieved from <a class=\"link\" href=\"http:\/\/people-press.org\/http:\/\/people-press.org\/files\/legacy-pdf\/cell-phone-commentary.pdf\" target=\"_blank\" rel=\"noopener\">http:\/\/people-press.org\/http:\/\/people-press.org\/files\/legacy-pdf\/cell-phone-commentary.pdf<\/a><\/span><\/p>\n<p id=\"blackstone_1.0-ch07_s04_s01_p05\" class=\"para editable block\">So how do we know when we can count on results that are being reported to us? While there might not be any magic or always-true rules we can apply, there are a couple of things we can keep in mind as we read the claims researchers make about their findings. First, remember that sample quality is determined only by the sample actually obtained, not by the sampling method itself. A researcher may set out to administer a survey to a representative sample by correctly employing a random selection technique, but if only a handful of the people sampled actually respond to the survey, the researcher will have to be very careful about the claims he can make about his survey findings. Another thing to keep in mind, as demonstrated by the preceding discussion, is that researchers may be drawn to talking about implications of their findings as though they apply to some group other than the population actually sampled. Though this tendency is usually quite innocent and does not come from a place of malice, it is all too tempting a way to talk about findings; as consumers of those findings, it is our responsibility to be attentive to this sort of (likely unintentional) bait and switch.<\/p>\n<p id=\"blackstone_1.0-ch07_s04_s01_p06\" class=\"para editable block\">Finally, keep in mind that a sample that allows for comparisons of theoretically important concepts or variables is certainly better than one that does not allow for such comparisons. In a study based on a nonrepresentative sample, for example, we can learn about the strength of our social theories by comparing relevant aspects of social processes. Klawiter\u2019s previously mentioned study (1999)<span id=\"blackstone_1.0-fn07_013\" class=\"footnote\">Klawiter, M. (1999). Racing for the cure, walking women, and toxic touring: Mapping cultures of action within the Bay Area terrain of breast cancer. <em class=\"emphasis\">Social Problems, 46<\/em>, 104\u2013126.<\/span> of three carefully chosen breast cancer activist groups allowed her to contribute to our understandings of activism by addressing potential weaknesses in theories of social change.<\/p>\n<p id=\"blackstone_1.0-ch07_s04_s01_p07\" class=\"para editable block\">At their core, questions about sample quality should address who has been sampled, how they were sampled, and for what purpose they were sampled. Being able to answer those questions will help you better understand, and more responsibly read, research results.<\/p>\n<div id=\"blackstone_1.0-ch07_s04_s01_n01\" class=\"key_takeaways editable block\">\n<h3 class=\"title\">Key Takeaways<\/h3>\n<ul id=\"blackstone_1.0-ch07_s04_s01_l01\" class=\"itemizedlist\">\n<li>Sometimes researchers may make claims about populations other than those from whom their samples were drawn; other times they may make claims about a population based on a sample that is not representative. As consumers of research, we should be attentive to both possibilities.<\/li>\n<li>A researcher\u2019s findings need not be generalizable to be valuable; samples that allow for comparisons of theoretically important concepts or variables may yield findings that contribute to our social theories and our understandings of social processes.<\/li>\n<\/ul>\n<\/div>\n<div id=\"blackstone_1.0-ch07_s04_s01_n02\" class=\"exercises editable block\">\n<h3 class=\"title\">Exercise<\/h3>\n<ol id=\"blackstone_1.0-ch07_s04_s01_l02\" class=\"orderedlist\">\n<li>Find any news story or blog entry that describes results from any social scientific study. How much detail is reported about the study\u2019s sample? What sorts of claims are being made about the study\u2019s findings, and to whom do they apply?<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\t\t\t <section class=\"citations-section\" role=\"contentinfo\">\n\t\t\t <h3>Candela Citations<\/h3>\n\t\t\t\t\t <div>\n\t\t\t\t\t\t <div id=\"citation-list-75\">\n\t\t\t\t\t\t\t <div class=\"licensing\"><div class=\"license-attribution-dropdown-subheading\">CC licensed content, Shared previously<\/div><ul class=\"citation-list\"><li>Principles of Sociological Inquiry: Qualitative and Quantitative Methods. <strong>Provided by<\/strong>: Saylor Academy. <strong>Located at<\/strong>: <a target=\"_blank\" href=\"https:\/\/saylordotorg.github.io\/text_principles-of-sociological-inquiry-qualitative-and-quantitative-methods\/\">https:\/\/saylordotorg.github.io\/text_principles-of-sociological-inquiry-qualitative-and-quantitative-methods\/<\/a>. <strong>License<\/strong>: <em><a target=\"_blank\" rel=\"license\" href=\"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/\">CC BY-NC-SA: Attribution-NonCommercial-ShareAlike<\/a><\/em><\/li><\/ul><\/div>\n\t\t\t\t\t\t <\/div>\n\t\t\t\t\t <\/div>\n\t\t\t <\/section>","protected":false},"author":18697,"menu_order":7,"template":"","meta":{"_candela_citation":"[{\"type\":\"cc\",\"description\":\"Principles of Sociological Inquiry: Qualitative and Quantitative Methods\",\"author\":\"\",\"organization\":\"Saylor Academy\",\"url\":\"https:\/\/saylordotorg.github.io\/text_principles-of-sociological-inquiry-qualitative-and-quantitative-methods\/\",\"project\":\"\",\"license\":\"cc-by-nc-sa\",\"license_terms\":\"\"}]","CANDELA_OUTCOMES_GUID":"","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-75","chapter","type-chapter","status-publish","hentry"],"part":3,"_links":{"self":[{"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/chapters\/75","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/wp\/v2\/users\/18697"}],"version-history":[{"count":2,"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/chapters\/75\/revisions"}],"predecessor-version":[{"id":140,"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/chapters\/75\/revisions\/140"}],"part":[{"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/parts\/3"}],"metadata":[{"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/chapters\/75\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/wp\/v2\/media?parent=75"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/pressbooks\/v2\/chapter-type?post=75"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/wp\/v2\/contributor?post=75"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-oldwestbury-sociological-inquiry\/wp-json\/wp\/v2\/license?post=75"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}