{"id":5307,"date":"2022-08-19T16:14:50","date_gmt":"2022-08-19T16:14:50","guid":{"rendered":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/?post_type=chapter&#038;p=5307"},"modified":"2022-08-19T16:15:32","modified_gmt":"2022-08-19T16:15:32","slug":"11a-coreq","status":"publish","type":"chapter","link":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/chapter\/11a-coreq\/","title":{"raw":"11A Coreq","rendered":"11A Coreq"},"content":{"raw":"In the next preview assignment and in the next class, you will need to identify population parameters of interest and then determine whether a given sample statistic is evidence that the parameter actually does not have a particular assumed value.\r\n\r\nSurprising Water Samples\r\n\r\nThe next in-class activity uses the context of the Flint, Michigan water crisis (beginning in 2014). During that event, the city of Flint switched water sources, and the residents began to suspect that their water was contaminated with lead. The Michigan Department of Environmental Quality (DEQ) claimed that the water was compliant with federal regulations and that there was not a contamination problem. The federal guidelines for water safety state that a city is compliant if at least 90% of water samples obtained from residences have lead in the water under 15 parts per billion (ppb). A water sample is \u201ccontaminated\u201d if it contains lead at 15 ppb or above. In other words, under 10% of residences would need to be contaminated in order for the city to be compliant.\r\n\r\nThe residents of Flint suspected that more than 10% of the homes in the city had contaminated water, so they took their own sample of residences with support from scientists at Virginia Tech. They tested the water from 271 homes as part of the Flint Water Study (FWS), and they recorded the proportion of homes which had contaminated water.[footnote]Barry-Jester, A. M. (2016, January 26). <em>What went wrong in Flint<\/em>. FiveThirtyEight. https:\/\/fivethirtyeight.com\/features\/what-went-wrong-in-flint-water-crisis-michigan\/[\/footnote]\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 1<\/h3>\r\nWhat is the population of interest in this study?\r\n<ol style=\"list-style-type: lower-alpha;\">\r\n \t<li>All of the residences in Flint, Michigan<\/li>\r\n \t<li>The 271 homes from which the water was tested<\/li>\r\n \t<li>All of the water in Flint, Michigan<\/li>\r\n \t<li>All of the residences in Flint, Michigan that had contaminated water e) All of the residences in the 271 sampled that had contaminated water<\/li>\r\n<\/ol>\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 2<\/h3>\r\nWhat is the sample being considered in this study?\r\n<ol style=\"list-style-type: lower-alpha;\">\r\n \t<li>All of the residences in Flint, Michigan<\/li>\r\n \t<li>The 271 homes from which the water was tested<\/li>\r\n \t<li>All of the water in Flint, Michigan<\/li>\r\n \t<li>All of the residences in Flint, Michigan that had contaminated water<\/li>\r\n \t<li>All of the residences in the 271 sampled that had contaminated water<\/li>\r\n<\/ol>\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 3<\/h3>\r\nWhat is the parameter of interest in this study?\r\n<ol style=\"list-style-type: lower-alpha;\">\r\n \t<li>The mean lead level from all homes in Flint<\/li>\r\n \t<li>The mean lead level from all homes in the sample<\/li>\r\n \t<li>The proportion of homes in Flint which had contaminated water<\/li>\r\n \t<li>The proportion of homes in the sample which had contaminated water<\/li>\r\n<\/ol>\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 4<\/h3>\r\nWhich sample statistic is being considered in the study?\r\n<ol style=\"list-style-type: lower-alpha;\">\r\n \t<li>The mean lead level from all homes in Flint<\/li>\r\n \t<li>The mean lead level from all homes in the sample<\/li>\r\n \t<li>The proportion of homes in Flint which had contaminated water<\/li>\r\n \t<li>The proportion of homes in the sample which had contaminated water<\/li>\r\n<\/ol>\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 5<\/h3>\r\nThe logic behind hypothesis testing involves looking at a result from a sample and\u00a0 determining whether that result is enough evidence to reject a previous assumption.\r\n\r\nIn this context, the baseline assumption was that the DEQ was correct and the city\u00a0 of Flint was compliant with federal water safety regulations, so the proportion of\u00a0 residences with contaminated water was not over 10%. It was the FWS\u2019s responsibility to provide evidence that the city was really not compliant and that\u00a0 there was actually a higher proportion of homes with contaminated water.\r\n\r\nSince it was the FWS\u2019s responsibility to provide evidence against the baseline\u00a0 assumption that Flint was compliant with federal regulations, they had to assume\u00a0 Flint was compliant and then see if their sample result was surprising. A surprising\u00a0 result would have been evidence that the assumption was wrong and that there was actually a higher proportion of homes with contaminated water.\r\n\r\nThis is a conditional statement because we assume a certain condition had to be\u00a0 true (in this case, that Flint was compliant with federal water safety regulations) and\u00a0 are drawing conclusions based on that assumption.\r\n\r\nThe question we want to ask here is, \u201cIf Flint was compliant with federal water safety\u00a0 regulations, was the FWS sample result surprising?\u201d\r\n<ol style=\"list-style-type: lower-alpha;\">\r\n \t<li>What does a \u201csurprising event\u201d refer to in the probability context?\r\n<ol>\r\n \t<li>The event has a high probability of occurring.<\/li>\r\n \t<li>The event has a low probability of occurring.<\/li>\r\n \t<li>There is a 50\/50 chance the event will occur.<\/li>\r\n<\/ol>\r\n<\/li>\r\n \t<li>If Flint was really compliant with federal water safety regulations, which\u00a0 would you most expect to be true?\r\n<ol>\r\n \t<li>There was a large proportion of houses in Flint with contaminated water.<\/li>\r\n \t<li>There was a fairly large proportion of houses in Flint with contaminated\u00a0 water.<\/li>\r\n \t<li>There was a moderate proportion of houses in Flint with contaminated\u00a0 water.<\/li>\r\n \t<li>There was a very small proportion of houses in Flint with contaminated\u00a0 water.<\/li>\r\n<\/ol>\r\n<\/li>\r\n \t<li>If Flint was really compliant with federal water safety regulations, which event\u00a0 would be most surprising?\r\n<ol>\r\n \t<li>A smaller proportion of houses in the sample having contaminated water<\/li>\r\n \t<li>A larger proportion of houses in the sample having contaminated water<\/li>\r\n \t<li>No houses in the sample having contaminated water<\/li>\r\n<\/ol>\r\n<\/li>\r\n \t<li>Explain your answer to Part c.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 6<\/h3>\r\nThe FWS found that a large proportion of houses in their sample had contaminated\u00a0 water. What might you conclude from that?\r\n\r\nHint: Remember that the FWS was working under the assumption that Flint was\u00a0 compliant with federal water safety regulations, as found by the DEQ, so they were\u00a0 seeking evidence that this assumption was wrong.\r\n<ol style=\"list-style-type: lower-alpha;\">\r\n \t<li>It is very unlikely that a large proportion of houses had contaminated water if the water source was actually contaminated, so the sample was strong evidence that the DEQ was incorrect.<\/li>\r\n \t<li>It is very likely that a large proportion of houses had contaminated water if the\u00a0 water source was actually contaminated, so the sample was not strong evidence\u00a0 that the DEQ was incorrect.<\/li>\r\n \t<li>It is very unlikely that a large proportion of houses had contaminated water if the water source was not contaminated, so the sample was strong evidence that the\u00a0 DEQ was incorrect.<\/li>\r\n \t<li>It is very likely that a large proportion of houses had contaminated water if the\u00a0 water source was actually contaminated, so the sample was not strong evidence\u00a0 that the DEQ was incorrect.<\/li>\r\n<\/ol>\r\n<\/div>\r\nSummary: When using statistical hypothesis testing to test an assumption:\r\n<ul>\r\n \t<li>We start with a baseline assumption about a population parameter of interest\u00a0 (this is called the null hypothesis), and we assume this to be true.<\/li>\r\n \t<li>We collect a sample, and we ask whether that sample is surprising if our baseline\u00a0 assumption is actually true.<\/li>\r\n \t<li>If the sample result is very surprising (i.e., very unlikely), we then have strong\u00a0 evidence that our starting assumption was incorrect.<\/li>\r\n<\/ul>\r\nPractice\r\n\r\nThe American Community Survey (ACS) is a survey of around 3.5 million homes in the\u00a0 United States and Puerto Rico conducted annually by the U.S. Census Bureau.\u00a0 Aggregate data from the ACS are released every five years. The overall ACS poverty\u00a0 rate from 2015 to 2019 was reported to be 13.4%.[footnote]U.S. Census Bureau. (2020, December 10). <em>Census Bureau releases new American community survey 5-year estimates.<\/em> https:\/\/www.census.gov\/newsroom\/press-releases\/2020\/acs-5-year.html[\/footnote] Suppose that some new economic\u00a0 reforms were made in the years after 2019, and you want to test whether or not the\u00a0 poverty rate has decreased.\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 7<\/h3>\r\nIf the poverty rate has not decreased, what poverty rate would you expect to find in a\u00a0 random sample of American adults?\r\n\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Question 8<\/h3>\r\nIf the poverty rate has not decreased, what poverty rate would be very surprising to\u00a0 obtain in a sample?\r\n\r\n<\/div>\r\n&nbsp;","rendered":"<p>In the next preview assignment and in the next class, you will need to identify population parameters of interest and then determine whether a given sample statistic is evidence that the parameter actually does not have a particular assumed value.<\/p>\n<p>Surprising Water Samples<\/p>\n<p>The next in-class activity uses the context of the Flint, Michigan water crisis (beginning in 2014). During that event, the city of Flint switched water sources, and the residents began to suspect that their water was contaminated with lead. The Michigan Department of Environmental Quality (DEQ) claimed that the water was compliant with federal regulations and that there was not a contamination problem. The federal guidelines for water safety state that a city is compliant if at least 90% of water samples obtained from residences have lead in the water under 15 parts per billion (ppb). A water sample is \u201ccontaminated\u201d if it contains lead at 15 ppb or above. In other words, under 10% of residences would need to be contaminated in order for the city to be compliant.<\/p>\n<p>The residents of Flint suspected that more than 10% of the homes in the city had contaminated water, so they took their own sample of residences with support from scientists at Virginia Tech. They tested the water from 271 homes as part of the Flint Water Study (FWS), and they recorded the proportion of homes which had contaminated water.<a class=\"footnote\" title=\"Barry-Jester, A. M. (2016, January 26). What went wrong in Flint. FiveThirtyEight. https:\/\/fivethirtyeight.com\/features\/what-went-wrong-in-flint-water-crisis-michigan\/\" id=\"return-footnote-5307-1\" href=\"#footnote-5307-1\" aria-label=\"Footnote 1\"><sup class=\"footnote\">[1]<\/sup><\/a><\/p>\n<div class=\"textbox key-takeaways\">\n<h3>Question 1<\/h3>\n<p>What is the population of interest in this study?<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>All of the residences in Flint, Michigan<\/li>\n<li>The 271 homes from which the water was tested<\/li>\n<li>All of the water in Flint, Michigan<\/li>\n<li>All of the residences in Flint, Michigan that had contaminated water e) All of the residences in the 271 sampled that had contaminated water<\/li>\n<\/ol>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Question 2<\/h3>\n<p>What is the sample being considered in this study?<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>All of the residences in Flint, Michigan<\/li>\n<li>The 271 homes from which the water was tested<\/li>\n<li>All of the water in Flint, Michigan<\/li>\n<li>All of the residences in Flint, Michigan that had contaminated water<\/li>\n<li>All of the residences in the 271 sampled that had contaminated water<\/li>\n<\/ol>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Question 3<\/h3>\n<p>What is the parameter of interest in this study?<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>The mean lead level from all homes in Flint<\/li>\n<li>The mean lead level from all homes in the sample<\/li>\n<li>The proportion of homes in Flint which had contaminated water<\/li>\n<li>The proportion of homes in the sample which had contaminated water<\/li>\n<\/ol>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Question 4<\/h3>\n<p>Which sample statistic is being considered in the study?<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>The mean lead level from all homes in Flint<\/li>\n<li>The mean lead level from all homes in the sample<\/li>\n<li>The proportion of homes in Flint which had contaminated water<\/li>\n<li>The proportion of homes in the sample which had contaminated water<\/li>\n<\/ol>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Question 5<\/h3>\n<p>The logic behind hypothesis testing involves looking at a result from a sample and\u00a0 determining whether that result is enough evidence to reject a previous assumption.<\/p>\n<p>In this context, the baseline assumption was that the DEQ was correct and the city\u00a0 of Flint was compliant with federal water safety regulations, so the proportion of\u00a0 residences with contaminated water was not over 10%. It was the FWS\u2019s responsibility to provide evidence that the city was really not compliant and that\u00a0 there was actually a higher proportion of homes with contaminated water.<\/p>\n<p>Since it was the FWS\u2019s responsibility to provide evidence against the baseline\u00a0 assumption that Flint was compliant with federal regulations, they had to assume\u00a0 Flint was compliant and then see if their sample result was surprising. A surprising\u00a0 result would have been evidence that the assumption was wrong and that there was actually a higher proportion of homes with contaminated water.<\/p>\n<p>This is a conditional statement because we assume a certain condition had to be\u00a0 true (in this case, that Flint was compliant with federal water safety regulations) and\u00a0 are drawing conclusions based on that assumption.<\/p>\n<p>The question we want to ask here is, \u201cIf Flint was compliant with federal water safety\u00a0 regulations, was the FWS sample result surprising?\u201d<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>What does a \u201csurprising event\u201d refer to in the probability context?\n<ol>\n<li>The event has a high probability of occurring.<\/li>\n<li>The event has a low probability of occurring.<\/li>\n<li>There is a 50\/50 chance the event will occur.<\/li>\n<\/ol>\n<\/li>\n<li>If Flint was really compliant with federal water safety regulations, which\u00a0 would you most expect to be true?\n<ol>\n<li>There was a large proportion of houses in Flint with contaminated water.<\/li>\n<li>There was a fairly large proportion of houses in Flint with contaminated\u00a0 water.<\/li>\n<li>There was a moderate proportion of houses in Flint with contaminated\u00a0 water.<\/li>\n<li>There was a very small proportion of houses in Flint with contaminated\u00a0 water.<\/li>\n<\/ol>\n<\/li>\n<li>If Flint was really compliant with federal water safety regulations, which event\u00a0 would be most surprising?\n<ol>\n<li>A smaller proportion of houses in the sample having contaminated water<\/li>\n<li>A larger proportion of houses in the sample having contaminated water<\/li>\n<li>No houses in the sample having contaminated water<\/li>\n<\/ol>\n<\/li>\n<li>Explain your answer to Part c.<\/li>\n<\/ol>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Question 6<\/h3>\n<p>The FWS found that a large proportion of houses in their sample had contaminated\u00a0 water. What might you conclude from that?<\/p>\n<p>Hint: Remember that the FWS was working under the assumption that Flint was\u00a0 compliant with federal water safety regulations, as found by the DEQ, so they were\u00a0 seeking evidence that this assumption was wrong.<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>It is very unlikely that a large proportion of houses had contaminated water if the water source was actually contaminated, so the sample was strong evidence that the DEQ was incorrect.<\/li>\n<li>It is very likely that a large proportion of houses had contaminated water if the\u00a0 water source was actually contaminated, so the sample was not strong evidence\u00a0 that the DEQ was incorrect.<\/li>\n<li>It is very unlikely that a large proportion of houses had contaminated water if the water source was not contaminated, so the sample was strong evidence that the\u00a0 DEQ was incorrect.<\/li>\n<li>It is very likely that a large proportion of houses had contaminated water if the\u00a0 water source was actually contaminated, so the sample was not strong evidence\u00a0 that the DEQ was incorrect.<\/li>\n<\/ol>\n<\/div>\n<p>Summary: When using statistical hypothesis testing to test an assumption:<\/p>\n<ul>\n<li>We start with a baseline assumption about a population parameter of interest\u00a0 (this is called the null hypothesis), and we assume this to be true.<\/li>\n<li>We collect a sample, and we ask whether that sample is surprising if our baseline\u00a0 assumption is actually true.<\/li>\n<li>If the sample result is very surprising (i.e., very unlikely), we then have strong\u00a0 evidence that our starting assumption was incorrect.<\/li>\n<\/ul>\n<p>Practice<\/p>\n<p>The American Community Survey (ACS) is a survey of around 3.5 million homes in the\u00a0 United States and Puerto Rico conducted annually by the U.S. Census Bureau.\u00a0 Aggregate data from the ACS are released every five years. The overall ACS poverty\u00a0 rate from 2015 to 2019 was reported to be 13.4%.<a class=\"footnote\" title=\"U.S. Census Bureau. (2020, December 10). Census Bureau releases new American community survey 5-year estimates. https:\/\/www.census.gov\/newsroom\/press-releases\/2020\/acs-5-year.html\" id=\"return-footnote-5307-2\" href=\"#footnote-5307-2\" aria-label=\"Footnote 2\"><sup class=\"footnote\">[2]<\/sup><\/a> Suppose that some new economic\u00a0 reforms were made in the years after 2019, and you want to test whether or not the\u00a0 poverty rate has decreased.<\/p>\n<div class=\"textbox key-takeaways\">\n<h3>Question 7<\/h3>\n<p>If the poverty rate has not decreased, what poverty rate would you expect to find in a\u00a0 random sample of American adults?<\/p>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Question 8<\/h3>\n<p>If the poverty rate has not decreased, what poverty rate would be very surprising to\u00a0 obtain in a sample?<\/p>\n<\/div>\n<p>&nbsp;<\/p>\n<hr class=\"before-footnotes clear\" \/><div class=\"footnotes\"><ol><li id=\"footnote-5307-1\">Barry-Jester, A. M. (2016, January 26). <em>What went wrong in Flint<\/em>. FiveThirtyEight. https:\/\/fivethirtyeight.com\/features\/what-went-wrong-in-flint-water-crisis-michigan\/ <a href=\"#return-footnote-5307-1\" class=\"return-footnote\" aria-label=\"Return to footnote 1\">&crarr;<\/a><\/li><li id=\"footnote-5307-2\">U.S. Census Bureau. (2020, December 10). <em>Census Bureau releases new American community survey 5-year estimates.<\/em> https:\/\/www.census.gov\/newsroom\/press-releases\/2020\/acs-5-year.html <a href=\"#return-footnote-5307-2\" class=\"return-footnote\" aria-label=\"Return to footnote 2\">&crarr;<\/a><\/li><\/ol><\/div>","protected":false},"author":574340,"menu_order":1,"template":"","meta":{"_candela_citation":"[]","CANDELA_OUTCOMES_GUID":"","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-5307","chapter","type-chapter","status-publish","hentry"],"part":5305,"_links":{"self":[{"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/chapters\/5307","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/wp\/v2\/users\/574340"}],"version-history":[{"count":1,"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/chapters\/5307\/revisions"}],"predecessor-version":[{"id":5308,"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/chapters\/5307\/revisions\/5308"}],"part":[{"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/parts\/5305"}],"metadata":[{"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/chapters\/5307\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/wp\/v2\/media?parent=5307"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/pressbooks\/v2\/chapter-type?post=5307"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/wp\/v2\/contributor?post=5307"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/lumen-danacenter-statsmockup\/wp-json\/wp\/v2\/license?post=5307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}