Introduction: Confidence Intervals

 

This is a photo of M&Ms piled together. The M&Ms are red, blue, green, yellow, orange and brown.
Have you ever wondered what the average number of M&Ms in a bag at the grocery store is? You can use confidence intervals to answer this question. (credit: comedy_nose/flickr)

Learning Objectives

By the end of this chapter, the student should be able to:

  • Calculate and interpret confidence intervals for estimating a population mean and a population proportion.
  • Interpret the Student’s t probability distribution as the sample size changes.
  • Discriminate between problems applying the normal and the Student’s t distributions.
  • Calculate the sample size required to estimate a population mean and a population proportion given a desired confidence level and margin of error.

 



Suppose you were trying to determine the mean rent of a two-bedroom apartment in your town. You might look in the classified section of the newspaper, write down several rents listed, and average them together. You would have obtained a point estimate of the true mean.

Another example is that you are trying to determine the percentage of times you make a basket when shooting a basketball. You might count the number of shots you make and divide that by the number of shots you attempted. In this case, you would have obtained a point estimate for the true proportion of successful shot.

We use sample data to make generalizations about an unknown population. This part of statistics is called inferential statistics. The sample data help us to make an estimate for a population. We realize that the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals.

Throughout the chapter, it is important to keep in mind that the confidence interval is a random variable.
It is the population parameter that is fixed.



For example,

If you worked in the marketing department of an entertainment company, you might be interested in the mean number of songs a consumer downloads a month from iTunes.
You could conduct a survey and calculate the sample mean, [latex]\displaystyle\overline{x}[/latex], and the sample standard deviation, s.
You would use [latex]\displaystyle\overline{x}[/latex] to estimate the population mean and s to estimate the population standard deviation.
The sample mean, [latex]\displaystyle\overline{x}[/latex], is the point estimate for the population mean, μ.
The sample standard deviation, s, is the point estimate for the population standard deviation, σ.

Each of [latex]\displaystyle\overline{x}[/latex] and s is called a statistic.

A confidence interval is another type of estimate but, instead of being just one number, it is an interval of numbers. The interval of numbers is a range of values calculated from a given set of sample data. The confidence interval is likely to include an unknown population parameter.

Suppose, for the iTunes example, we do not know the population mean μ, but we do know that the population standard deviation is σ = 1 and our sample size is 100. Then, by the central limit theorem, the standard deviation for the sample mean is

[latex]\displaystyle\frac{{\sigma}}{{\sqrt{n}}}[/latex] = [latex]\frac{{1}}{{\sqrt{100}}}=0.1[/latex]

The empirical rule, which applies to bell-shaped distributions, says that in approximately 95% of the samples, the sample mean ([latex]\displaystyle\overline{x}[/latex]) will be within two standard deviations of the population mean μ.
For our iTunes example, mean μ = 0.1 and standard deviation σ = 0.1.
Therefore, two standard deviations is (2)(0.1) = 0.2.
The sample mean [latex]\displaystyle\overline{x}[/latex] 0.1 is likely to be within 0.2 units of μ.

Because [latex]\displaystyle\overline{x}[/latex] is within 0.2 units of μ, which is unknown, then μ is likely to be within 0.2 units of [latex]\displaystyle\overline{x}[/latex] in 95% of the samples. The population mean μ is contained in an interval whose lower number is calculated by taking the sample mean and subtracting two standard deviations (2)(0.1) and whose upper number is calculated by taking the sample mean and adding two standard deviations. In other words, μ is between [latex]\displaystyle\overline{x}[/latex] 0.2 and [latex]\displaystyle\overline{x}[/latex] + 0.2 in 95% of all the samples.

For the iTunes example, suppose that a sample produced a sample mean [latex]\displaystyle\overline{x}[/latex]= 2. Then the unknown population mean μ is between
[latex]\displaystyle\overline{x}[/latex]0.2 20.2 1.8 and [latex]\displaystyle\overline{x}[/latex] +0.2 2+0.2 2.2.
The 95% confidence interval is (1.8, 2.2). We say that we are 95% confident that the unknown population mean number of songs downloaded from iTunes per month is between 1.8 and 2.2.

The 95% confidence interval implies two possibilities. Either the interval (1.8, 2.2) contains the true mean μ or our sample produced an [latex]\displaystyle\overline{x}[/latex] that is not within 0.2 units of the true mean μ. The second possibility happens for only 5% of all the samples (95–100%).

Remember that a confidence interval is created for an unknown population parameter like the population mean, μ. Confidence intervals for some parameters have the form:

(point estimate – margin of error, point estimate + margin of error)

The margin of error depends on the confidence level or percentage of confidence and the standard error of the mean.

When you read newspapers and journals, some reports will use the phrase “margin of error.” Other reports will not use that phrase, but include a confidence interval as the point estimate plus or minus the margin of error. These are two ways of expressing the same concept.

Note

Although the text only covers symmetrical confidence intervals, there are non-symmetrical confidence intervals (for example, a confidence interval for the standard deviation).