{"id":3180,"date":"2014-12-11T02:29:26","date_gmt":"2014-12-11T02:29:26","guid":{"rendered":"https:\/\/courses.candelalearning.com\/colphysics\/?post_type=chapter&#038;p=3180"},"modified":"2016-11-04T03:36:54","modified_gmt":"2016-11-04T03:36:54","slug":"15-7-statistical-interpretation-of-entropy-and-the-second-law-of-thermodynamics-the-underlying-explanation","status":"publish","type":"chapter","link":"https:\/\/courses.lumenlearning.com\/suny-physics\/chapter\/15-7-statistical-interpretation-of-entropy-and-the-second-law-of-thermodynamics-the-underlying-explanation\/","title":{"raw":"Statistical Interpretation of Entropy and the Second Law of Thermodynamics: The Underlying Explanation","rendered":"Statistical Interpretation of Entropy and the Second Law of Thermodynamics: The Underlying Explanation"},"content":{"raw":"<div class=\"textbox learning-objectives\">\r\n<h3>Learning Objectives<\/h3>\r\nBy the end of this section, you will be able to:\r\n<ul>\r\n \t<li>Identify probabilities in entropy.<\/li>\r\n \t<li>Analyze statistical probabilities in entropic systems.<\/li>\r\n<\/ul>\r\n<\/div>\r\n\r\n[caption id=\"\" align=\"alignright\" width=\"350\"]<img src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images-archive-read-only\/wp-content\/uploads\/sites\/222\/2014\/12\/20104954\/Figure_16_07_01.jpg\" alt=\"Photograph of many coins laid down on a surface, some with heads shown up and some with tails shown up.\" width=\"350\" height=\"524\" \/> Figure 1. When you toss a coin a large number of times, heads and tails tend to come up in roughly equal numbers. Why doesn\u2019t heads come up 100, 90, or even 80% of the time? (credit: Jon Sullivan, PDPhoto.org)[\/caption]\r\n\r\nThe various ways of formulating the second law of thermodynamics tell what happens rather than why it happens. Why should heat transfer occur only from hot to cold? Why should energy become ever less available to do work? Why should the universe become increasingly disorderly? The answer is that it is a matter of overwhelming probability. Disorder is simply vastly more likely than order.\r\n\r\nWhen you watch an emerging rain storm begin to wet the ground, you will notice that the drops fall in a disorganized manner both in time and in space. Some fall close together, some far apart, but they never fall in straight, orderly rows. It is not impossible for rain to fall in an orderly pattern, just highly unlikely, because there are many more disorderly ways than orderly ones. To illustrate this fact, we will examine some random processes, starting with coin tosses.\r\n<h2>Coin Tosses<\/h2>\r\nWhat are the possible outcomes of tossing 5 coins? Each coin can land either heads or tails. On the large scale, we are concerned only with the total heads and tails and not with the order in which heads and tails appear. The following possibilities exist:\r\n<p style=\"text-align: center;\">[latex]\\begin{array}{ll}5\\text{ heads,}&amp;0\\text{ tails}\\\\4\\text{ heads,}&amp;1\\text{ tail}\\\\3\\text{ heads,}&amp;2\\text{ tails}\\\\2\\text{ heads,}&amp;3\\text{ tails}\\\\1\\text{ head,}&amp;4\\text{ tails}\\\\0\\text{ head,}&amp;5\\text{ tails}\\end{array}\\\\[\/latex]<\/p>\r\nThese are what we call macrostates. A <em>macrostate<\/em> is an overall property of a system. It does not specify the details of the system, such as the order in which heads and tails occur or which coins are heads or tails.\r\n\r\nUsing this nomenclature, a system of 5 coins has the 6 possible macrostates just listed. Some macrostates are more likely to occur than others. For instance, there is only one way to get 5 heads, but there are several ways to get 3 heads and 2 tails, making the latter macrostate more probable. Table 1\u00a0lists of all the ways in which 5 coins can be tossed, taking into account the order in which heads and tails occur. Each sequence is called a <em>microstate<\/em>\u2014a detailed description of every element of a system.\r\n<table summary=\"A table with combinations of five coins tossed together five times is shown. The first column shows different toss results. The second column represents individual microstates, and the third column represents the number of microstates.\">\r\n<thead>\r\n<tr>\r\n<th colspan=\"3\">Table 1. 5-Coin Toss<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<th style=\"width: 25%;\"><\/th>\r\n<th>Individual microstates<\/th>\r\n<th>Number of microstates<\/th>\r\n<\/tr>\r\n<tr>\r\n<td>5 heads, 0 tails<\/td>\r\n<td>HHHHH<\/td>\r\n<td>1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>4 heads, 1 tail<\/td>\r\n<td>HHHHT, HHHTH, HHTHH, HTHHH, THHHH<\/td>\r\n<td>5<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>3 heads, 2 tails<\/td>\r\n<td>HTHTH, THTHH, HTHHT, THHTH, THHHT HTHTH, THTHH, HTHHT, THHTH, THHHT<\/td>\r\n<td>10<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>2 heads, 3 tails<\/td>\r\n<td>TTTHH, TTHHT, THHTT, HHTTT, TTHTH, THTHT, HTHTT, THTTH, HTTHT, HTTTH<\/td>\r\n<td>10<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>1 head, 4 tails<\/td>\r\n<td>TTTTH, TTTHT, TTHTT, THTTT, HTTTT<\/td>\r\n<td>5<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>0 heads, 5 tails<\/td>\r\n<td>TTTTT<\/td>\r\n<td>1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td><\/td>\r\n<td><\/td>\r\n<td><b>Total: 32<\/b><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\nThe macrostate of 3 heads and 2 tails can be achieved in 10 ways and is thus 10 times more probable than the one having 5 heads. Not surprisingly, it is equally probable to have the reverse, 2 heads and 3 tails. Similarly, it is equally probable to get 5 tails as it is to get 5 heads. Note that all of these conclusions are based on the crucial assumption that each microstate is equally probable. With coin tosses, this requires that the coins not be asymmetric in a way that favors one side over the other, as with loaded dice. With any system, the assumption that all microstates are equally probable must be valid, or the analysis will be erroneous.\r\n\r\nThe two most orderly possibilities are 5 heads or 5 tails. (They are more structured than the others.) They are also the least likely, only 2 out of 32 possibilities. The most disorderly possibilities are 3 heads and 2 tails and its reverse. (They are the least structured.) The most disorderly possibilities are also the most likely, with 20 out of 32 possibilities for the 3 heads and 2 tails and its reverse. If we start with an orderly array like 5 heads and toss the coins, it is very likely that we will get a less orderly array as a result, since 30 out of the 32 possibilities are less orderly. So even if you start with an orderly state, there is a strong tendency to go from order to disorder, from low entropy to high entropy. The reverse can happen, but it is unlikely.\r\n<table summary=\"A table is shown for hundred coin toss with three columns. The first two columns are for the microstate heads and tails and the third column is for number of microstates W.\">\r\n<thead>\r\n<tr>\r\n<th colspan=\"3\">Table 2. 100-Coin Toss<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<th colspan=\"2\">Macrostate<\/th>\r\n<th>Number of microstates<\/th>\r\n<\/tr>\r\n<tr>\r\n<td>Heads<\/td>\r\n<td>Tails<\/td>\r\n<td>(<em>W<\/em>)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>100<\/td>\r\n<td>0<\/td>\r\n<td>1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>99<\/td>\r\n<td>1<\/td>\r\n<td>1.0 <em>\u00d7<\/em> 10<sup>2 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>95<\/td>\r\n<td>5<\/td>\r\n<td>7.5 <em>\u00d7<\/em> 10<sup>7 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>90<\/td>\r\n<td>10<\/td>\r\n<td>1.7 <em>\u00d7<\/em> 10<sup>13 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>75<\/td>\r\n<td>25<\/td>\r\n<td>2.4 <em>\u00d7<\/em> 10<sup>23 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>60<\/td>\r\n<td>40<\/td>\r\n<td>1.4 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>55<\/td>\r\n<td>45<\/td>\r\n<td>6.1 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>51<\/td>\r\n<td>49<\/td>\r\n<td>9.9 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>50<\/td>\r\n<td>50<\/td>\r\n<td>1.0 <em>\u00d7<\/em> 10<sup>29 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>49<\/td>\r\n<td>51<\/td>\r\n<td>9.9 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>45<\/td>\r\n<td>55<\/td>\r\n<td>6.1 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>40<\/td>\r\n<td>60<\/td>\r\n<td>1.4 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>25<\/td>\r\n<td>75<\/td>\r\n<td>2.4 <em>\u00d7<\/em> 10<sup>23 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>10<\/td>\r\n<td>90<\/td>\r\n<td>1.7 <em>\u00d7<\/em> 10<sup>13 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>5<\/td>\r\n<td>95<\/td>\r\n<td>7.5 <em>\u00d7<\/em> 10<sup>7 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>1<\/td>\r\n<td>99<\/td>\r\n<td>1.0 <em>\u00d7<\/em> 10<sup>2 <\/sup><\/td>\r\n<\/tr>\r\n<tr>\r\n<td>0<\/td>\r\n<td>100<\/td>\r\n<td>1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td><\/td>\r\n<td><\/td>\r\n<td><strong>Total: 1.27\u00a0<em>\u00d7\u00a0<\/em>10<sup>30<\/sup><\/strong><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\nThis result becomes dramatic for larger systems. Consider what happens if you have 100 coins instead of just 5. The most orderly arrangements (most structured) are 100 heads or 100 tails. The least orderly (least structured) is that of 50 heads and 50 tails. There is only 1 way (1 microstate) to get the most orderly arrangement of 100 heads. There are 100 ways (100 microstates) to get the next most orderly arrangement of 99 heads and 1 tail (also 100 to get its reverse). And there are 1.0 \u00d7 10<sup>29<\/sup> ways to get 50 heads and 50 tails, the least orderly arrangement. Table 2\u00a0is an abbreviated list of the various macrostates and the number of microstates for each macrostate. The total number of microstates\u2014the total number of different ways 100 coins can be tossed\u2014is an impressively large 1.27 \u00d7 10<sup>30<\/sup>. Now, if we start with an orderly macrostate like 100 heads and toss the coins, there is a virtual certainty that we will get a less orderly macrostate. If we keep tossing the coins, it is possible, but exceedingly unlikely, that we will ever get back to the most orderly macrostate. If you tossed the coins once each second, you could expect to get either 100 heads or 100 tails once in 2 \u00d7 10<sup>22<\/sup> years! This period is 1 trillion (10<sup>12<\/sup>) times longer than the age of the universe, and so the chances are essentially zero. In contrast, there is an 8% chance of getting 50 heads, a 73% chance of getting from 45 to 55 heads, and a 96% chance of getting from 40 to 60 heads. Disorder is highly likely.\r\n<h2>Disorder in a Gas<\/h2>\r\nThe fantastic growth in the odds favoring disorder that we see in going from 5 to 100 coins continues as the number of entities in the system increases. Let us now imagine applying this approach to perhaps a small sample of gas. Because counting microstates and macrostates involves statistics, this is called <em>statistical analysis<\/em>. The macrostates of a gas correspond to its macroscopic properties, such as volume, temperature, and pressure; and its microstates correspond to the detailed description of the positions and velocities of its atoms. Even a small amount of gas has a huge number of atoms: 1.0 cm<sup>3<\/sup> of an ideal gas at 1.0 atm and 0\u00ba C has 2.7 \u00d7 10<sup>19<\/sup> atoms. So each macrostate has an immense number of microstates. In plain language, this means that there are an immense number of ways in which the atoms in a gas can be arranged, while still having the same pressure, temperature, and so on.\r\n\r\nThe most likely conditions (or macrostates) for a gas are those we see all the time\u2014a random distribution of atoms in space with a Maxwell-Boltzmann distribution of speeds in random directions, as predicted by kinetic theory. This is the most disorderly and least structured condition we can imagine. In contrast, one type of very orderly and structured macrostate has all of the atoms in one corner of a container with identical velocities. There are very few ways to accomplish this (very few microstates corresponding to it), and so it is exceedingly unlikely ever to occur. (See Figure 2b.) Indeed, it is so unlikely that we have a law saying that it is impossible, which has never been observed to be violated\u2014the second law of thermodynamics.\r\n\r\n[caption id=\"attachment_10671\" align=\"aligncenter\" width=\"1301\"]<img class=\"wp-image-10671 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images-archive-read-only\/wp-content\/uploads\/sites\/222\/2016\/01\/20112926\/Figure_16_07_02.jpg\" alt=\"Two states of a container of gas are shown. In state a, the gas molecules, depicted as small green spheres, are randomly distributed in the container, with random velocities (an arrow is attached to each sphere, and the arrows vary in length and direction). This state is labeled likely. In state b, the molecules are clustered in the lower left-hand corner of the container and the arrows are much shorter. This state is labeled highly unlikely.\" width=\"1301\" height=\"504\" \/> Figure 2. (a) The ordinary state of gas in a container is a disorderly, random distribution of atoms or molecules with a Maxwell-Boltzmann distribution of speeds. It is so unlikely that these atoms or molecules would ever end up in one corner of the container that it might as well be impossible. (b) With energy transfer, the gas can be forced into one corner and its entropy greatly reduced. But left alone, it will spontaneously increase its entropy and return to the normal conditions, because they are immensely more likely.[\/caption]\r\n\r\nThe disordered condition is one of high entropy, and the ordered one has low entropy. With a transfer of energy from another system, we could force all of the atoms into one corner and have a local decrease in entropy, but at the cost of an overall increase in entropy of the universe. If the atoms start out in one corner, they will quickly disperse and become uniformly distributed and will never return to the orderly original state (Figure 2b). Entropy will increase. With such a large sample of atoms, it is possible\u2014but unimaginably unlikely\u2014for entropy to decrease. Disorder is vastly more likely than order.\r\n\r\nThe arguments that disorder and high entropy are the most probable states are quite convincing. The great Austrian physicist Ludwig Boltzmann (1844\u20131906)\u2014who, along with Maxwell, made so many contributions to kinetic theory\u2014proved that the entropy of a system in a given state (a macrostate) can be written as\u00a0<em>S\u00a0<\/em>=\u00a0<em>k<\/em> ln<em>W<\/em>,\u00a0where <em>k<\/em> = 1.38\u00a0\u00d7 10<sup>\u221223<\/sup> J\/K\u00a0is Boltzmann\u2019s constant, and ln<em>W<\/em> is the natural logarithm of the number of microstates <em>W<\/em> corresponding to the given macrostate. <em>W<\/em> is proportional to the probability that the macrostate will occur. Thus entropy is directly related to the probability of a state\u2014the more likely the state, the greater its entropy. Boltzmann proved that this expression for <em>S<\/em> is equivalent to the definition [latex]\\Delta{S}=\\frac{Q}{T}\\\\[\/latex], which we have used extensively.\r\n\r\nThus the second law of thermodynamics is explained on a very basic level: entropy either remains the same or increases in every process. This phenomenon is due to the extraordinarily small probability of a decrease, based on the extraordinarily larger number of microstates in systems with greater entropy. Entropy <em>can<\/em> decrease, but for any macroscopic system, this outcome is so unlikely that it will never be observed.\r\n<div class=\"textbox examples\">\r\n<h3>Example 1. Entropy Increases in a Coin Toss<\/h3>\r\nSuppose you toss 100 coins starting with 60 heads and 40 tails, and you get the most likely result, 50 heads and 50 tails. What is the change in entropy?\r\n<h4>Strategy<\/h4>\r\nNoting that the number of microstates is labeled <em>W<\/em> in Table 2\u00a0for the 100-coin toss, we can use \u0394<em>S\u00a0<\/em>=\u00a0<em>S<\/em><sub>f<\/sub>\u00a0\u2212\u00a0<em>S<\/em><sub>i<\/sub>\u00a0=\u00a0<em>k<\/em> ln<em>W<\/em><sub>f<\/sub>\u00a0\u2013\u00a0<em>k<\/em>ln<em>W<\/em><sub>i<\/sub> to calculate the change in entropy.\r\n<h4>Solution<\/h4>\r\nThe change in entropy is\u00a0\u0394<em>S\u00a0<\/em>=\u00a0<em>S<\/em><sub>f<\/sub>\u00a0\u2013\u00a0<em>S<\/em><sub>i<\/sub>\u00a0=\u00a0<em>k<\/em> ln<em>W<\/em><sub>f<\/sub>\u00a0\u2013\u00a0<em>k<\/em>ln<em>W<\/em><sub>i,<\/sub>\r\n\r\nwhere the subscript i stands for the initial 60 heads and 40 tails state, and the subscript f for the final 50 heads and 50 tails state. Substituting the values for <em>W<\/em> from Table 2\u00a0gives\r\n\r\n[latex]\\begin{array}{lll}\\Delta{S}&amp;=&amp;\\left(1.38\\times10^{-23}\\text{ J\/K}\\right)\\left[\\ln\\left(1.0\\times10^{29}\\right)-\\ln\\left(1.4\\times{10}^{29}\\right)\\right]\\\\\\text{ }&amp;=&amp;2.7\\times10^{-23}\\text{ J\/K}\\end{array}\\\\[\/latex]\r\n<h4>Discussion<\/h4>\r\nThis increase in entropy means we have moved to a less orderly situation. It is not impossible for further tosses to produce the initial state of 60 heads and 40 tails, but it is less likely. There is about a 1 in 90 chance for that decrease in entropy (\u22122.7\u00a0\u00d7\u00a010<sup>\u221223<\/sup>\u00a0J\/K) to occur. If we calculate the decrease in entropy to move to the most orderly state, we get \u0394<em>S<\/em> = \u221292\u00a0\u00d7 10<sup>\u221223<\/sup>\u00a0J\/K. There is about a 1 in 10<sup>30<\/sup> chance of this change occurring. So while very small decreases in entropy are unlikely, slightly greater decreases are impossibly unlikely. These probabilities imply, again, that for a macroscopic system, a decrease in entropy is impossible. For example, for heat transfer to occur spontaneously from 1.00 kg of 0\u00baC ice to its 0\u00baC environment, there would be a decrease in entropy of 1.22 \u00d7 10<sup>3<\/sup> J\/K. Given that a \u0394<em>S<\/em> 10<sup>\u221221<\/sup> J\/K\u00a0corresponds to about a 1 in 10<sup>30<\/sup> chance, a decrease of this size (10<sup>3<\/sup> J\/K) is an <em>utter<\/em> impossibility. Even for a milligram of melted ice to spontaneously refreeze is impossible.\r\n\r\n<\/div>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Problem-Solving Strategies for Entropy<\/h3>\r\n<ol>\r\n \t<li><em>Examine the situation to determine if entropy is involved.<\/em><\/li>\r\n \t<li><em>Identify the system of interest and draw a labeled diagram of the system showing energy flow.<\/em><\/li>\r\n \t<li><em>Identify exactly what needs to be determined in the problem (identify the unknowns).<\/em> A written list is useful.<\/li>\r\n \t<li><em>Make a list of what is given or can be inferred from the problem as stated (identify the knowns).<\/em> You must carefully identify the heat transfer, if any, and the temperature at which the process takes place. It is also important to identify the initial and final states.<\/li>\r\n \t<li><em>Solve the appropriate equation for the quantity to be determined (the unknown).<\/em> Note that the change in entropy can be determined between any states by calculating it for a reversible process.<\/li>\r\n \t<li><em>Substitute the known value along with their units into the appropriate equation, and obtain numerical solutions complete with units.<\/em><\/li>\r\n \t<li><em>To see if it is reasonable: Does it make sense?<\/em> For example, total entropy should increase for any real process or be constant for a reversible process. Disordered states should be more probable and have greater entropy than ordered states.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<h2>Section Summary<\/h2>\r\n<ul>\r\n \t<li>Disorder is far more likely than order, which can be seen statistically.<\/li>\r\n \t<li>The entropy of a system in a given state (a macrostate) can be written as\u00a0<em>S\u00a0<\/em>= <em>k\u00a0<\/em>ln<em>W<\/em>,<em>\u00a0<\/em>where\u00a0<em>k\u00a0<\/em>= 1.38 \u00d7 10<sup>\u221223<\/sup> J\/K is Boltzmann\u2019s constant, and ln<em>W<\/em>\u00a0is the natural logarithm of the number of microstates <em>W<\/em>\u00a0corresponding to the given macrostate.<\/li>\r\n<\/ul>\r\n<div class=\"textbox key-takeaways\">\r\n<h3>Conceptual Questions<\/h3>\r\n<ol>\r\n \t<li>Explain why a building made of bricks has smaller entropy than the same bricks in a disorganized pile. Do this by considering the number of ways that each could be formed (the number of microstates in each macrostate).<\/li>\r\n<\/ol>\r\n<\/div>\r\n<div class=\"textbox exercises\">\r\n<h3>Problems &amp; Exercises<\/h3>\r\n<ol>\r\n \t<li>Using Table 2, verify the contention that if you toss 100 coins each second, you can expect to get 100 heads or 100 tails once in 2 \u00d7 10<sup>22<\/sup> years; calculate the time to two-digit accuracy.<\/li>\r\n \t<li>What percent of the time will you get something in the range from 60 heads and 40 tails through 40 heads and 60 tails when tossing 100 coins? The total number of microstates in that range is 1.22 \u00d7 10<sup>30<\/sup>. (Consult Table 2.)<\/li>\r\n \t<li>(a)\u00a0If tossing 100 coins, how many ways (microstates) are there to get the three most likely macrostates of 49 heads and 51 tails, 50 heads and 50 tails, and 51 heads and 49 tails? (b)\u00a0What percent of the total possibilities is this? (Consult Table 2.)<\/li>\r\n \t<li>(a)\u00a0What is the change in entropy if you start with 100 coins in the 45 heads and 55 tails macrostate, toss them, and get 51 heads and 49 tails? (b)\u00a0What if you get 75 heads and 25 tails? (c)\u00a0How much more likely is 51 heads and 49 tails than 75 heads and 25 tails? (d)\u00a0Does either outcome violate the second law of thermodynamics?<\/li>\r\n \t<li>(a)\u00a0What is the change in entropy if you start with 10 coins in the 5 heads and 5 tails macrostate, toss them, and get 2 heads and 8 tails? (b)\u00a0How much more likely is 5 heads and 5 tails than 2 heads and 8 tails? (Take the ratio of the number of microstates to find out.) (c)\u00a0If you were betting on 2 heads and 8 tails would you accept odds of 252 to 45? Explain why or why not.\r\n<table>\r\n<thead>\r\n<tr>\r\n<th colspan=\"3\">Table 3. 10-Coin Toss<\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<th colspan=\"2\">Macrostate<\/th>\r\n<th>Number of Microstates<\/th>\r\n<\/tr>\r\n<tr>\r\n<td>Heads<\/td>\r\n<td>Tails<\/td>\r\n<td>(<em>W<\/em>)<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>10<\/td>\r\n<td>0<\/td>\r\n<td>1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>9<\/td>\r\n<td>1<\/td>\r\n<td>10<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>8<\/td>\r\n<td>2<\/td>\r\n<td>45<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>7<\/td>\r\n<td>3<\/td>\r\n<td>120<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>6<\/td>\r\n<td>4<\/td>\r\n<td>210<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>5<\/td>\r\n<td>5<\/td>\r\n<td>252<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>4<\/td>\r\n<td>6<\/td>\r\n<td>210<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>3<\/td>\r\n<td>7<\/td>\r\n<td>120<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>2<\/td>\r\n<td>8<\/td>\r\n<td>45<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>1<\/td>\r\n<td>9<\/td>\r\n<td>10<\/td>\r\n<\/tr>\r\n<tr>\r\n<td>0<\/td>\r\n<td>10<\/td>\r\n<td>1<\/td>\r\n<\/tr>\r\n<tr>\r\n<td><\/td>\r\n<td><\/td>\r\n<td><strong>Total: 1024<\/strong><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/li>\r\n \t<li>(a)\u00a0If you toss 10 coins, what percent of the time will you get the three most likely macrostates (6 heads and 4 tails, 5 heads and 5 tails, 4 heads and 6 tails)? (b)\u00a0You can realistically toss 10 coins and count the number of heads and tails about twice a minute. At that rate, how long will it take on average to get either 10 heads and 0 tails or 0 heads and 10 tails?<\/li>\r\n \t<li>(a)\u00a0Construct a table showing the macrostates and all of the individual microstates for tossing 6 coins. (Use Table 3\u00a0as a guide.) (b)\u00a0How many macrostates are there? (c)\u00a0What is the total number of microstates? (d)\u00a0What percent chance is there of tossing 5 heads and 1 tail? (e)\u00a0How much more likely are you to toss 3 heads and 3 tails than 5 heads and 1 tail? (Take the ratio of the number of microstates to find out.)<\/li>\r\n \t<li>In an air conditioner, 12.65 MJ of heat transfer occurs from a cold environment in 1.00 h. (a)\u00a0What mass of ice melting would involve the same heat transfer? (b)\u00a0How many hours of operation would be equivalent to melting 900 kg of ice? (c)\u00a0If ice costs 20 cents per kg, do you think the air conditioner could be operated more cheaply than by simply using ice? Describe in detail how you evaluate the relative costs.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<h2>Glossary<\/h2>\r\n<strong>macrostate:\u00a0<\/strong>an overall property of a system\r\n\r\n<strong>microstate:<\/strong>\u00a0each sequence within a larger macrostate\r\n\r\n<strong>statistical analysis:<\/strong>\u00a0using statistics to examine data, such as counting microstates and macrostates\r\n<div class=\"textbox exercises\">\r\n<h3>Selected Solutions to Problems &amp; Exercises<\/h3>\r\n1.\u00a0It should happen twice in every 1.27\u00a0\u00d7 10<sup>30<\/sup> s\u00a0or once in every 6.35 \u00d7 10<sup>29<\/sup> s\r\n\r\n[latex]\\begin{array}{ll}\\left(6.35\\times {\\text{10}}^{\\text{29}}\\text{s}\\right)\\left(\\frac{\\text{1 h}}{\\text{3600 s}}\\right)&amp; \\left(\\frac{\\text{1 d}}{\\text{24 h}}\\right)\\left(\\frac{\\text{1 y}}{\\text{365.25 d}}\\right)\\\\ =&amp; 2.0\\times {\\text{10}}^{\\text{22}}\\text{y}\\end{array}\\\\[\/latex]\r\n\r\n3.\u00a0(a)\u00a03.0 \u00d7 10<sup>29<\/sup>; (b)\u00a024%\r\n\r\n5.\u00a0(a)\u00a0\u22122.38 \u00d7 10<sup>\u221223<\/sup> J\/K;\u00a0(b)\u00a05.6 times more likely;\u00a0(c)\u00a0If you were betting on two heads and 8 tails, the odds of breaking even are 252 to 45, so on average you would break even. So, no, you wouldn\u2019t bet on odds of 252 to 45.\r\n\r\n7.\u00a0(b)\u00a07;\u00a0(c)\u00a064;\u00a0(d)\u00a09.38%;\u00a0(e)\u00a03.33 times more likely (20 to 6)\r\n\r\n<\/div>","rendered":"<div class=\"textbox learning-objectives\">\n<h3>Learning Objectives<\/h3>\n<p>By the end of this section, you will be able to:<\/p>\n<ul>\n<li>Identify probabilities in entropy.<\/li>\n<li>Analyze statistical probabilities in entropic systems.<\/li>\n<\/ul>\n<\/div>\n<div style=\"width: 360px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images-archive-read-only\/wp-content\/uploads\/sites\/222\/2014\/12\/20104954\/Figure_16_07_01.jpg\" alt=\"Photograph of many coins laid down on a surface, some with heads shown up and some with tails shown up.\" width=\"350\" height=\"524\" \/><\/p>\n<p class=\"wp-caption-text\">Figure 1. When you toss a coin a large number of times, heads and tails tend to come up in roughly equal numbers. Why doesn\u2019t heads come up 100, 90, or even 80% of the time? (credit: Jon Sullivan, PDPhoto.org)<\/p>\n<\/div>\n<p>The various ways of formulating the second law of thermodynamics tell what happens rather than why it happens. Why should heat transfer occur only from hot to cold? Why should energy become ever less available to do work? Why should the universe become increasingly disorderly? The answer is that it is a matter of overwhelming probability. Disorder is simply vastly more likely than order.<\/p>\n<p>When you watch an emerging rain storm begin to wet the ground, you will notice that the drops fall in a disorganized manner both in time and in space. Some fall close together, some far apart, but they never fall in straight, orderly rows. It is not impossible for rain to fall in an orderly pattern, just highly unlikely, because there are many more disorderly ways than orderly ones. To illustrate this fact, we will examine some random processes, starting with coin tosses.<\/p>\n<h2>Coin Tosses<\/h2>\n<p>What are the possible outcomes of tossing 5 coins? Each coin can land either heads or tails. On the large scale, we are concerned only with the total heads and tails and not with the order in which heads and tails appear. The following possibilities exist:<\/p>\n<p style=\"text-align: center;\">[latex]\\begin{array}{ll}5\\text{ heads,}&0\\text{ tails}\\\\4\\text{ heads,}&1\\text{ tail}\\\\3\\text{ heads,}&2\\text{ tails}\\\\2\\text{ heads,}&3\\text{ tails}\\\\1\\text{ head,}&4\\text{ tails}\\\\0\\text{ head,}&5\\text{ tails}\\end{array}\\\\[\/latex]<\/p>\n<p>These are what we call macrostates. A <em>macrostate<\/em> is an overall property of a system. It does not specify the details of the system, such as the order in which heads and tails occur or which coins are heads or tails.<\/p>\n<p>Using this nomenclature, a system of 5 coins has the 6 possible macrostates just listed. Some macrostates are more likely to occur than others. For instance, there is only one way to get 5 heads, but there are several ways to get 3 heads and 2 tails, making the latter macrostate more probable. Table 1\u00a0lists of all the ways in which 5 coins can be tossed, taking into account the order in which heads and tails occur. Each sequence is called a <em>microstate<\/em>\u2014a detailed description of every element of a system.<\/p>\n<table summary=\"A table with combinations of five coins tossed together five times is shown. The first column shows different toss results. The second column represents individual microstates, and the third column represents the number of microstates.\">\n<thead>\n<tr>\n<th colspan=\"3\">Table 1. 5-Coin Toss<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<th style=\"width: 25%;\"><\/th>\n<th>Individual microstates<\/th>\n<th>Number of microstates<\/th>\n<\/tr>\n<tr>\n<td>5 heads, 0 tails<\/td>\n<td>HHHHH<\/td>\n<td>1<\/td>\n<\/tr>\n<tr>\n<td>4 heads, 1 tail<\/td>\n<td>HHHHT, HHHTH, HHTHH, HTHHH, THHHH<\/td>\n<td>5<\/td>\n<\/tr>\n<tr>\n<td>3 heads, 2 tails<\/td>\n<td>HTHTH, THTHH, HTHHT, THHTH, THHHT HTHTH, THTHH, HTHHT, THHTH, THHHT<\/td>\n<td>10<\/td>\n<\/tr>\n<tr>\n<td>2 heads, 3 tails<\/td>\n<td>TTTHH, TTHHT, THHTT, HHTTT, TTHTH, THTHT, HTHTT, THTTH, HTTHT, HTTTH<\/td>\n<td>10<\/td>\n<\/tr>\n<tr>\n<td>1 head, 4 tails<\/td>\n<td>TTTTH, TTTHT, TTHTT, THTTT, HTTTT<\/td>\n<td>5<\/td>\n<\/tr>\n<tr>\n<td>0 heads, 5 tails<\/td>\n<td>TTTTT<\/td>\n<td>1<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td><\/td>\n<td><b>Total: 32<\/b><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>The macrostate of 3 heads and 2 tails can be achieved in 10 ways and is thus 10 times more probable than the one having 5 heads. Not surprisingly, it is equally probable to have the reverse, 2 heads and 3 tails. Similarly, it is equally probable to get 5 tails as it is to get 5 heads. Note that all of these conclusions are based on the crucial assumption that each microstate is equally probable. With coin tosses, this requires that the coins not be asymmetric in a way that favors one side over the other, as with loaded dice. With any system, the assumption that all microstates are equally probable must be valid, or the analysis will be erroneous.<\/p>\n<p>The two most orderly possibilities are 5 heads or 5 tails. (They are more structured than the others.) They are also the least likely, only 2 out of 32 possibilities. The most disorderly possibilities are 3 heads and 2 tails and its reverse. (They are the least structured.) The most disorderly possibilities are also the most likely, with 20 out of 32 possibilities for the 3 heads and 2 tails and its reverse. If we start with an orderly array like 5 heads and toss the coins, it is very likely that we will get a less orderly array as a result, since 30 out of the 32 possibilities are less orderly. So even if you start with an orderly state, there is a strong tendency to go from order to disorder, from low entropy to high entropy. The reverse can happen, but it is unlikely.<\/p>\n<table summary=\"A table is shown for hundred coin toss with three columns. The first two columns are for the microstate heads and tails and the third column is for number of microstates W.\">\n<thead>\n<tr>\n<th colspan=\"3\">Table 2. 100-Coin Toss<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<th colspan=\"2\">Macrostate<\/th>\n<th>Number of microstates<\/th>\n<\/tr>\n<tr>\n<td>Heads<\/td>\n<td>Tails<\/td>\n<td>(<em>W<\/em>)<\/td>\n<\/tr>\n<tr>\n<td>100<\/td>\n<td>0<\/td>\n<td>1<\/td>\n<\/tr>\n<tr>\n<td>99<\/td>\n<td>1<\/td>\n<td>1.0 <em>\u00d7<\/em> 10<sup>2 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>95<\/td>\n<td>5<\/td>\n<td>7.5 <em>\u00d7<\/em> 10<sup>7 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>90<\/td>\n<td>10<\/td>\n<td>1.7 <em>\u00d7<\/em> 10<sup>13 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>75<\/td>\n<td>25<\/td>\n<td>2.4 <em>\u00d7<\/em> 10<sup>23 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>60<\/td>\n<td>40<\/td>\n<td>1.4 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>55<\/td>\n<td>45<\/td>\n<td>6.1 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>51<\/td>\n<td>49<\/td>\n<td>9.9 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>50<\/td>\n<td>50<\/td>\n<td>1.0 <em>\u00d7<\/em> 10<sup>29 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>49<\/td>\n<td>51<\/td>\n<td>9.9 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>45<\/td>\n<td>55<\/td>\n<td>6.1 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>40<\/td>\n<td>60<\/td>\n<td>1.4 <em>\u00d7<\/em> 10<sup>28 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>25<\/td>\n<td>75<\/td>\n<td>2.4 <em>\u00d7<\/em> 10<sup>23 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>10<\/td>\n<td>90<\/td>\n<td>1.7 <em>\u00d7<\/em> 10<sup>13 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>95<\/td>\n<td>7.5 <em>\u00d7<\/em> 10<sup>7 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>1<\/td>\n<td>99<\/td>\n<td>1.0 <em>\u00d7<\/em> 10<sup>2 <\/sup><\/td>\n<\/tr>\n<tr>\n<td>0<\/td>\n<td>100<\/td>\n<td>1<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td><\/td>\n<td><strong>Total: 1.27\u00a0<em>\u00d7\u00a0<\/em>10<sup>30<\/sup><\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>This result becomes dramatic for larger systems. Consider what happens if you have 100 coins instead of just 5. The most orderly arrangements (most structured) are 100 heads or 100 tails. The least orderly (least structured) is that of 50 heads and 50 tails. There is only 1 way (1 microstate) to get the most orderly arrangement of 100 heads. There are 100 ways (100 microstates) to get the next most orderly arrangement of 99 heads and 1 tail (also 100 to get its reverse). And there are 1.0 \u00d7 10<sup>29<\/sup> ways to get 50 heads and 50 tails, the least orderly arrangement. Table 2\u00a0is an abbreviated list of the various macrostates and the number of microstates for each macrostate. The total number of microstates\u2014the total number of different ways 100 coins can be tossed\u2014is an impressively large 1.27 \u00d7 10<sup>30<\/sup>. Now, if we start with an orderly macrostate like 100 heads and toss the coins, there is a virtual certainty that we will get a less orderly macrostate. If we keep tossing the coins, it is possible, but exceedingly unlikely, that we will ever get back to the most orderly macrostate. If you tossed the coins once each second, you could expect to get either 100 heads or 100 tails once in 2 \u00d7 10<sup>22<\/sup> years! This period is 1 trillion (10<sup>12<\/sup>) times longer than the age of the universe, and so the chances are essentially zero. In contrast, there is an 8% chance of getting 50 heads, a 73% chance of getting from 45 to 55 heads, and a 96% chance of getting from 40 to 60 heads. Disorder is highly likely.<\/p>\n<h2>Disorder in a Gas<\/h2>\n<p>The fantastic growth in the odds favoring disorder that we see in going from 5 to 100 coins continues as the number of entities in the system increases. Let us now imagine applying this approach to perhaps a small sample of gas. Because counting microstates and macrostates involves statistics, this is called <em>statistical analysis<\/em>. The macrostates of a gas correspond to its macroscopic properties, such as volume, temperature, and pressure; and its microstates correspond to the detailed description of the positions and velocities of its atoms. Even a small amount of gas has a huge number of atoms: 1.0 cm<sup>3<\/sup> of an ideal gas at 1.0 atm and 0\u00ba C has 2.7 \u00d7 10<sup>19<\/sup> atoms. So each macrostate has an immense number of microstates. In plain language, this means that there are an immense number of ways in which the atoms in a gas can be arranged, while still having the same pressure, temperature, and so on.<\/p>\n<p>The most likely conditions (or macrostates) for a gas are those we see all the time\u2014a random distribution of atoms in space with a Maxwell-Boltzmann distribution of speeds in random directions, as predicted by kinetic theory. This is the most disorderly and least structured condition we can imagine. In contrast, one type of very orderly and structured macrostate has all of the atoms in one corner of a container with identical velocities. There are very few ways to accomplish this (very few microstates corresponding to it), and so it is exceedingly unlikely ever to occur. (See Figure 2b.) Indeed, it is so unlikely that we have a law saying that it is impossible, which has never been observed to be violated\u2014the second law of thermodynamics.<\/p>\n<div id=\"attachment_10671\" style=\"width: 1311px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-10671\" class=\"wp-image-10671 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images-archive-read-only\/wp-content\/uploads\/sites\/222\/2016\/01\/20112926\/Figure_16_07_02.jpg\" alt=\"Two states of a container of gas are shown. In state a, the gas molecules, depicted as small green spheres, are randomly distributed in the container, with random velocities (an arrow is attached to each sphere, and the arrows vary in length and direction). This state is labeled likely. In state b, the molecules are clustered in the lower left-hand corner of the container and the arrows are much shorter. This state is labeled highly unlikely.\" width=\"1301\" height=\"504\" \/><\/p>\n<p id=\"caption-attachment-10671\" class=\"wp-caption-text\">Figure 2. (a) The ordinary state of gas in a container is a disorderly, random distribution of atoms or molecules with a Maxwell-Boltzmann distribution of speeds. It is so unlikely that these atoms or molecules would ever end up in one corner of the container that it might as well be impossible. (b) With energy transfer, the gas can be forced into one corner and its entropy greatly reduced. But left alone, it will spontaneously increase its entropy and return to the normal conditions, because they are immensely more likely.<\/p>\n<\/div>\n<p>The disordered condition is one of high entropy, and the ordered one has low entropy. With a transfer of energy from another system, we could force all of the atoms into one corner and have a local decrease in entropy, but at the cost of an overall increase in entropy of the universe. If the atoms start out in one corner, they will quickly disperse and become uniformly distributed and will never return to the orderly original state (Figure 2b). Entropy will increase. With such a large sample of atoms, it is possible\u2014but unimaginably unlikely\u2014for entropy to decrease. Disorder is vastly more likely than order.<\/p>\n<p>The arguments that disorder and high entropy are the most probable states are quite convincing. The great Austrian physicist Ludwig Boltzmann (1844\u20131906)\u2014who, along with Maxwell, made so many contributions to kinetic theory\u2014proved that the entropy of a system in a given state (a macrostate) can be written as\u00a0<em>S\u00a0<\/em>=\u00a0<em>k<\/em> ln<em>W<\/em>,\u00a0where <em>k<\/em> = 1.38\u00a0\u00d7 10<sup>\u221223<\/sup> J\/K\u00a0is Boltzmann\u2019s constant, and ln<em>W<\/em> is the natural logarithm of the number of microstates <em>W<\/em> corresponding to the given macrostate. <em>W<\/em> is proportional to the probability that the macrostate will occur. Thus entropy is directly related to the probability of a state\u2014the more likely the state, the greater its entropy. Boltzmann proved that this expression for <em>S<\/em> is equivalent to the definition [latex]\\Delta{S}=\\frac{Q}{T}\\\\[\/latex], which we have used extensively.<\/p>\n<p>Thus the second law of thermodynamics is explained on a very basic level: entropy either remains the same or increases in every process. This phenomenon is due to the extraordinarily small probability of a decrease, based on the extraordinarily larger number of microstates in systems with greater entropy. Entropy <em>can<\/em> decrease, but for any macroscopic system, this outcome is so unlikely that it will never be observed.<\/p>\n<div class=\"textbox examples\">\n<h3>Example 1. Entropy Increases in a Coin Toss<\/h3>\n<p>Suppose you toss 100 coins starting with 60 heads and 40 tails, and you get the most likely result, 50 heads and 50 tails. What is the change in entropy?<\/p>\n<h4>Strategy<\/h4>\n<p>Noting that the number of microstates is labeled <em>W<\/em> in Table 2\u00a0for the 100-coin toss, we can use \u0394<em>S\u00a0<\/em>=\u00a0<em>S<\/em><sub>f<\/sub>\u00a0\u2212\u00a0<em>S<\/em><sub>i<\/sub>\u00a0=\u00a0<em>k<\/em> ln<em>W<\/em><sub>f<\/sub>\u00a0\u2013\u00a0<em>k<\/em>ln<em>W<\/em><sub>i<\/sub> to calculate the change in entropy.<\/p>\n<h4>Solution<\/h4>\n<p>The change in entropy is\u00a0\u0394<em>S\u00a0<\/em>=\u00a0<em>S<\/em><sub>f<\/sub>\u00a0\u2013\u00a0<em>S<\/em><sub>i<\/sub>\u00a0=\u00a0<em>k<\/em> ln<em>W<\/em><sub>f<\/sub>\u00a0\u2013\u00a0<em>k<\/em>ln<em>W<\/em><sub>i,<\/sub><\/p>\n<p>where the subscript i stands for the initial 60 heads and 40 tails state, and the subscript f for the final 50 heads and 50 tails state. Substituting the values for <em>W<\/em> from Table 2\u00a0gives<\/p>\n<p>[latex]\\begin{array}{lll}\\Delta{S}&=&\\left(1.38\\times10^{-23}\\text{ J\/K}\\right)\\left[\\ln\\left(1.0\\times10^{29}\\right)-\\ln\\left(1.4\\times{10}^{29}\\right)\\right]\\\\\\text{ }&=&2.7\\times10^{-23}\\text{ J\/K}\\end{array}\\\\[\/latex]<\/p>\n<h4>Discussion<\/h4>\n<p>This increase in entropy means we have moved to a less orderly situation. It is not impossible for further tosses to produce the initial state of 60 heads and 40 tails, but it is less likely. There is about a 1 in 90 chance for that decrease in entropy (\u22122.7\u00a0\u00d7\u00a010<sup>\u221223<\/sup>\u00a0J\/K) to occur. If we calculate the decrease in entropy to move to the most orderly state, we get \u0394<em>S<\/em> = \u221292\u00a0\u00d7 10<sup>\u221223<\/sup>\u00a0J\/K. There is about a 1 in 10<sup>30<\/sup> chance of this change occurring. So while very small decreases in entropy are unlikely, slightly greater decreases are impossibly unlikely. These probabilities imply, again, that for a macroscopic system, a decrease in entropy is impossible. For example, for heat transfer to occur spontaneously from 1.00 kg of 0\u00baC ice to its 0\u00baC environment, there would be a decrease in entropy of 1.22 \u00d7 10<sup>3<\/sup> J\/K. Given that a \u0394<em>S<\/em> 10<sup>\u221221<\/sup> J\/K\u00a0corresponds to about a 1 in 10<sup>30<\/sup> chance, a decrease of this size (10<sup>3<\/sup> J\/K) is an <em>utter<\/em> impossibility. Even for a milligram of melted ice to spontaneously refreeze is impossible.<\/p>\n<\/div>\n<div class=\"textbox key-takeaways\">\n<h3>Problem-Solving Strategies for Entropy<\/h3>\n<ol>\n<li><em>Examine the situation to determine if entropy is involved.<\/em><\/li>\n<li><em>Identify the system of interest and draw a labeled diagram of the system showing energy flow.<\/em><\/li>\n<li><em>Identify exactly what needs to be determined in the problem (identify the unknowns).<\/em> A written list is useful.<\/li>\n<li><em>Make a list of what is given or can be inferred from the problem as stated (identify the knowns).<\/em> You must carefully identify the heat transfer, if any, and the temperature at which the process takes place. It is also important to identify the initial and final states.<\/li>\n<li><em>Solve the appropriate equation for the quantity to be determined (the unknown).<\/em> Note that the change in entropy can be determined between any states by calculating it for a reversible process.<\/li>\n<li><em>Substitute the known value along with their units into the appropriate equation, and obtain numerical solutions complete with units.<\/em><\/li>\n<li><em>To see if it is reasonable: Does it make sense?<\/em> For example, total entropy should increase for any real process or be constant for a reversible process. Disordered states should be more probable and have greater entropy than ordered states.<\/li>\n<\/ol>\n<\/div>\n<h2>Section Summary<\/h2>\n<ul>\n<li>Disorder is far more likely than order, which can be seen statistically.<\/li>\n<li>The entropy of a system in a given state (a macrostate) can be written as\u00a0<em>S\u00a0<\/em>= <em>k\u00a0<\/em>ln<em>W<\/em>,<em>\u00a0<\/em>where\u00a0<em>k\u00a0<\/em>= 1.38 \u00d7 10<sup>\u221223<\/sup> J\/K is Boltzmann\u2019s constant, and ln<em>W<\/em>\u00a0is the natural logarithm of the number of microstates <em>W<\/em>\u00a0corresponding to the given macrostate.<\/li>\n<\/ul>\n<div class=\"textbox key-takeaways\">\n<h3>Conceptual Questions<\/h3>\n<ol>\n<li>Explain why a building made of bricks has smaller entropy than the same bricks in a disorganized pile. Do this by considering the number of ways that each could be formed (the number of microstates in each macrostate).<\/li>\n<\/ol>\n<\/div>\n<div class=\"textbox exercises\">\n<h3>Problems &amp; Exercises<\/h3>\n<ol>\n<li>Using Table 2, verify the contention that if you toss 100 coins each second, you can expect to get 100 heads or 100 tails once in 2 \u00d7 10<sup>22<\/sup> years; calculate the time to two-digit accuracy.<\/li>\n<li>What percent of the time will you get something in the range from 60 heads and 40 tails through 40 heads and 60 tails when tossing 100 coins? The total number of microstates in that range is 1.22 \u00d7 10<sup>30<\/sup>. (Consult Table 2.)<\/li>\n<li>(a)\u00a0If tossing 100 coins, how many ways (microstates) are there to get the three most likely macrostates of 49 heads and 51 tails, 50 heads and 50 tails, and 51 heads and 49 tails? (b)\u00a0What percent of the total possibilities is this? (Consult Table 2.)<\/li>\n<li>(a)\u00a0What is the change in entropy if you start with 100 coins in the 45 heads and 55 tails macrostate, toss them, and get 51 heads and 49 tails? (b)\u00a0What if you get 75 heads and 25 tails? (c)\u00a0How much more likely is 51 heads and 49 tails than 75 heads and 25 tails? (d)\u00a0Does either outcome violate the second law of thermodynamics?<\/li>\n<li>(a)\u00a0What is the change in entropy if you start with 10 coins in the 5 heads and 5 tails macrostate, toss them, and get 2 heads and 8 tails? (b)\u00a0How much more likely is 5 heads and 5 tails than 2 heads and 8 tails? (Take the ratio of the number of microstates to find out.) (c)\u00a0If you were betting on 2 heads and 8 tails would you accept odds of 252 to 45? Explain why or why not.<br \/>\n<table>\n<thead>\n<tr>\n<th colspan=\"3\">Table 3. 10-Coin Toss<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<th colspan=\"2\">Macrostate<\/th>\n<th>Number of Microstates<\/th>\n<\/tr>\n<tr>\n<td>Heads<\/td>\n<td>Tails<\/td>\n<td>(<em>W<\/em>)<\/td>\n<\/tr>\n<tr>\n<td>10<\/td>\n<td>0<\/td>\n<td>1<\/td>\n<\/tr>\n<tr>\n<td>9<\/td>\n<td>1<\/td>\n<td>10<\/td>\n<\/tr>\n<tr>\n<td>8<\/td>\n<td>2<\/td>\n<td>45<\/td>\n<\/tr>\n<tr>\n<td>7<\/td>\n<td>3<\/td>\n<td>120<\/td>\n<\/tr>\n<tr>\n<td>6<\/td>\n<td>4<\/td>\n<td>210<\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>5<\/td>\n<td>252<\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>6<\/td>\n<td>210<\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>7<\/td>\n<td>120<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>8<\/td>\n<td>45<\/td>\n<\/tr>\n<tr>\n<td>1<\/td>\n<td>9<\/td>\n<td>10<\/td>\n<\/tr>\n<tr>\n<td>0<\/td>\n<td>10<\/td>\n<td>1<\/td>\n<\/tr>\n<tr>\n<td><\/td>\n<td><\/td>\n<td><strong>Total: 1024<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/li>\n<li>(a)\u00a0If you toss 10 coins, what percent of the time will you get the three most likely macrostates (6 heads and 4 tails, 5 heads and 5 tails, 4 heads and 6 tails)? (b)\u00a0You can realistically toss 10 coins and count the number of heads and tails about twice a minute. At that rate, how long will it take on average to get either 10 heads and 0 tails or 0 heads and 10 tails?<\/li>\n<li>(a)\u00a0Construct a table showing the macrostates and all of the individual microstates for tossing 6 coins. (Use Table 3\u00a0as a guide.) (b)\u00a0How many macrostates are there? (c)\u00a0What is the total number of microstates? (d)\u00a0What percent chance is there of tossing 5 heads and 1 tail? (e)\u00a0How much more likely are you to toss 3 heads and 3 tails than 5 heads and 1 tail? (Take the ratio of the number of microstates to find out.)<\/li>\n<li>In an air conditioner, 12.65 MJ of heat transfer occurs from a cold environment in 1.00 h. (a)\u00a0What mass of ice melting would involve the same heat transfer? (b)\u00a0How many hours of operation would be equivalent to melting 900 kg of ice? (c)\u00a0If ice costs 20 cents per kg, do you think the air conditioner could be operated more cheaply than by simply using ice? Describe in detail how you evaluate the relative costs.<\/li>\n<\/ol>\n<\/div>\n<h2>Glossary<\/h2>\n<p><strong>macrostate:\u00a0<\/strong>an overall property of a system<\/p>\n<p><strong>microstate:<\/strong>\u00a0each sequence within a larger macrostate<\/p>\n<p><strong>statistical analysis:<\/strong>\u00a0using statistics to examine data, such as counting microstates and macrostates<\/p>\n<div class=\"textbox exercises\">\n<h3>Selected Solutions to Problems &amp; Exercises<\/h3>\n<p>1.\u00a0It should happen twice in every 1.27\u00a0\u00d7 10<sup>30<\/sup> s\u00a0or once in every 6.35 \u00d7 10<sup>29<\/sup> s<\/p>\n<p>[latex]\\begin{array}{ll}\\left(6.35\\times {\\text{10}}^{\\text{29}}\\text{s}\\right)\\left(\\frac{\\text{1 h}}{\\text{3600 s}}\\right)& \\left(\\frac{\\text{1 d}}{\\text{24 h}}\\right)\\left(\\frac{\\text{1 y}}{\\text{365.25 d}}\\right)\\\\ =& 2.0\\times {\\text{10}}^{\\text{22}}\\text{y}\\end{array}\\\\[\/latex]<\/p>\n<p>3.\u00a0(a)\u00a03.0 \u00d7 10<sup>29<\/sup>; (b)\u00a024%<\/p>\n<p>5.\u00a0(a)\u00a0\u22122.38 \u00d7 10<sup>\u221223<\/sup> J\/K;\u00a0(b)\u00a05.6 times more likely;\u00a0(c)\u00a0If you were betting on two heads and 8 tails, the odds of breaking even are 252 to 45, so on average you would break even. So, no, you wouldn\u2019t bet on odds of 252 to 45.<\/p>\n<p>7.\u00a0(b)\u00a07;\u00a0(c)\u00a064;\u00a0(d)\u00a09.38%;\u00a0(e)\u00a03.33 times more likely (20 to 6)<\/p>\n<\/div>\n\n\t\t\t <section class=\"citations-section\" role=\"contentinfo\">\n\t\t\t <h3>Candela Citations<\/h3>\n\t\t\t\t\t <div>\n\t\t\t\t\t\t <div id=\"citation-list-3180\">\n\t\t\t\t\t\t\t <div class=\"licensing\"><div class=\"license-attribution-dropdown-subheading\">CC licensed content, Shared previously<\/div><ul class=\"citation-list\"><li>College Physics. <strong>Authored by<\/strong>: OpenStax College. <strong>Located at<\/strong>: <a target=\"_blank\" href=\"http:\/\/cnx.org\/contents\/031da8d3-b525-429c-80cf-6c8ed997733a\/College_Physics\">http:\/\/cnx.org\/contents\/031da8d3-b525-429c-80cf-6c8ed997733a\/College_Physics<\/a>. <strong>License<\/strong>: <em><a target=\"_blank\" rel=\"license\" href=\"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\">CC BY: Attribution<\/a><\/em>. <strong>License Terms<\/strong>: Located at License<\/li><\/ul><\/div>\n\t\t\t\t\t\t <\/div>\n\t\t\t\t\t <\/div>\n\t\t\t <\/section>","protected":false},"author":17,"menu_order":157,"template":"","meta":{"_candela_citation":"[{\"type\":\"cc\",\"description\":\"College Physics\",\"author\":\"OpenStax College\",\"organization\":\"\",\"url\":\"http:\/\/cnx.org\/contents\/031da8d3-b525-429c-80cf-6c8ed997733a\/College_Physics\",\"project\":\"\",\"license\":\"cc-by\",\"license_terms\":\"Located at License\"}]","CANDELA_OUTCOMES_GUID":"","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-3180","chapter","type-chapter","status-publish","hentry"],"part":7570,"_links":{"self":[{"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/chapters\/3180","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/wp\/v2\/users\/17"}],"version-history":[{"count":11,"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/chapters\/3180\/revisions"}],"predecessor-version":[{"id":12283,"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/chapters\/3180\/revisions\/12283"}],"part":[{"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/parts\/7570"}],"metadata":[{"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/chapters\/3180\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/wp\/v2\/media?parent=3180"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/pressbooks\/v2\/chapter-type?post=3180"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/wp\/v2\/contributor?post=3180"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/suny-physics\/wp-json\/wp\/v2\/license?post=3180"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}