Next Article in Journal
Phase-Controlled Atom-Photon Entanglement in a Three-Level V-Type Atomic System via Spontaneously Generated Coherence
Previous Article in Journal
A Risk Profile for Information Fusion Algorithms

Entropy 2011, 13(8), 1533-1540; https://doi.org/10.3390/e13081533

Commentary
Distinguishability in Entropy Calculations: Chemical Reactions, Conformational and Residual Entropy
Departamento de Química Física y Analítica, Universidad de Oviedo, Julián Clavería 8, 33006, Oviedo, Spain
Received: 15 June 2011; in revised form: 2 August 2011 / Accepted: 20 August 2011 / Published: 23 August 2011

Abstract

:
By analyzing different examples of practical entropy calculations and using concepts such as conformational and residual entropies, I show herein that experimental calorimetric entropies of single molecules can be theoretically reproduced considering chemically identical atoms either as distinguishable or indistinguishable particles. The broadly used correction in entropy calculations due to the symmetry number and particle indistinguishability is not mandatory, as an ad hoc correction, to obtain accurate values of absolute and relative entropies. It is shown that, for any chemical reaction of any kind, considering distinguishability or indistinguishability among identical atoms is irrelevant as long as we act consistently in the calculation of all the required entropy contributions.
Keywords:
particle distinguishability; chemical reactions; conformational entropy; residual entropy; Gibbs paradox

1. Introduction

In the statistical treatment of a system of N identical particles, it is customary to divide the partition function by N ! in order to avoid the overcounting of states due to particle indistinguishability [1]. Analogously, the single molecule partition function is divided by the external symmetry number σ e x t that corresponds to the number of indistinguishable molecular orientations, and by the internal symmetry number σ i n t that accounts for the number of indistinguishable conformers (see [2] for a convincing discussion on symmetry numbers). In all cases, the reduction in microstates is related to the concept of indistinguishability: since chemically identical atoms are considered as indistinguishable, any permutation among them would lead to the same state.
The solution of the so-called Gibbs paradox [3,4,5,6,7,8], is probably the most famous example where the same kind of correction has been applied. Gibbs proposed an ad hoc reduction in the entropy of an N-particle system by the amount - k B ln N ! , where k B is Boltzmann’s constant. This entropy diminution, which corresponds to a reduction in the number of microstates accessible to the system by the permutation symmetry number N ! , was able to correct what Gibbs considered as an unphysical situation, that is, the fact that entropy increases after mixing two (identical) ideal gases both being initially at the same temperature and pressure.
The unphysical situation that Gibbs tried to avoid in mixing processes is consistent with the concept of entropy as extensive property as held by Gibbs himself. However, it may be interesting to remember that the thermodynamic definition of entropy proposed by Clausius in 1865 does not reveal anything about how the entropy behaves as the number of particles N changes. The Clausius definition only allows us to compute the difference in entropy between two thermodynamics states of a closed system. Pauli noticed this incompleteness and showed what additional condition must be imposed in order to define an extensive entropy, suggesting that entropy, as defined by Clausius, is not intrinsically an extensive property [4,9]. In any case, the extensivity and the indistinguishability are concepts closely connected to each other in the context of the Gibbs arguments, which have been supported and rejected more than once in an ongoing debate [3,4,7,10,11].
From the point of view of classical statistics, whenever identical particles are distinguishable (Maxwell–Boltzmann statistics), it turns out that the entropy reduction by a term of - k B N ln σ is in contrast with the idea of a magnitude that grows with the number of microscopic complexions compatible with the macroscopic state of the system [6], because ultimately, the result of any symmetry operation including any permutation is another microscopic complexion. Nevertheless, it is well known that the experimental 3rd law entropies of small molecules can be reproduced with extreme accuracy if the entropy reduction is employed. It therefore appears that the experimental values can be reproduced only by using this correction, or equivalently, by adopting truly quantum statistics from which the entropy reduction emerges naturally due to the symmetry of the wave function [12].
The residual entropy [13,14,15] is another concept that can be linked to the indistinguishability. When we assert that a perfect crystal at 0 K has null entropy, we are implicitly assuming from the statistical standpoint that any permutation of two identical particles does not lead to a new microstate. Although the residual entropy is only relevant when is empirically detectable [13,14] and can be related to a potentially measurable latent head [15], the concept will be helpful when we analyse absolute entropies in the context of distinguishable particles. Because in this scenario, the residual entropy would be present even if a reversible path to the solid state at 0 K were available.
Herein, through the careful analysis of various practical cases, I support the idea that considering identical atoms as indistinguishable particles is not mandatory in order to compute entropy values that are in agreement with experiment [10,16,17]. I show that classical treatment (distinguishable particles) can reproduce experimental entropy values without the need for any adjustment due to weaknesses of the classical model. All that is required is to be consistent with all the implications arising from distinguishability, including the consequences for the residual and conformational entropy (if any) of the involved molecules. I also show with two examples the innocuous effect of the distinguishability on the entropy change in chemical reactions obtaining for all cases the same result as that obtained by considering identical atoms as indistinguishable.
The entropy of mixing and the Gibbs paradox, however, is out of the scope of this work because the problem has recently been solved for distinguishable particles without any ad hoc correction [8,17]. In this respect, the present work tries to generalize the idea to any other chemical transformation of any kind, where symmetry changes might take place. The implications of these ideas could be particularly relevant for approximate calculations of absolute entropies in which quantum mechanical and classical statistics are mixed in order to estimate different entropic contributions.

2. Discussion

2.1. Indistinguishable Particles and Third Law Entropies

Nowadays, 3rd law entropies of small molecules in the gas-phase can be computed easily and with remarkable precision by feeding thermodynamic statistical formulae with molecular properties computed with quantum chemical methods [18]. For example, Table 1 shows both theoretical and experimental entropy values reported in the literature for small alkanes [19]. For simplicity, the examples in Table 1 are selected so that the ω possible conformers for each molecule, if any, are not only isoenergetic, but also chemically identical. Thus, the conformational entropy would be zero, depending whether or not we are considering indistinguishability or distinguishability among identical conformers.
Table 1. B3LYP/cc-pVTZ theoretical and experimental entropies in J K - 1 m o l - 1 [19].
Table 1. B3LYP/cc-pVTZ theoretical and experimental entropies in J K - 1 m o l - 1 [19].
Molecule σ e x t TheoryExperimentAbs. Error
methane12186.20186.370.17
ethane6228.50229.160.66
propane2270.20270.310.11
methylpropane3295.50295.700.20
dimethylpropane12306.74306.000.74
2,2-dimethylbutane1358.70358.400.30
Since molar entropies are being dealing with, the number of particles is chosen to be the Avogadro Number ( N a ), expressing the entropy corrections preferably in terms of the gas constant R = k B N a . The theoretical values in Table 1 are Rigid-Rotor Harmonic-Oscillator (RRHO) entropies obtained from standard statistical thermodynamic formulae at the B3LYP/cc-pVTZ level of theory, where B3LYP is a hybrid density functional and cc-pVTZ denotes the correlation consistent basis set used [20]. Standard formulae refers to the fact that in all cases the reported theoretical entropies are reduced due to the symmetry including the permutation symmetry (i.e., reduced by the terms - R ln σ e x t and - k B ln N a ! ) [12]. In principle, we should also correct the entropy due to the internal symmetry number σ i n t = ω by adding - R ln ω . However, it is well known that RRHO entropies do not capture all the intramolecular entropy, as they lack the purely conformational part of the entropy [21,22,23], which is in our case exactly R ln ω and, therefore, the last correction is automatically done due to the deficiencies of the RRHO method. As can be seen in Table 1, the theoretical results are, without any doubt, in good agreement with the experimental values.

2.2. Distinguishable Particles and Third Law Entropies

If the particles are distinguishable, the entropy correction is not justified and there are new entropy terms that should be taken into account. The conformational entropy, for instance, is now not canceled and consequently the corresponding term R ln ω , as well as the one due to the external symmetry R ln σ e x t , must be added to each of the theoretical values in Table 1. By doing so, the agreement of the theoretical data with the experimental values apparently worsens. However, we realise that standard experimental calorimetric entropies are ultimately an entropy change from T = 0 K to T = 298 K . This change is equal to the absolute entropy if the 3rd law holds, i.e.,
S T = 298 K = S T = 0 K + T = 0 K T = 298 K δ Q T
To interpret the experimental results assuming distinguishable particles, it can be noted first that, in the examples, any formal conformational change of a single molecule near 0 K , as well as any rotational symmetry operation, will lead to a different microscopic complexion compatible with the macroscopic state [13]. Therefore, a residual entropy should be considered for these molecules having a value of R ln ( ω σ e x t ) . This quantity must be added to the original experimental values and the resulting entropy values, which assume particle distinguishability, maintain the agreement between theory and experiment (see Table 2).
Table 2. Theoretical (B3LYP/cc-pVTZ) and experimental entropy values in J K - 1 m o l - 1 augmented by R ln ( ω σ e x t ) due to the distinguishability.
Table 2. Theoretical (B3LYP/cc-pVTZ) and experimental entropy values in J K - 1 m o l - 1 augmented by R ln ( ω σ e x t ) due to the distinguishability.
Moleculeω σ e x t TheoryExperimentAbs. Error
methane112206.86207.030.17
ethane36252.53253.190.66
propane 3 2 2294.23294.340.11
methylpropane 3 3 3332.03332.230.20
dimethylpropane 3 4 12363.93363.190.74
2,2-dimethylbutane 3 5 1404.37404.070.30
At this point the reader might wonder why, if all particles are taken as distinguishable, the uncertainty due to the permutation symmetry in the solid state at 0 K has not been considered. After all, any permutation would give a new different microstate. In fact, it could have been done, but it would have changed nothing, because in such a case the term k B ln N a ! needs to also be added to the theoretical value because the translational part of the entropy is computed in its corrected form S t = R ( ln q t + 5 2 ) , where q t is the translational partition function [1]. Note that the corrected form is conceptually equivalent to the “reduced” entropy used by Cheng [17]. In general any other intra- or extra-molecular permutation between identical but distinguishable atoms can both be considered in the gas phase and in the solid state nearby 0 K , and the agreement between theory and experiment would be unaffected.

2.3. Entropy Changes in Chemical Reactions: Is There Any Difference?

The statement that the absolute entropy of a system depends on a subjective decision, to consider or not that identical atoms or particles are indistinguishable, most likely seems awkward. It is no less subjective, however, than setting an arbitrary reference in order to transform a relative magnitude into an absolute one. There are an infinite number of possible functions that would give the correct experimental entropy change, and therefore they all meet the original Clausius thermodynamic definition. The entropy change is the magnitude that must be invariant regardless of any considerations. Through two simple examples, both points of view discussed above (considering identical particles distinguishable or not) will be shown as totally equivalent.
Let us first consider the following equilibrium reactions in the gas phase:
CH3Cl + Cl2 ⇌ CH2Cl2 + HCl
If a quantum chemical program is used to optimize the molecular geometries, carry out the corresponding frequency calculations and compute the RRHO entropies without considering any symmetry operation except the identity, the entropy values, say, S C H 3 C l R R H O , S C l 2 R R H O , S C H 2 C l 2 R R H O , and S H C l R R H O would be obtained. For convenience the required entropy corrections are introduced explicitly, then the estimated entropy change in (R-1) is
Δ S = Δ S n o s y m R R H O + Δ ( - R ln σ e x t ) = Δ S n o s y m R R H O - R ln σ e x t ( CH 2 Cl 2 ) σ e x t ( HCl ) σ e x t ( CH 3 Cl ) σ e x t ( Cl 2 ) = Δ S n o s y m R R H O + R ln 3
where Δ S n o s y m R R H O = S C H 2 C l 2 R R H O + S H C l R R H O - S C H 3 C l R R H O - S C l 2 R R H O . In principle, Δ S would reproduce the experimental entropy change provided that the level of theory in the calculations is adequate.
Considering distinguishability in the same reaction (R-1), it is now obvious that the CH 3 Cl molecule can be formed by any of the 3 distinguishable Cl atoms involved, furthermore, the three numerable H atoms can be reordered in two different forms not superimposable by rotations, being the atoms in Cl 2 completely determined by our first selection. Hence, the reactants would have an additional uncertainty that contributes to the entropy in R ln ( 2 × 3 ) . On the other hand, the CH 2 Cl 2 molecule can be formed by any two of the three Cl and any two of the three H atoms, and once selected, there are two possible arrangements to be chosen between. Note that the atoms are numerable and we could obtain two enantiomeric configurations. The atoms in HCl will be determined once again by the previous selection and finally the entropy estimation under this new formalism is
Δ S = Δ S n o s y m R R H O + R ln 2 3 2 3 2 - R ln ( 2 × 3 ) = Δ S n o s y m R R H O + R ln 18 - R ln 6 = Δ S n o s y m R R H O + R ln 3
which is exactly the same result obtained above.
Let us consider a more complex example where the conformational entropy is also involved. In (R-2), the symmetry number is three for the methylpropane, one in the methylcyclopropane and two for the H, being Δ ( - R ln σ e x t ) = R ln ( 3 / 2 ) .
Entropy 13 01533 i001
Considering identical atoms as indistinguishable, there is no conformational entropy either in the methylpropane or in the methylcyclopropane molecules. The entropy change involved is Δ S = Δ S n o s y m R R H O + R ln ( 3 / 2 ) .
If, on the contrary, identical atoms are distinguishable, the H atoms can be arranged in multiple different ways and the entropy value is not lower due to symmetry, but higher. Additionally, the conformational entropy must be taken into account since any conformational change in any methyl group would give a new different conformer. The uncertainty due to the arrangements of the carbon atoms (excluding the connectivity) is the same in reactant and products and will not be considered.
In order to build the reactant molecule (methylpropane), 10 H atoms need to be distributed into 4 “boxes” of capacities 3, 3, 3 and 1, where, in the boxes of capacity 3 (methyl groups), there are two possible enantiomeric arrangements. Also, each methyl group will contribute to the conformational entropy with 3 conformers, being the total number of complexions
10 ! 3 ! 3 ! 3 ! 1 ! × 2 3 × 3 3 = 10 !
For the products (methylcyclopropane and H 2 ) the carbon atoms which will close the cycle are selected first (there are 3 2 possibilities), then we have 10 H atoms for 5 boxes of capacities 3, 2, 2, 1 and 2, where we included the H 2 molecule as the last box. Once again the methyl groups as well as the - CH 2 - groups have two possible arrangements and each methyl group generates three different conformers. As a consequence, the total number of complexions is
3 2 × 10 ! 3 ! 2 ! 2 ! 2 ! 1 ! × 2 3 × 3 = 3 2 × 10 !
and therefore the computed entropy is
Δ S = Δ S n o s y m R R H O + R ln ( 10 ! × ( 3 / 2 ) ) - R ln 10 ! = Δ S n o s y m R R H O + R ln ( 3 / 2 )
obtaining again the same result under both formalisms.
However, two examples do not equate to a formal proof, the idea needs to be extended to any chemical reaction. To this end, notice that for distinguishable particles, those permutations that lead to a different arrangement, i.e., not superimposable with the original one by rigid rotations are being considered. For a given system, a systematic way to compute the required number of permutations would be to consider all the possible permutations and then reduce this value taking into account the total symmetry number. For example, it is known that there are only two possible arrangements of the distinguishable atoms in the CH 4 molecule, this quantity is equal to the number of permutations of the H atoms ( 4 ! ) divided by the symmetry number of a tetrahedral molecule ( σ = 12 ).
In general, the number of permutations not superimposable by rotations (internal or external) of a system that have n 1 atoms of type 1, n 2 atoms of type 2, and so on, is equal to
i n i ! j σ j
where the denominator is the product of all the symmetry numbers of the system (reactants or products). If, for instance, the last expression in the reaction (R-1) is applied, it results in ( 3 ! 3 ! 1 ! ) / ( 2 × 3 ) = 6 and ( 3 ! 3 ! 1 ! ) / ( 2 × 3 ) = 18 complexions for the reactants and products respectively, the same results obtained above (see Equation (3)).
For a general reaction R e a c t P r o d , since the number and type of atoms is conserved, the numerator in (5) always cancels out in the difference R ln i n i ! j σ j , p r o d - R ln i n i ! j σ j , r e a c t , where σ j , r e a c t and σ j , p r o d are respectively the symmetry number of reactants and products. Consequently, the effect is equivalent to correcting the entropy change by Δ ( - R ln σ ) , being σ = j σ j the total symmetry number on each side of the chemical reaction. Note that the correction is the same as that for indistinguishable particles except for one point; in the above two examples when indistinguishable particles were considered, only external symmetry numbers were used, not because the internal symmetry was not present, but simply because of the flaws of the RRHO approach taken as “reference”. In other words, considering whether identical atoms are distinguishable or not has no effect on the entropy change in chemical reactions.

3. Conclusions

It has been explicitly shown through practical examples that, for all practical applications, it is irrelevant to consider indistinguishable particles or not in entropy calculations. The classical statistical treatment (distinguishable particles) is equally valid provided that the new degrees of freedom involved are taken into account properly. These arguments could be of particular interest for computing entropies in biochemical reactions where the classical treatment is ubiquitous. Even though in such systems it is quite common to observe chemical reactions like binding processes where no symmetry change takes place [21,22], care must be taken, because as we have seen, even under a classical formalism the symmetry should be considered for a proper entropy estimation.

Acknowledgements

The author thanks Dimas Suárez and Ramón López (Universidad de Oviedo) for their careful reading of the manuscript and their suggestions.

References

  1. McQuarrie, D. Statistical Mechanics; University Science Books: Sausalito, CA, USA, 2000. [Google Scholar]
  2. Gilson, M.K.; Irikura, K.K. Symmetry numbers for rigid, flexible, and fluxional molecules: Theory and applications. J. Phys. Chem. B 2010, 114, 16304–16317. [Google Scholar] [CrossRef] [PubMed]
  3. Ben-Naim, A. On the so-called Gibbs paradox, and on the real paradox. Entropy 2007, 9, 132–136. [Google Scholar] [CrossRef]
  4. Jaynes, E. The Gibbs paradox. In Maximum Entropy and Bayesian Methods; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1992. [Google Scholar]
  5. Lesk, A. On the Gibbs paradox: What does indistinguishability really mean? J. Phys. A: Math. Gen. 1980, 13, L111–L114. [Google Scholar] [CrossRef]
  6. Lin, S.K. Correlation of entropy with similarity and symmetry. J. Chem. Inf. Comput. Sci. 1996, 36, 367–376. [Google Scholar] [CrossRef]
  7. Lin, S.K. Gibbs paradox and the concepts of information, symmetry, similarity and their relationship. Entropy 2008, 10, 1–5. [Google Scholar] [CrossRef]
  8. Versteegh, M.A.M.; Dieks, D. The Gibbs paradox and the distinguishability of identical particles. Am. J. Phys. 2011, 79, 741–746. [Google Scholar] [CrossRef]
  9. Pauli, W. Thermodynamics and the Kinetic Theory of Gases. In Pauli Lectures on Physics; MIT Press: Cambridge, MA, USA, 1973. [Google Scholar]
  10. Swendsen, R. Statistical mechanics of classical systems with distinguishable particles. J. Stat. Phys. 2002, 107, 1143–1166. [Google Scholar] [CrossRef]
  11. Nagle, J. Regarding the entropy of distinguishable particles. J. Stat. Phys. 2004, 117, 1047–1062. [Google Scholar] [CrossRef]
  12. Pathria, R. Statistical Mechanics; Butterworth-Heinemann: Oxford, UK, 1996. [Google Scholar]
  13. Pauling, L. The structure and entropy of ice and of other crystals with some randomness of atomic arrangement. J. Am. Chem. Soc. 1935, 57, 2680–2684. [Google Scholar] [CrossRef]
  14. Kozliak, E. Consistent application of the boltzmann distribution to residual entropy in crystals. J. Chem. Educ. 2007, 84, 493–498. [Google Scholar] [CrossRef]
  15. Kozliak, E.; Lambert, F.L. Residual entropy, the third law and latent heat. Entropy 2008, 10, 274–284. [Google Scholar] [CrossRef]
  16. Ercolany, G.; Piguet, C.; Borkovec, M.; Hamacek, J. Symmetry numbers and statistical factors in self-assembly and multivalency. J. Phys. Chem. B 2007, 111, 12195–12203. [Google Scholar] [CrossRef] [PubMed]
  17. Cheng, C.H. Thermodynamics of the system of distinguishable particles. Entropy 2009, 11, 326–333. [Google Scholar] [CrossRef]
  18. DeTar, D.F. Theoretical ab initio calculation of entropy, heat capacity, and heat content. J. Phys. Chem. A 1998, 102, 5128–5141. [Google Scholar] [CrossRef]
  19. NIST Computational Chemistry Comparison and Benchmark Database. Available online: http://cccbdb.nist.gov/ (accessed on 10 June 2011).
  20. Dunning, T. Gaussian basis sets for use in correlated molecular calculations. I. The atoms boron through neon and hydrogen. J. Chem. Phys. 1989, 90, 1007. [Google Scholar] [CrossRef]
  21. Chang, C.; Chen, C.; Gilson, M.K. Ligand configurational entropy and protein binding. Proc. Nat. Acad. Sci. USA 2007, 104, 1534–1539. [Google Scholar] [CrossRef] [PubMed]
  22. Suárez, E.; Díaz, N.; Suárez, D. Entropic control of the relative stability of triple-helical collagen peptide models. J. Phys. Chem. B 2008, 112, 15248–15255. [Google Scholar] [CrossRef] [PubMed]
  23. Zhou, H.X.; Gilson, M.K. Theory of free energy and entropy in noncovalent binding. Chem. Rev. 2009, 109, 4092–4107. [Google Scholar] [CrossRef] [PubMed]
Back to TopTop