0
$\begingroup$

How to derive an expression for entropy in form of

$S = \ln \Omega$

from the form

$\displaystyle{S = - \sum_i \; p_i \ln p_i}$ ?

That is the last formula taken as a definition of entropy.

Just a reference will do. The backwards derivation (probably with some assumptions) is given in Landau and Lifshitz.

$\endgroup$
1
  • $\begingroup$ WHat is $\Omega$? For uniform distribution $p_i=1/n$ the entropy is $ln n$. $\endgroup$
    – Andreas K.
    Jan 30, 2012 at 17:39

1 Answer 1

3
$\begingroup$

If there are $\Omega$ states and $p_i$ is constant by the fundamental postulate of statistical mechanics, then you have

$$1=\sum_{i=1}^\Omega\ p_i=\Omega\ p_i\ \ \Longrightarrow\ \ p_i=\frac{1}{\Omega},$$ and consequently $$S = - \sum_{i=1}^\Omega\ p_i \ln p_i=- \sum_{i=1}^\Omega\ p_i \ln \frac{1}{\Omega}=\left(-\ln \frac{1}{\Omega}\right) \sum_{i=1}^\Omega\ p_i=\ln\Omega.$$

$\endgroup$
3
  • $\begingroup$ Well, that's exact for microcanonical ensemble . The thing is that $\ln \Omega$ is used for canonical ensemble too. After a bit of thinking I think I got why it is valid and what does $\Omega$ mean for a canonical ensemble. Anyway I don't need it anymore, so I won't check my guess. $\endgroup$
    – Yrogirg
    Jan 31, 2012 at 15:27
  • $\begingroup$ @Yrogirg: Wait. In the canonical ensamble, don't you just compute the partition function with $p_i=e^{-H/T}$ and take the logarithm, so you get the free energy and compute an expression for the entropy from there? $\endgroup$
    – Nikolaj-K
    Jan 31, 2012 at 15:56
  • $\begingroup$ The question is not how do you compute entropy (anyway one cannot generally compute the partition function), but how do you define entropy in statistical physics. I prefer the definition as $S = - \sum_i \; p_i \ln p_i$ ($- \int \rho \ln \rho \; d \Gamma$, $\text{Tr} \hat \rho \ln \hat \rho$). But following Boltzmann some use $\ln \Omega$ definition. I don't quite get that definition, at least in ensembles other than micro canonical. So I've asked how to derive one from the other partly because I wanted to understand that $\ln \Omega$ definition. $\endgroup$
    – Yrogirg
    Jan 31, 2012 at 16:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.