Physics Stack Exchange is a question and answer site for active researchers, academics and students of physics. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have seen different authors define von Neumann entropy in different ways. In particular, some use the natural logarithm and others log to base 2. What is the reasoning for this? Does it make any difference? What is the accepted definition?

Thank you in anticipation of your help.

share|cite|improve this question
Use that different logarithms are proportional $\log_b \rho =\frac{\ln \rho}{\ln b}$. – Qmechanic Mar 31 '13 at 10:47

The different conventions give values for entropy that differ by a constant multiplicative factor. You can think of them as different units for measuring entropy.

The entropy with the base-2 logarithm is measured in "bits", and the entropy with the natural logarithm is measured in "nats".

share|cite|improve this answer
+1. To push the point home: the difference amounts to measuring distances in either meters, or feet. The scalar factor doesn't have any impact on anything that matters, and really just amounts to a choice of units. – Niel de Beaudrap Mar 31 '13 at 0:09

In computer science and/or information theory, people call von Neumann entropy Shannon entropy. (The true connection between the two is still being debated, in my knowledge, but that is not important here, I hope). Since the choice of log to base 2 is natural in Computer Science, a lot of authors in that field just define entropy that way. This makes it easier to apply the concept of entropy in programming, where entropy is a fundamental concept in several sub-fields, such as algorithm design. It can also be used for fun-stuff, such as programming a hang-man game.

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.