Physics Stack Exchange is a question and answer site for active researchers, academics and students of physics. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am long been confused by these entropy terms. Would be obliged if an explanation is provided in less technical jargon

  1. What are the differences between Shannon's entropy, topological entropy and source entropy?
  2. What exactly is the significane of Kolgomorov complexity. Is it same as Kolgomorov entropy. How is it related to Shannon's entropy?
  3. What information does the complexity number convey? It is known that source entropy=kolgomorov entropy , so what does this imply from the point of view of infomation theory?

Thank you

share|cite|improve this question
what is "source entropy"? It doesn't google for me. Is it just another name for Kolmogorov entropy? – Ron Maimon Jul 20 '12 at 7:57
maybe you could break this question into several questions? Some people might only be able to answer one of your questions and those don't feel it's appropriate to answer this thread. – Xurtio Jul 9 '13 at 15:06

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.