I am long been confused by these entropy terms. Would be obliged if an explanation is provided in less technical jargon
- What are the differences between Shannon's entropy, topological entropy and source entropy?
- What exactly is the significane of Kolgomorov complexity. Is it same as Kolgomorov entropy. How is it related to Shannon's entropy?
- What information does the complexity number convey? It is known that source entropy=kolgomorov entropy , so what does this imply from the point of view of infomation theory?