A important extensive property of all systems in thermodynamics, statistical mechanics, and information theory, quantifying their disorder (randomness), i.e., our lack of information about them. It characterizes the degree to which the energy of the system is *not* available to do useful work.

learn more… | top users | synonyms

39
votes
6answers
8k views

Why is information indestructible?

I really can't understand what Leonard Susskind means when he says that information is indestructible. Is that information that is lost, through the increase of entropy really recoverable? He ...
5
votes
4answers
677 views

Chance of objects going against greater entropy?

My book uses the argument that the multiplicities of a few macrostates in a macroscopic object take up an extraordinarily large share of all possible microstates, such that even over the entire ...
24
votes
11answers
3k views

How can it be that the beginning universe had a high temperature and a low entropy at the same time?

The Big Bang theory assumes that our universe started from a very/infinitely dense and extremely/infinitely hot state. But on the other side, it is often claimed that our universe must have been ...
18
votes
5answers
3k views

Is a world with constant/decreasing entropy theoretically impossible?

I'm not 110% sure exactly what I mean by this question. It was sparked by a friend who said he wished the law of entropy were reversed, so he wouldn't have to worry about cleaning the bathroom. ...
12
votes
7answers
2k views

How do you prove the second law of thermodynamics from statistical mechanics?

How do you prove the second law of thermodynamics from statistical mechanics? To prove entropy will only increase with time? How to prove? Please guide.
14
votes
6answers
2k views

Does the scientific community consider the Loschmidt paradox resolved? If so what is the resolution?

Does the scientific community consider the Loschmidt paradox resolved? If so what is the resolution? I have never seen dissipation explained, although what I have seen a lot is descriptions of ...
11
votes
10answers
6k views

What is entropy really?

On this site, change in entropy is defined as the amount of energy dispersed divided by the absolute temperature. But I want to know: What is the definition of entropy? Here, entropy is defined as ...
9
votes
6answers
6k views

Why was the universe in a extraordinarily low-entropy state right after the big bang?

Let me start by saying that I have no scientific background whatsoever. I am very interested in science though and I'm currently enjoying Brian Greene's The Fabric of the Cosmos. I'm at chapter 7 and ...
50
votes
5answers
4k views

What is information?

We're all familiar with basic tenets such as "information cannot be transmitted faster than light" and ideas such as information conservation in scenarios like Hawking radiation (and in general, ...
6
votes
4answers
522 views

How does the formation of a solar system not break the second law of thermodynamics?

Please forgive: I am a layman when it comes to physics and cosmology, and have tried finding an answer to this that I can understand, with no luck. As I understand it, the solar system evolved from a ...
72
votes
3answers
4k views

Where is the flaw in this machine that decreases the entropy of a closed system?

I was thinking about a completely unrelated problem (Quantum Field Theory Peskin & Schroeder kind of unrelated!) when the diagram below sprang into my mind for no apparent reason. After some ...
30
votes
7answers
2k views

How is $\frac{dQ}{T}$ measure of randomness of system?

I am studying entropy and its hard for me to catch up what exactly is entropy. Many articles and books write that entropy is the measure of randomness or disorder of the system. They say when a gas ...
8
votes
3answers
2k views

Maxwell's Demon Constant (Information-Energy equivalence)

New Scientist article: Summon a 'demon' to turn information into energy The speed of light c converts between space and time and also appears in e=mc^2. Maxwell's Demon can turn information supplied ...
3
votes
2answers
514 views

Is quantum uncertainty principle related to thermodynamics?

Would like to ask a question, but first i would like to say Hello Everybody in a way that plays the system, since some geniouses decided that one should not be able to say hello in a question. The ...
9
votes
3answers
3k views

Why does the low entropy at the big bang require an explanation? (cosmological arrow of time)

I have read Sean Carrol's book. I have listened to Roger Penrose talk on "Before the Big Bang". Both are offering to explain the mystery of low entropy, highly ordered state, at the Big Bang. Since ...
7
votes
3answers
14k views

Do magnets lose their magnetism?

I recently bought some buckyballs, considered to be the world's best selling desk toy. Essentially, they are little, spherical magnets that can form interesting shapes when a bunch of them are used ...
25
votes
5answers
2k views

Where does deleted information go?

I've heard that, in classical and quantum mechanics, the law of conservation of information holds. I always wonder where my deleted files and folders have gone on my computer. It must be somewhere I ...
6
votes
4answers
865 views

Entropy as an arrow of time

From what I understand, entropy is a concept defined by the experimentalist due to his ignorance of the exact microstate of a system. To say the number of accessible microstates $W$ of the universe is ...
10
votes
3answers
2k views

How efficient is a desktop computer?

As I understand it (and admittedly it's a weak grasp), a computer processes information irreversibly (AND gates, for example), and therefore has some minimum entropy increase associated with its ...
6
votes
1answer
1k views

Clear up confusion about the meaning of entropy

So I though, and was told, that entropy is the amount of disorder in a system. Specifically the example of heat flow and it flows to maximize entropy. To me this seemed odd. This seemed more ordered ...
6
votes
2answers
174 views

How can the microstates be measured with zero energy expenditure?

James P. Sethna. Statistical Mechanics. Exercise 5.2: What prevents a Maxwellian demon from using an atom in an unknown state to extract work? The demon must first measure which side of the ...
6
votes
6answers
2k views

Is it possible for the entropy in an isolated system to decrease?

As far as I can tell, the concept of entropy is a purely statistical one. In my engineering thermodynamics course we were told that the second law of Thermodynamics states that "the entropy of an ...
16
votes
3answers
6k views

Is there any proof for the 2nd law of thermodynamics?

Are there any analytical proofs for the 2nd law of thermodynamics? Or is it based entirely on empirical evidence?
21
votes
3answers
848 views

Intuitive understanding of the entropy equation

In thermodynamics, entropy is defined as $ d S = \dfrac{\delta q_{\rm }}{T}$. This definition guarantees that heat will transfer from hot to cold, which is the second law of thermodynamics. But, why ...
6
votes
2answers
487 views

What is the resolution to Gibb's paradox?

This question is essentially a duplicate of Gibbs Paradox - why should the change in entropy be zero?. The question concerns the following situation: I have some gas of identical particles and they ...
5
votes
2answers
338 views

Does a universe experiencing “heat death” have a temperature?

As defined by Wikipedia: The heat death of the universe is a suggested ultimate fate of the universe in which the universe has diminished to a state of no thermodynamic free energy and ...
6
votes
1answer
347 views

What is the entropy of the universe today?

What's the entropy of the universe today? How does one go about calculating this? I've heard the statement that black holes account for the bulk of the entropy in the universe today, but don't know ...
5
votes
2answers
537 views

Difference between irreversible and entropy?

Cedric Villani recently wrote an article on Landau damping, where at least one topic discussed confused me. Besides discussing the issue of how a process can be microscopically reversible and ...
1
vote
0answers
205 views

What is Mathematical formulation of entropic Gravitational force?

There are people proposing the possibility of using entropic force to explain the gravity force between objects. The emphasis is that entropy is more fundamental than energy. It is the closest study ...
3
votes
1answer
1k views

Should entropy have units and temperature in terms of energy? [duplicate]

I've been thinking about entropy for a while and why it is a confusing concept and many references are filled with varying descriptions of something that is a statistical probability (arrows of time, ...
2
votes
1answer
376 views

The definition of entropy

As history of thermodynamics say, it was a mystery that what is the required condition for a given energy conversion to take place? Like there are two possible events each conserving energy but only ...
0
votes
2answers
67 views

clausious inquality

Take a reservoir which gains a heat Q irreversibly at temp T from a surrounding at temp T0 then the entropy change of reservoir is given by Q/t and that of the surrounding is -Q/T0...How is this ...
92
votes
1answer
3k views

Is it necessary to consume energy to perform computation?

As far as I know, today most of the computers are made from semiconductor devices, so the energy consumed all turns into the heat emitted into space. But I wonder, is it necessary to consume energy ...
22
votes
4answers
2k views

How do you prove $S=-\sum p\ln p$?

How does one prove the formula for entropy $S=-\sum p\ln p$? Obviously systems on the microscopic level are fully determined by the microscopic equations of motion. So if you want to introduce a law ...
15
votes
5answers
3k views

Can a single classical particle have any entropy?

recently I have had some exchanges with @Marek regarding entropy of a single classical particle. I always believed that to define entropy one must have some distribution. In Quantum theory, a single ...
11
votes
1answer
838 views

Why is (von Neumann) entropy maximized for an ensemble in thermal equilibrium?

Consider a quantum system in thermal equilibrium with a heat bath. In determining the density operator of the system, the usual procedure is to maximize the von Neumann entropy subject to the ...
13
votes
2answers
592 views

Black hole no-hair theorems vs. entropy and surface area

I was revisiting some old popular science books a while ago and two statements struck me as incompatible. No-hair theorems: a black hole is fully-described by just a few numbers (mass, spin etc) ...
6
votes
1answer
459 views

Motivation for maximum Renyi/Tsallis entropy

The Conditional limit theorem of Van Campenhout and Cover gives a physical reason for maximizing (Shannon) entropy. Nowadays, in statistical mechanics, people talk about maximum Renyi/Tsallis entropy ...
4
votes
3answers
496 views

Entropy and Information

Several posts and my classes in thermodynamics equate increase in entropy with loss of information. Shannon clearly showed that the information content of a message is zero when its entropy is zero ...
11
votes
7answers
3k views

Why does heat added to a system at a lower temperature cause higher entropy increase?

Entropy is defined in my book as $\Delta\ S = \frac{Q}{T}$. To derive the formula it says that entropy should be directly proportional to the heat energy as with more energy the particles would be ...
4
votes
1answer
2k views

Isentropic processes

I'm having trouble understanding why reversible adiabatic processes are isentropic. I understand that in a reversible adiabatic process there is no heat exchange and so $dQ = TdS = 0.$ However, if ...
3
votes
0answers
120 views

Is there a relationship between force and entropy?

Is there any relation between force and entropy? If any, I would like to know what the equation of this relation will be. What is the entropy of strong and weak nuclear force? Can we determine it? If ...
3
votes
1answer
592 views

Connection between Kolmogorov entropy and Boltzmann entropy

http://math.stackexchange.com/questions/527384/what-is-the-connectivity-between-boltzmanns-entropy-expression-and-shannons-en mentions a relationship between Shannon entropy and Boltzmann entropy. Is ...
6
votes
3answers
2k views

Why does the law of increasing entropy, a law arising from statistics of many particles, underpin modern physics?

As far as I interpret it, the law of ever increasing entropy states that "a system will always move towards the most disordered state, never in the other direction". Now, I understand why it would ...
5
votes
3answers
3k views

Is entropy of all systems zero at absolute zero?

Is the entropy of every system zero at the absolute zero? Or is it taken to be zero at the absolute zero? Are there systems that doesn't reach zero entropy even till absolute zero?
5
votes
1answer
369 views

Is this derivation of Black Hole entropy viable?

This question is motivated by this one. Suppose $l$ is the minimum measurable unit of length. What is entropy of a spinless particle contained in this interval? We know that entropy of a two-level ...
5
votes
7answers
3k views

Entropy and Crystal Growth

I was reading about growing single crystals and I'm a little confused about this - In most crystal growing processes, a "seed crystal" is used, and the rest of the material crystallizes on the seed ...
4
votes
4answers
11k views

For an isolated system, can the entropy decrease or increase?

In any sizable system, the number of equilibrium states are much, much greater then the number of non-equilibrium states. Since each accessible micro state is equally probably, it is overwhelmingly ...
3
votes
1answer
330 views

Simpler derivation of Sackur-Tetrode equation

Is there a reason the following derivation for the Sackur-Tetrode equation is not common? I am teaching a lower undergraduate level class and would like to derive it with simpler terms of only using ...
2
votes
2answers
427 views

Black hole entropy

Bekenstein and Hawking derived the expression for black hole entropy as, $$ S_{BH}={c^3 A\over 4 G \hbar}. $$ We know from the hindsight that entropy has statistical interpretation. It is a measure ...