24
$\begingroup$

My question is basically this. Is the second law of thermodynamics a fundamental, basic law of physics, or does it emerge from more fundamental laws?

Let's say I was to write a massive computer simulation of our universe. I model every single sub-atomic particle with all their known behaviours, the fundamental forces of nature as well as (for the sake of this argument) Newtonian mechanics. Now I press the "run" button on my program - will the second law of thermodynamics become "apparent" in this simulation, or would I need to code in special rules for it to work? If I replace Newton's laws with quantum physics, does the answer change in any way?

FWIW, I'm basically a physics pleb. I've never done a course on thermodynamics, and reading about it on the internet confuses me somewhat. So please be gentle and don't assume too much knowledge from my side. :)

$\endgroup$

7 Answers 7

22
$\begingroup$

In thermodynamics, the early 19th century science about heat as a "macroscopic entity", the second law of thermodynamics was an axiom, a principle that couldn't be derived from anything deeper. Instead, physicists used it as a basic assumption to derive many other things about the thermal phenomena. The axiom was assumed to hold exactly.

In the late 19th century, people realized that thermal phenomena are due to the motion of atoms and the amount of chaos in that motion. Laws of thermodynamics could suddenly be derived from microscopic considerations. The second law of thermodynamics then holds "almost at all times", statistically – it doesn't hold strictly because the entropy may temporarily drop by a small amount. It's unlikely for entropy to drop by too much; the process' likelihood goes like $\exp(\Delta S/k_B)$, $\Delta S \lt 0$. So, for macroscopic decreases of the entropy, you may prove that they're "virtually impossible."

The mathematical proof of the second law of thermodynamics within the axiomatic system of statistical physics is known as the Boltzmann's H-theorem or its variations of various kinds.

Yes, if you will simulate (let us assume you are talking about classical, deterministic physics) many atoms and their positions, you will see that they're evolving into the increasingly disordered states so that the entropy is increasing at almost all times (unless you extremely finely adjust the initial state – unless you maliciously calculate the very special initial state for which the entropy will happen to decrease, but these states are extremely rare and they don't differ from the majority in any other way than just by the fact that they happen to evolve into lower-entropy states).

$\endgroup$
10
  • $\begingroup$ Thanks for the informative answer. "Yes, if you will simulate .. many atoms and their positions, you will see that they're evolving into the increasingly disordered states so that the entropy is increasing at almost all times". Will this increase in entropy be indistinguishable from the second law as we know it? Or is there still some mysterious details about the second law that we can't yet reduce to more fundamental laws? $\endgroup$
    – FranS
    Commented Jan 31, 2014 at 8:14
  • 1
    $\begingroup$ It will be identical. We may define the entropy in your computer simulation as well as in the real world and it is increasing for the same reasons in the real world as the reasons you see in the computer simulations. Of course, the entropy and its increase is just one aspect of physics among millions. Just because your simulation respects the increasing entropy - every semirealistic simulation of any physics does - doesn't mean that it's the correct simulation/theory of Nature in all other respects, of course. In particular, Nature is described by a particular quantum theory, not classical one $\endgroup$ Commented Jan 31, 2014 at 8:17
  • $\begingroup$ Thanks Lubos, I can't imagine a more perfect answer to my question. $\endgroup$
    – FranS
    Commented Jan 31, 2014 at 8:25
  • $\begingroup$ Lubos, from what I understand the "proofiness" of the H-theorem was (and is) heavily disputed and the modern point of view is that thermodynamic entropy cannot be a microstate property. Even in quantum mechanics the H-theorem still relies on a random phase approximation (Fermi golden rule) that is analogous to the classical molecular chaos assumption, and has similar problems. Are you aware of these complications? To me, the information theory approach to entropy seems much more solid. $\endgroup$
    – Nanite
    Commented Jan 31, 2014 at 12:18
  • $\begingroup$ I am aware of all these complaints and have heard them about 50 times but I also know that all these complaints are due to people's misunderstanding of the physics. The definition of entropy always depends on some rule to identify microstates (in ensembles) or declare them "close to each other" and that's true for Boltzmann's proof, too. That's true whether or not you call this approach Boltzmann's or "information-theoreteical" - it's still the same thing. Boltzmann established the information-theoretical attitude to these questions, all the updates were just terminological. $\endgroup$ Commented Jan 31, 2014 at 12:31
5
$\begingroup$

It has not be proven that The Second Law of Thermodynamics is physically derived from other basic physical principles. The H-Theorem is predicated upon some pretty serious, yet plausible, assumptions about how our universe works. To my knowledge, these assumptions have not themselves been explained using other principles and/or experimental verifications of some kind; for the kinetic equation, upon whom the theorem derives life, contains fundamental assumptions about how particles interact. That said, the H-theorem is a beautiful model of the interaction of particles, and we see a strong resemblance of it's behavior to the physically observable concept called Entropy.

$\endgroup$
1
  • $\begingroup$ This is not true. Second law follows directly from statistics. Think of brand new deck of cards. Each shuffle makes the deck more dissordered. But not neccessarily. $\endgroup$ Commented Jul 21 at 21:16
2
$\begingroup$

My question is basically this. Is the second law of thermodynamics a fundamental, basic law of physics, or does it emerge from more fundamental laws?

It would be useful first to say what is the 2nd law and what it isn't.

2nd law: when system goes from equilibrium state 1 to equilibrium state 2 in any way and exchanges heat with reservoir at temperature $T_r$, $$ S_2 \geq S_1 + \int_1^2\frac{d Q}{T_r} $$ In special case there is no heat transferred, $$ S_2 \geq S_1. $$

This law is valid for controlled macroscopic systems such as the working medium in a heat engine. Within this domain, it is a basic law.

2nd law does not say that the entropy of all systems or Universe has to increase in time. It speaks only of states of thermodynamic equilibrium.

There were and are attempts to derive 2nd law from microscopic theory, but there are always some additional assumptions about the probability. With these, it was proven that the above law will be obeyed in an actual process with probability very close to 1 (the greater the number of particles, the better). Since probabilistic ideas are involved, it cannot be said that the law is derived as unescapable consequence from the equations of motion.

Let's say I was to write a massive computer simulation of our universe. I model every single sub-atomic particle with all their known behaviours, the fundamental forces of nature as well as (for the sake of this argument) Newtonian mechanics. Now I press the "run" button on my program - will the second law of thermodynamics become "apparent" in this simulation, or would I need to code in special rules for it to work?

Most probably it will not be apparent, since it would hardly be possible to ascertain whether the system is in some kind of equilibrium state.

If you somehow extend the notion of entropy to complicated particle/field system in any microscopic state, then the question makes much more sense, but then it is also no longer about the entropy of the 2nd law, only about the new concept of entropy.

Then, you will need to start the simulation with some initial conditions (boundary conditions). If all the basic equations in the computer model are time-reversible (and the most basic equations of motion are), then for each initial condition that leads to increasing entropy there is an initial condition that leads to decreasing entropy.

To find such "weird" condition, let's think of a model that describes particles moving under influence of their gravitational forces. Just consider the trajectory that increases entropy, take its final point, reverse all the velocities and start the simulation again. The system will retrace its past states, so its entropy has to decrease.

One can get systematic increase of entropy only if the initial states are being chosen in a special way. We do not know whether the Universe started in such special state or not, or whether the entropy of the Universe, be it anything, increases or not. These and related questions of "heat death of the Universe" are entirely out of scope of the 2nd law of thermodynamics.

$\endgroup$
5
  • $\begingroup$ "Since probabilistic ideas are involved, it cannot be said that the law is derived as unescapable consequence from the equations of motion." I'm not sure I follow. Why would the inclusion of a probabilistic element prohibit the law from being derivable from more fundamental, mechanical laws? $\endgroup$
    – FranS
    Commented Jan 31, 2014 at 12:09
  • $\begingroup$ Because the statement "2nd law will be obeyed with probability close to 1" is not the same as statement "2nd law will be obeyed". The former is a statement about probability, the second is not. $\endgroup$ Commented Jan 31, 2014 at 13:06
  • $\begingroup$ Statements about probability are usually derived from other statements about probability. In case of the 2nd law, the fact that the derived probability is close to 1 has roots in some other probability statement in the derivation, which is most probably not derivable from the physical laws. $\endgroup$ Commented Jan 31, 2014 at 13:21
  • $\begingroup$ A probabilistic element can mean either the thing being described is uncertain in principle (as in quantum mechanics), but it can also mean that we use probability because it is much more convenient than trying to account for every single individual thing in the system. Which is the 2nd law? $\endgroup$
    – FranS
    Commented Jan 31, 2014 at 13:23
  • 1
    $\begingroup$ The probabilistic version of 2nd law derived within classical statistical physics uses probability in the sense "probability that given the same conditions (preparation procedure), the system is in microstate near $q,p$". There is no "uncertainty in principle" in classical statistical physics. $\endgroup$ Commented Jan 31, 2014 at 13:32
2
$\begingroup$

First we would start by stating what version of the second law. The classical thermodynamics version $\Delta S \ge 0$ for isolated systems is not fundamental. First it doesn't apply to open systems and has to be replaced by $\Delta_i S \ge 0$. Second, it refers to macroscopic systems that aren't too special (long-range correlations). Moreover, it can be derived from more fundamental expressions. For instance taking a local production of entropy $\sigma_S = \sum J_i X_i = J_Q\nabla(1/T) + J_N \nabla(\mu/T) + \cdots$ and integrating over the whole volume of the macroscopic system one obtains the classical expression $\Delta_i S \ge 0$.

Now if by second law you mean the modern microscopic version (The second law as a selection principle: The microscopic theory of dissipative processes in quantum systems), then it is not derivable from anything else.

About simulations. If you use "fundamental forces" and Newtonian mechanics you will get a simulation that could agree with our universe or not, because the laws of mechanics are compatible with heat spontaneously flowing from hot to cold and with flowing from cold to hot, when only one of those processes is observed in nature. Precisely that is the reason why thermodynamics was invented to deal with such observations and complement Newtonian mechanics.

To correctly simulate Universe (at least when relativity and quantum effects aren't important) you have to use dissipative particle dynamics. This is a standard procedure that uses Newtonian equations $ma = F$ with a total force given by $F= F_C + F_D + F_R$. The first term are conservative (and time reversible and deterministic) forces, the second are dissipative or frictional forces and the last are random (stochastic) forces. The explicit expressions for the dissipative and random forces are chosen to be compatible with the second law.

Note: Since Boltzmann H-theorem has been mentioned in other replies and comments, a pair of remarks are worth. First, the theorem is only valid for a special kind of diluted gases, whereas the second law is more general. Second, Boltzmann original demonstration of the theorem is incorrect. There are a huge literature on the hidden assumptions and explicit mistakes made by Boltzmann and why, contrary to his claims, he didn't derive the second law. Many modern re-derivations of the theorem repeat the old mistakes or make some new.

$\endgroup$
1
$\begingroup$

I see the second law of thermodymamics more as an empirical principle. In the history of our universe as we know it now, many times it did not appear to hold.

If you simulate some air molecules in a box tracking their paths you will soon end with a more or less uniform distribution of particles in a situation of maximum disorder. However if you try to do the same starting from the quark-gluon plasma of the primordial universe, you'll need a way to break the second law in order to create articulate structures (from stars to DNA) from the initial disorder.

We still lack a lot of comprehension about these things.

$\endgroup$
1
$\begingroup$

My one cent.

According to some physicists, the second law of thermodynamics is simply a statistical and emergent law (eg as in the form derived from fluctuation theorem) that can be violated, although this becomes unlikely as systems get larger and/or durations get longer.

However other physicists (myself included) are of the opinion that the second law is a basic law, at least as basic and fundamental as any other fundamental law we can think of, that cannot be violated. This has been justified, for example, both in purely thermodynamic terms (1) and in thermodynamic/information terms (2).

References:

  1. What is the second law of thermodynamics and are there any limits to its validity? Elias P. Gyftopoulos, Gian Paolo Beretta 2005

In the scientific and engineering literature, the second law of thermodynamics is expressed in terms of the behavior of entropy in reversible and irreversible processes. According to the prevailing statistical mechanics interpretation the entropy is viewed as a nonphysical statistical attribute, a measure of either disorder in a system, or lack of information about the system, or erasure of information collected about the system, and a plethora of analytic expressions are proposed for the various measures. In this paper, we present two expositions of thermodynamics (both 'revolutionary' in the sense of Thomas Kuhn with respect to conventional statistical mechanics and traditional expositions of thermodynamics) that apply to all systems (both macroscopic and microscopic, including single particle or single spin systems), and to all states (thermodynamic or stable equilibrium, nonequilibrium, and other states).

  1. Universal validity of the second law of information thermodynamics, Shintaro Minagawa, M. Hamed Mohammady, Kenta Sakai, Kohtaro Kato, Francesco Buscemi 2023

Feedback control and erasure protocols have often been considered as a model to embody Maxwell's Demon paradox and to study the interplay between thermodynamics and information processing. Such studies have led to the conclusion, now widely accepted in the community, that Maxwell's Demon and the second law of thermodynamics can peacefully coexist because any gain provided by the demon must be offset by the cost of performing measurement and resetting the demon's memory to its initial state. Statements of this kind are collectively referred to as second laws of information thermodynamics and have recently been extended to include quantum theoretical scenarios. However, previous studies in this direction have made several assumptions, in particular about the feedback process and the measurement performed on the demon's memory, and thus arrived at statements that are not universally applicable and whose range of validity is not clear. In this work, we fill this gap by precisely characterizing the full range of quantum feedback control and erasure protocols that are overall consistent with the second law of thermodynamics. This leads us to conclude that the second law of information thermodynamics is indeed universal: it must hold for any quantum feedback control and erasure protocol, regardless of the measurement process involved, as long as the protocol is overall compatible with thermodynamics. Our comprehensive analysis not only encompasses new scenarios but also retrieves previous ones, doing so with fewer assumptions. This simplification contributes to a clearer understanding of the theory. Additionally, our work identifies the Groenewold--Ozawa information gain as the correct information measure characterizing the work extractable by feedback control.

$\endgroup$
0
$\begingroup$

The 'second law of thermodynamics' is a not a law of physics, it is just a statement about probabilities. It is similar to the statement 'the probability of a fair coin coming up heads a million times in a row is very low'.

$\endgroup$
1
  • $\begingroup$ Welcome on Physics SE :) As your answer can be called non-canonical, it might be a good idea to support it with more elaboration and sources :) $\endgroup$
    – Sanya
    Commented Dec 29, 2016 at 1:02

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.