I know that the canonical ensemble can be derived by maximizing the entropy under the constraint that the mean of the energy is fixed. But is there an intuitive reason for that?
A few definitions/preliminaries to start:
- In the canonical (or "Gibbs") ensemble, we consider the temperature to be fixed. This is often described as considering the system of interest to be in contact with a "large" "heat bath/reservoir," with which the system of interest can exchange energy.
- In the microcanonical ensemble, we consider the energy (and other integrals of the motion, which we ignore here) to be fixed. This is often described as considering the system of interest to be completely isolated.
In the microcanonical ensemble, the distribution function is $$ \rho_{micro}(E) = A\delta(E-E_0)\;, $$ where $E_0$ is the fixed energy of the isolated system. Any microstate that satisfies the condition is equally probable.
The above microcanonical ensemble can be compared with the result of minimizing the entropy subject to only the condition of conservation of probability. Both result in a constant probability for every (accessible) microstate.
The canonical ensemble can be derived by considering the microcanonical ensemble of a system (1) in contact with a heat bath (2). The total distribution is: $$ A\delta(E_1 + E_2 - E_0)d\Gamma_1 d\Gamma_2 $$
The probability of a microstate of system (1) being in state $n$ is: $$ p_n = A\int\delta(E_n + E_2 - E_0)d\Gamma_2\;, $$ which can be shown to equal: $$ w_n = \tilde A e^{-E_n/T}\;, $$ where $T$ is the temperature.
The above probability expression also results from maximizing the entropy subject to two constraints: (1) $\sum_i p_i = 1$; and (2) $\sum_i p_i E_i = U$, where $U$ is some constant, which we will identify as the thermodynamic energy of the macrostate.
So, we see that, in the canonical ensemble, states with arbitrary energies can be excited, but their probability is low if the energies are very high. This is because the system is free to exchange energy with the heat bath.
Similarly, when we maximize the entropy subject to the constraint $\sum_i p_i E_i = U$, we are saying that the microstates of any energy are possible, but nevertheless if we are going to characterize a system in equilibrium we know that the macrostate will be characterizable in terms of some thermodynamic energy $U$, which is why we need the constraint.
This is the best intuitive explanation I can give, and I note it is not really "intuitive," but rather just an explanation of how various ways of looking at ensembles are related. Not sure if there is a better "intuitive" explanation, but if so I look forward to reading about it.