Suppose that I have a system described by a quantum field theory with Hamiltonian $H$ and $U(1)$ charge $Q$. The thermal density matrix is then $$ \rho = \frac{1}{Z} e^{-(H-\mu Q)/T},\quad Z=Tr(e^{-(H-\mu Q)/T}). $$ In the absence of a chemical potential ($\mu=0$), this density matrix is clearly normalizable (assuming we regularize the system e.g. put it in a finite volume) so long as $H$ is bounded from below. But $$ Q = \text{(number of particles)} - \text{(number of anti-particles)}, $$ meaning that $Q$ is not bounded. Now it is much less obvious that $H - \mu Q$ is bounded, yet we typically just assume it is. Note that if it is not bounded, thermal equilibrium does not exist.
Question: Why is it legitimate to assume $H-\mu Q$ is bounded? Are there certain reasonable conditions that $H$ and $Q$ are expected to satisfy that make this bounded?