Disclaimer. I am a graduate student in pure mathematics, so my knowledge of physics more advanced than basic 1st/2nd year undergraduate physics is very limited. I welcome corrections on any misconceptions present in my question.
Background. From readings I have done online (mainly on Wikipedia and online lecture notes), I understand that according to the theory of quantum mechanics, the possible energy levels of a quantum system are sometimes described using the eigenvalues of a Hermitian operator $H$ called the Hamiltonian operator on a (possibly infinite dimensional) Hilbert space, which is (for convenience) sometimes approximated using a large $n\times n$ Hermitian matrix $\widehat{H}_n$ (i.e., with $n\gg0$).
Furthermore, I understand that for many very complicated and rapidly fluctuating systems (such as heavy atomic nuclei), one is often mostly interested in a generic or typical hermitian operator, which can be modelled by defining our approximation $\widehat{H}_n$ as a random hermitian matrix.
According to what I have written so far, I understand at least partially the interest of studying the spectrum of large Hermitian matrices for applications in physics.
However, when applications in physics are mentioned in random matrix theory, there is usually a lot of emphasis on the invariant random matrix ensembles, which are ensembles of random matrices $M$ whose distributions are invariant under conjugation by matrices from one of the classical matrix Lie groups. For example, the random matrix $M$ is said to belong to a unitary ensemble if the probability distribution of $M$ is equal to the probability distribution of $UMU^*$ for every unitary matrix $U$. This leads me to the following question:
Question. Is there a physical reason why physicists are especially interested in the invariant ensembles? While researching this, I came across the following paragraph in a paper which seems to address this question
Physically, an invariant random matrix ensemble describes extended (but phase-randomized) states, where the localization effects are negligible. In contrast to that any non-invariant ensemble accounts for a sort of structure of eigenfunctions (e.g. localization) in a given basis which may be not the case in a different rotated basis (remember about the extended states in the tight-binding model which are the linear combinations of states localized at a given site).
but given my lack of knowledge of physics jargon, I don't quite understand what is meant by "localization effects are negligible".