The Pauli spin matrices $$ \sigma_1 ~=~ (\begin{smallmatrix} 0 & 1 \\ 1 & 0 \end{smallmatrix}), \qquad\qquad \sigma_2 ~=~ (\begin{smallmatrix} 0 & -i \\ i & 0 \end{smallmatrix}), \qquad\qquad \sigma_3 ~=~ (\begin{smallmatrix} 1 & 0 \\ 0 & -1 \end{smallmatrix}),$$
are mathematically symmetric in the sense that (like $i$ and $-i$) they can be universally exchanged with each other in several ways without altering any mathematical result. However, the visual forms for these three matrices are unexpectedly diverse (e.g., only $\sigma_2$ uses $i$ and $-i$). My understanding of physics history is that Pauli (and also Dirac) developed his matrices by trial and error, rather than by applying any specific theory.
Does a deeper theoretical explanation exist for why these very different visual representations of spin are nonetheless interchangeable in multiple ways?


