So we can write the $SU(2)$ matrices multiplication as this.
$$\begin{bmatrix}\alpha&\beta\\-\beta^*&\alpha^*\end{bmatrix}\begin{bmatrix}z&x-iy\\x+iy&-z\end{bmatrix}\begin{bmatrix}\alpha^*&-\beta\\\beta^*&\alpha\end{bmatrix}=\begin{bmatrix}Z&X-iY\\X+iY&-Z\end{bmatrix}$$
now is this always rotation ($SO(3)$) provided that $|\alpha|^2+|\beta|^2=1$ which makes them $SU(2)$.
and therefore we can rotate Pauli vectors with the help of $SU(2)$ and we know that Pauli vectors are like 3d vectors so we are effectively rotating the 3d space with the help of $SU(2)$ instead of $SO(3)$.
edit:-
and so we then can imagine Pauli spinors present within the geometry which just rotate by $SU(2)$ operation on them.