If the comparator was not unitary, you could not expand it in terms of Hermitean generators of $SU(2)$, which is required in order to construct the non-Abelian covariant derivative, as it is done in Peskin and Schroeder.