The sign has nothing to do with the charge itself. It is just a convention. Just because we write an electron's charge as $-1.6\times10^{-19}$, it does not make the electron negative or its charge to be less than that of a proton.
We could have called charge on a proton to be $-1.6\times 10^{-19} C$ and the charge on an electron to be $1.6\times 10^{-19} C$. It does not make any difference in physics. Everything will continue to work the way it should.
Saying that a proton has $3.2\times 10^{-19}C$ of charge is not wrong. However, it is more useful to refer to the magnitudes while comparing charges. I would personally prefer to say negative $5\mu C$ is greater than positive $3\mu C$ as it conveys something useful.
Saying that the charge on a proton is $3.2\times 10^{-19} C$ more than a charge on an electron — even though numerically correct — is not really useful as it does not convey:
- the magnitude of the charge on the proton
- the magnitude of the charge on the electron
- the type of charge on the proton
- the type of charge on the electron
- it does not even tell if the magnitude of charge on proton is more or less or the same to that of an electron
Moreover, it could be misleading. Many of us are used to refering to magnitudes of charges while comparing their size. The idea of treating the magnitude of charges with their signs while comparing them isn't really useful.
However, when you are using those values in mathematical equations, you need to take their sign into account. In this case, $p^+ - e^-$$(p^+ - e^-)$ does give you $3.2\times10^{-19}$.
When you are writing equations which involve variables for charges (which can be either negative or positive), you need to give importance to the sign.
$$q_{net} = q_1 + q_2$$
If $q_1$ was $-5C$ and $q_2$ was $3C$, then $q_{net}$ turns out to be $-2C$.
Taking the difference, $q_1 - q_2$ gives you $-8C$. This is correct and this is how you should treat charges in equations.
The net charge of an atom is $0$. Therefore, $p^+ +e^-$ is $0$$3.2\times10^{-19}C$.