So, I assumed a pair of electron and proton to behave as a dipole
Classicaly, this is correct.
But in quantum mechanics we don't talk about a localised electron ,but a wavefunction.
In the case of an electron and proton (hydrogen), the orbital has spherical symmetry. This means that the will be no net charge.