Two main reasons. First, the raindrop density is really low. Recall how it may sometimes seem it's pouring rain but you go out and barely get hit with some 10 droplets per second. It makes sense, when it's raining, it's still mostly air. If rainfall is $10\, {\rm mm/h}$ at $10\,{\rm m/s}$, the density of droplets must be the quotient of these fluxes ($\sim 3.6\cdot 10^{-6}$). That is, in heavy rain, only a few parts per million of air is droplets (comparable to cloud density). An important factor here is also projection: a visual image is 2D projection of the droplets: raindrops are huge and so this small percentage of volume is mostly concentrated in a few dots at any given time (+blur helps even more). Fog is worse mainly because it covers your field of view more efficiently: a droplet of volume $V$ covers $V^{2/3}$ of your vision. $N$ droplets of volume $V/N$ cover $N^{1/3} V^{2/3}$. Scattering difference also help to obscure even more efficiently, but mostly it's just fragmentation.
Another very important part is the motion blur. Droplets are so fast that within time resolution of a human eye (let's say a 20-50 Hz, depending on the light conditions), the droplet travels up to a metre distance. So the droplet never fully obscures a certain part of your visual field, it only "blocks" your vision for a fraction of the "exposure time".
That being said, when you are looking through a sufficient amount of rain, it does lower visibility quite a lot. Curtains of rain on the horizon are a common sight (possibly with a rainbow, which is, again, see-through).