The key here is that it is an infinite plane. If you buy that the electric filed is constant outside of an infinite plane of charge, you have to buy this too. I find that the electric field argument is more intuitive though, so think about why that is true first. For any distance away from the plane you say that the electric field should be stronger or weaker, I always have enough plane (and the symmetry about the origin) to exactly cancel the electric field from any point you give me. In short, you give me a distance, I can always match to "cancel that dependence on distance out" because of symmetry in the plane.
Now, let's try to translate this reasoning to magnetic fields. To gain an intuition look at the law of Biot-Savart
$$\mathbf{B}=\frac{\mu_0}{4\pi}\iint\frac{\mathbf{K}\times (\mathbf{r-r'})}{|\mathbf{r-r'}|^3}d^2r'.$$
Since the plane is infinite, it doesn't matter where you place your origin, so put it anywhere. Due to symmetry in the $xy$-plane, it can't depend on the distance from the origin in the $xy$-plane. So the only option is that it depends on the $z$ coordinate. Hence, the equation looks like
$$\mathbf{B}=\frac{\mu_0}{4\pi}\iint\frac{\mathbf{K}\times (\mathbf{z-r'})}{|\mathbf{z-r'}|^3}d^2r'.$$
Now, try to come up with an argument for why the electric field should depend on the position above the plane $z$. For every distance $z$ above the plane you give me, I can always have enough $xy$-plane to make the quantity $\mathbf{B}$ identical to what it would be at some other point $z$.
I suggest simply doing the Biot-Savart integral over all of $\mathbb{R}^2$ very carefully to convince yourself of this. It's one of those things that you should do it at least once in your life with your own hands. It still won't be completely obvious, but you will get a better feel for how it works out to be constant.