Preliminaries: Consider the homogenous Maxwell's equations
$$\partial_\mu F^{\mu\nu}=0.$$
and
$$\partial_{\sigma} F_{\mu \nu}+\partial_{\mu} F_{\nu \sigma}+\partial_{\nu} F_{\sigma \mu}=0$$
Since $F^{\mu\nu}$ is antisymmetric there are a total of $\frac{16-4}{2} =6$ DOFs, all of which are physical.
Now, let us introduce a gauge potential $A_\mu$ so that
$$ F_{\mu\nu} = \partial_\mu A_\nu - \partial_\nu A_\mu $$
which also has 6 DOFs, and also leave the Maxwell equations invariant under a suitable transformation of $A_\mu$. However, we regard some of them as non-physical.
Question: Is my counting of degrees of freedom correct? If not, then where do these "extra" number of degrees arise in introducing the gauge potential $A_\mu$? If my counting is correct, then why are there redundant DOFs in $\partial_{[\mu}A_{\nu]}$ but not $F_{\mu\nu}$?