We can obtain the classical equations of motion for electromagnetism by considering the vector potential $A^\mu$ and the electric $\mathbf E$ and magnetic $\mathbf B$ fields as independent degrees of freedom.
$$\mathcal L = j^\mu A_\mu - A^0 (\nabla \cdot \mathbf E) - \mathbf A \cdot (\dot {\mathbf E} - \nabla \times \mathbf B) - \frac12 (\mathbf E^2 - \mathbf B^2).$$
Varying the action with respect to $A^\mu$ yields the inhomogeneous Maxwell equations in terms of $\mathbf E$ and $\mathbf B$ (up to possible sign errors):
$$-\frac{\delta S}{\delta A^0} = \nabla \cdot \mathbf E - j^0$$
$$-\frac{\delta S}{\delta \mathbf A} = \dot {\mathbf E} - \nabla \times \mathbf B + \mathbf j$$
while varying with respect to $\mathbf E$ and $\mathbf B$ yields the standard definitions of those fields in terms of derivatives of $A^\mu$:
$$-\frac{\delta S}{\delta \mathbf E} + \mathbf E = \dot {\mathbf A} - \nabla A^0$$
$$\frac{\delta S}{\delta \mathbf B} + \mathbf B = \nabla \times \mathbf A.$$
Under a gauge transformation $A_\mu \to A_\mu + \partial_\mu \lambda$, $\mathcal L$ is not invariant, but $\delta S/\delta \lambda \equiv 0$ when $\partial_{\mu}j^{\mu} = 0$.
In this picture, $A^\mu$ acts as an intermediary between the bivector field $(\mathbf E, \mathbf B)$ and the source of the current density $j^\mu$ (e.g. a spinor field). The relations between $(\mathbf E,\mathbf B)$ and the exterior derivative of the vector potential arise as classical equations of motion, rather than by definition.
Are there problems with this formulation that invalidate it at the classical level? (e.g. too many degrees of freedom, problems with a Hamiltonian formulation, etc.) It looks like the Hamiltonian wouldn't be bounded from below, but maybe there's a workaround.
Does this setup have an analogue in quantum field theory, where we normally consider the gauge field $A^\mu$ as the only fundamental degrees of freedom for electromagnetism?