Why is the Hodge dual so essential? It seems unnatural to me that it is so often worthwhile to replace physical objects with their Hodge duals. For instance, if the magnetic field is properly thought of as a 2-form and the electric field as a 1-form, then why do they show up in Ampere's and Gauss' as laws as their duals, i.e.
$$ \int_{\partial M} \star \mathcal B^2  =  \int \int_M \left( 4\pi j^2 + \frac{\partial \star \mathcal E^1}{\partial t} \right)$$
$$ \int \int_{\partial U} \star \mathcal E^1 = 4 \pi Q_{\mathrm{enc}} $$
Similarly, angular momentum is considered nearly everywhere as a pseudo-vector instead of as a 2-form. Do these laws have formulations that do not use Hodge duals? Is this just for the sake of simplicity, since tensors are less familiar to the physics community than vectors?
 A: In the language of differential forms in spacetime, the field strength $2$-form $F = E\wedge\mathrm{d}\sigma + B$ gives Gauss's law for magnetism and Faraday induction:
$$\mathrm{d}F = 0\text{.}$$
Meanwhile, the electromagnetic excitation $2$-form $H = -\mathcal{H}\wedge\mathrm{d}\sigma + \mathcal{D}$ provides a natural formulation of Gauss's law and Ampère's circuital law:
$$\mathrm{d}H = J\text{,}$$
where $J$ is the electric current 3-form.

For instance, if the magnetic field is properly thought of as a 2-form and the electric field as a 1-form, then why do they show up in Ampere's and Gauss' as laws as their duals, i.e. ...

Because it's a qualitatively different role: $F$ being a closed form is a necessary property to ensure conservation of magnetic flux and that the existence of a potential $1$-form $A$ for which $F = \mathrm{d}A$. But $H$, instead of conservation of magnetic flux, expresses the conservation of charge, with $H$ acting as a "potential" for the electric current $J$.
Of course, if you know that $H\propto\star F$, then you can eliminate the $(\mathcal{D},\mathcal{H})$ excitation fields put everything in terms of $(E,B)$ only. Or the reverse, if you wished. This naturally introduces at least an implicit Hodge dual into the equations, as you have above. But doing so obscures the fundamentally metric-free character of Maxwell's equations: the only place the metric appears is in the Hodge dual. So instead, one can think of the Hodge dual as providing a simple constitutive relation for free space, with vacuum having its own meaningful $\mathbf{D}$ and $\mathbf{H}$ fields.
In that kind of presentation, the appearance of the Hodge dual is natural and necessary to turn electromagnetism into a fully predictive theory--the metric must make an appearance eventually, but Maxwell's equations themselves are metric-free!
There are other possible relations between $H$ and $F$ independent of Maxwell's equations per se, leading to alternative theories of electromagnetism, such as Born-Infeld theory and Heisenberg-Euler vacuum polarization, etc. Generally, the requirements of the relation being local and linear gives $36$ independent components, which $15$ are dissipative and don't contribute to Lagrangian ("skewon") and $1$ that contributes to Lagrangian but doesn't affect light propagation or electromagnetic stress energy (a ghostlike "axion").
For the differential form presentation of electromagnetism that emphasizes the logically independent roles of $F$ and $H$, a good place to start is Hehl and Obukhov's arXiv:physics/0005084, since it works exclusively in $1+3$ decomposition and hence much more clearly corresponds to the more usual presentation of electromagnetism in terms of $(\mathbf{E},\mathbf{B})$ and $(\mathbf{D},\mathbf{H})$. They have also the book on this: Foundations of Classical Electrodynamics, though it's more demanding.
Additionally, MTW's Gravitation has many nice illustrations of what would be $F$ and $H$, although in MTW's presentation they correspond to the "Faraday tensor" and the "Maxwell tensor", respectively, and differ by a conversion factor.
