This means the magnetic fields must produce electric fields inside the coil.
Yes, but this produced electric field, called induced electric field $\mathbf E_i$ , is only one component of total electric field in the conductor of the coil. It is not the total electric field itself.
Total electric field in an ideal wire of the coil is zero (because it is perfect conductor). However, this does not imply that voltage on the terminals has to be zero. Voltage on a component in AC circuits is not defined by total electric field, but only by its conservative (Coulomb, electrostatic) component. In AC circuits "voltage" usually means difference of electric potential, and this difference is defined based on the conservative field component.
In an ideal conductor with finite current density, total electric field has to be zero, so any induced electric field, if present, has to be counteracted and cancelled by some other contribution to the field, of the same magnitude but opposite direction in space. Electric field component that is always present in electric circuits is the conservative field $\mathbf E_{C}$, essentially a sum of all the Coulomb fields due to all charges in the system (most of which are usually on conductors' surfaces). This field component is zero inside conductors in the special case where everything is in static equilibrium, but as soon as charges accelerate (when electric current changes in time), the conservative field will be non-zero inside conductors, so that it can cancel the induced field. So, in the coil conductor with changing current present, induced electric field due to accelerated charges in the coil is cancelled by the conservative field of all the charges in the circuit.
Voltage or potential difference is integral of this conservative component of the field $\mathbf E_C$. Its integral is therefore independent of the path, it only depends on the endpoints. To calculate voltage between coil terminals A and B, one can use the path that the charge carriers actually follow, but if one chose a path that went out of that path and then back, as long as the endpoints are the same, the result would be the same.
Induced electromotive force (emf), on the other hand, is integral of the induced electric field $\mathbf E_i$, and depends not only on the endpoints, but also on the integration path. However, usually we are interested only in the value of emf for the special path where the charge carriers in the coil go.
Let motion "from A to B" be the positive sense of circulation in the circuit. Then the value of the emf for this oriented path is, in the common convention,
$$
emf(A~to~
B) = \int_A^B \mathbf E_i\cdot d\mathbf s = -L\frac{dI}{dt}.~~~(1)
$$
Since induced electric field is everywhere in the ideal coil cancelled by the conservative electric field, the integral of this conservative field has to have the opposite value:
$$
\int_A^B \mathbf E_{C}\cdot d\mathbf s = + L\frac{dI}{dt}.~~~(2)
$$
This integral gives the difference of potentials $\varphi_B - \varphi_A$.
In real coils, this cancellation of electric field components is not complete and total electric field is not necessarily zero. Thus potential difference does not counteract emf exactly. Emf is still given by the general formula (1), but potential difference is no longer equal to $LdI/dt$; this expression is valid only in the case of ideal inductor.
However, if the conductor is Ohmic, we can find a different relation between the emf and potential difference. The Kirchhoff 2nd circuital law (generalized Ohm's law) for the coil from terminal A to terminal B implies:
$$
\int_{A,~through~the~path~of~the~current}^B \mathbf E_{total}\cdot d\mathbf s = RI.
$$
$$
\int_{A,~through~the~path~of~the~current}^B (\mathbf E_i + \mathbf E_{C})\cdot d\mathbf s = RI
$$
where $R$ is Ohmic resistance of the coil conductor from $A$ to $B$. Using definitions of emf and potential difference, this is
$$
emf(A~to~B) + (\varphi_B-\varphi_A) = RI.
$$
Since the right-hand side is not zero in general,
emf and potential difference do not cancel each other completely in real inductors. Their algebraic sum can be understood as the "net active force" that pushes the current against the Ohmic resistance. The emf usually acts against the potential difference, so the greater the Ohmic resistance, the greater the difference of magnitudes of emf and potential difference has to be to maintain the same current.