A force feild is called conservative when it can be expressed in terms of a potential energy (or potential), as
$$
\mathbf{F}(\mathbf{x}) = -\nabla U(\mathbf{x}).
$$
Helmholtz decomposition means that any field can be expressed as a sum of a potential and a solenoidal components, i.e., as
$$
\mathbf{E}(\mathbf{x}) = -\nabla \phi(\mathbf{x}) + \nabla\times\mathbf{A}(\mathbf{x}).
$$
Note that $\nabla\cdot(\nabla\times\mathbf{A})\equiv 0$, that is $\nabla\cdot\mathbf{E}=\nabla^2\phi$. Since the Maxwell equation for the electrostatic field is
$$
\nabla\cdot \mathbf{E} = 0,
$$
it is fully described by the scalar potential - adding a solenoidal component would not change anything!
On the other hand, since $\nabla\times\nabla\phi\equiv 0$, we have $\nabla\times\mathbf{E}=\nabla\times(\nabla\times\mathbf{A})$. For the magnetic field this means that this field is fully described by a vector potential, since we have a Maxwell equation
$$\nabla\times\mathbf{B}=0.$$
For the electric field it means that its solenoidal component is fully determined by the derivative of the magnetic field, since
$$
\nabla\times\mathbf{E} = -\frac{\partial \mathbf{B}}{\partial t}.
$$
In other words the solenoidal (i.e., non-conservative) component of the electric field is solely determined by the magnetic field changing in time.
To summarize, the distinction between the conservative and non-conservative components of the electric field is due to the form of the Maxwell equations, which are the experimentally determined laws of nature.