Consider a point charge $q$ situated at the origin, and a uniform magnetic field, covering all of space, pointing in the $z$ direction $\mathbf{B}=B_0\hat{\mathbf{k}}$. What happens when you turn off the magnetic field? Which way will the charge go? There is obviously a changing magnetic field, and this will in turn produce an electric field, thereby exerting a force on $q$. But in which direction?
This is a textbook problem (Griffiths) and the solutions say that there are insufficient boundary conditions. OK, but what kind of boundary conditions are missing?