the closest analogy to inertia that we have is the phenomenon of inductance.
The standard setup to obtain strong inductance is to roll a conducting wire into a coil. Coiling the wire accumulates the effect.
When current is flowing through a wire there is a magnetic field around the wire. When the wire is looped the magnetic field is strongest inside that loop. A coiled wire has many loops, accumulating the effect.
Electrostatic fields and magnetic fields have a mutual interaction. A changing magnetic field gives rise to an electric field.
Take the following setup:
A coiled wire, and a source of electromotive power (such as a battery), to start and maintain a current in the wire.
From the moment the circuit is closed current starts flowing. So that is a changing rate of current. The magnetic field that is induced is a changing magnetic field, and this changing magnetic field acts in opposition to the inducing current. This puts a limit on how rapidly the rate of current can change.
Note especially that the self-induction cannot prevent change of current strength. In order for the induction to occur there must be change of current strength.
As long as presence of electromotive force in the circuit is kept up the current strength will keep increasing.
Increase/decrease symmetry
The same self-induction will oppose a decrease in current strength. Decrease of current strength is change of current strength just as well.
Normal wire has a non-zero resistance to current, so when you stop applying an electromotive force the current strength will start decreasing. This change of current strength induces a changing magnetic field that acts in opposition to the change that induced it. The stronger the self-induction of the setup, the stronger the tendency for current to remain flowing when there is no longer an electromotive force.
Circuits with strong self-induction need to be switched with a heavy duty current switch, because the current will tend to arc.
Inertia
Whatever Inertia may be, it is abundantly clear that Inertia is a responsive phenomenon. In order for Inertia to manifest itself in a forceful way there must be change of velocity.
In order to change the velocity of an object a force is required. The rate of change of velocity is proportional to the applied force.
Summerizing:
Inertia opposes change of velocity, but at the same time: because of its responsive nature it is inherently impossible for inertia to prevent change of velocity.