I'm having some difficulty with understanding why KVL (Kirchhoff voltage law) is valid when considering an AC circuit. I mean, the system is by definition not in steady state, right? That in turn means that the change in current causes a change in the magnetic field, which is manifested within the electric potential. I realize the potential is still defined and thus a line integral over a crossed curve of ALL of it's component should be zero.
That is correct. However, it is important to realize that the line integral mentioned above is line integral of the conservative component of total electric field $\mathbf E_{C}$, not integral of total electric field $\mathbf E = \mathbf E_{C} + \mathbf E_i$, where $\mathbf E_i$ is non-conservative part of the field, often due to induced electric field. So, generally
$$
\oint_{any~loop} \mathbf E_{C} \cdot d\mathbf s = 0.
$$
If charge distribution in the system is not moving fast, the field $\mathbf E_C$ can be visualized as the Coulomb integral of charge density over all space.
This is relevant because electric potential is related only to this conservative component of the electric field. It is not possible to define electric potential using total electric field $\mathbf E$, because in general, any line integral of $\mathbf E$ depends not merely on endpoints, but also on the path.
However, what I often see (for, say, RLC circuits with an AC emf) is total disregard to the time varying components of the electric potential. Only the emf of the different components are considered and their sum is said to be zero. How can that be? What about the "second" part of the potentials?
Not sure what you mean here. If the AC circuit is powered by AC source, then potential at any point will indeed oscillate in time, with same frequency.
Maybe you mean that when solving equations for simple RLC circuits, the time-dependent factor $e^{i\omega t}$ is dropped. This is done because those equations are linear and this factor is common to all terms in the equation, so it can be dropped in order to simplify the equations. Differential equations then become algebraic equations where time has no role.