I find that Schwartz is using the laziest way to discuss the integration of a field. What is going on can be made much more transparent rather easily.
To simplify the discussion, I will assume that the theory is described by two scalar fields $\psi$ and $\phi$, each described by a (possibly interacting) Lagrangian $\mathcal L_\psi$ and $\mathcal L_\phi$, which are coupled linearly, $\mathcal L_c=-g \,\psi\phi$. (I use Euclidian notations. The sign in front of $g$ is introduced for later convenience. The discussion can be adapted easily for other coupling and other kinds of fields).
The partition function is then given by
$$ Z=\int \mathcal D \psi \mathcal D \phi e^{-S_\psi-S_\phi-S_c},$$
with $S_i$ the action corresponding to $\mathcal L_i$. In the present context, integrating out a field just means formally doing the corresponding functional integral.
Say we want to integrate out the field $\phi$. In all generality, the generating function of the connected correlation function of the field $\phi$ (not coupled to the field $\psi$) is defined by
$$
W_\phi[J]=\log\int \mathcal D \phi\, e^{-S_\phi+\int dx J \phi},
$$
with $J$ a source. Then, we have
$$
Z=\int \mathcal D \psi e^{-S_{eff}},
$$
with $S_{eff}=S_\psi-W_\phi[g\,\psi]$. This is really (and only) what integrating out a field means.
Now, several remarks are in order.
1) If $S_\phi$ is quadratic, for instance $\mathcal L =\frac12 \phi(-\nabla^2+m^2)\phi$, one has $W_\phi[J]=\frac12 \int dx dy J(x) \frac1{-\nabla^2+m^2}J(y)$, up to a constant. This could also be obtained by replacing $\phi$ by the solution of the equation of motion $\phi_c$, which is such that $(-\nabla^2+m^2)\phi_c=J$. This is because for quadratic action, the semi-classical analysis (or saddle point approximation + gaussian fluctuations) is exact. We then recover Schwartz's discussion.
2) If $S_\phi$ is not quadratic, we can formally expand $W_\phi[g\, \psi]$ in $\psi$, which gives rise to new interaction terms. If $\phi$ is massive, its correlation functions are short-range, and, as long as we are interested in the physics of $\psi$ on distances much larger than the inverse mass, these interactions can be approximated as local (it corresponds to a gradient expansion of the correlation functions, for momenta much smaller than the mass). This is pretty much the effective field theory point of view (which allows for instance to record Fermi's theory of weak interaction from the standard model).
3) In a more Wilsonian point of view, when the RG scale (effective cut-off) gets smaller than the mass of $\phi$, this field decouples (since its contribution to the flow is of order cut-off/mass to some power), and it has been in essence integrated out in much the same way than what is done above.
4) If $\phi$ is massless (either it is free and massless, or interacting and massless, as it happens close at second-order phase transitions), then the effective interactions are highly non-local (in momentum space, they are non-analytic), which in practice makes $S_{eff}$ rather useless for any real calculations. The general rule of thumb is that integrating out massless fields is a very bad idea, they should be kept.