Consider the path integral for a lattice QFT. On a finite lattice, all configurations have finite action. What happens in the continuum limit?
If we apply the saddle-point approximation first and then take the continuum limit, no problems arise. Coleman's comments apply to the continuum limit of the original path integral and so do not contradict the legitimacy of the saddle point approximation. Actually, Coleman's comments also apply to the result of the saddle-point approximation: after applying the saddle-point approximation to the lattice QFT, the only path integral remaining is a gaussian path integral, and Coleman's comments apply to the continuum limit of that gaussian path integral.
A similar comment applies to renormalization. The traditional approach to renormalization tries to take the continuum limit with the coefficients in the action held fixed, then notices that the results are undefined, and then tries to repair them using ad-hoc shenanigans. The mathematically legitimate way to do renormalization is to acknowledge that the coefficients in the action are not constants: they depend on the lattice scale and so do not remain constant during the process of taking the continuum limit. In fact they may diverge, and that's fine, just like $\lim_{x\to 0} x^{-1} x$ is perfectly well-defined despite the presence of the divergent $x^{-1}$ factor. We run into trouble only when we try to take the limit before we calculate the product.
The guiding principle is: taking the continuum limit should be the last thing we do, if we ever do it at all.