Dyson Series Iteration - Gives Exact Solution? When we derive the Dyson series for usage as the time evolution operator in the case of a time dependent Hamiltonian, we start with the equation:
\begin{align}\hat{U}_I(t,t_i) = 1 - \frac{i}{\hbar}\int_{t_i}^t\hat{V}_I(t')\hat{U}_I(t',t_i)dt' 
\end{align}
And then we iterate the equation further by substituting in $U_I$ in the integral. Eventually, we do $N\longrightarrow \infty$ of these iterations, and we call that the solution. But my question is, even after we iterate this integral an infinity number of times, how can we consider that a solution? Won't the $N$th term in the Dyson Series still depend on $U$? Thus it would still continue to be an integral form of a differential equation, but not a solution itself?
I know the utility of this series is that we could, for example, use the first two or three terms in a perturbation expansion. But all sources I've read seem to imply that the infinite Dyson Expansion is THE unitary time evolution operator for time dependent Hamiltonian, when it just seems to be an integral form of the Schrodinger equation even for $N\longrightarrow \infty$?
 A: First, numerically one could never actually done the infinite summation. 
Second, the "magic" of Dyson series was convergences, that if you did more and more closely step, discrete integration, the solution converges.
The first step may be found by CAF's answer here: Dyson series derivation  However, if you sum it smaller and more, it would be more accurate. Read https://ocw.mit.edu/courses/nuclear-engineering/22-51-quantum-theory-of-radiation-interactions-fall-2012/lecture-notes/MIT22_51F12_Ch5.pdf 5.2.1  Dyson Time-ordering operator. If you are looking at convergence, read this https://en.wikipedia.org/wiki/Fixed-point_iteration. 
For a more detailed answer, I found http://bolvan.ph.utexas.edu/~vadim/classes/11f/dyson.pdf to be very helpful, at the end of page four "time-ordered exponential".(It's the mathematical basis for the series.)
It looks to me that the main message of the Dyson series was to take care of the deviation of the operator's time dependence. By increasing the order, it resolves the time dependence, and when approach infinity, it's exact. It's basically integrating along with the time iteration in infinite decimal place in $t$. It doesn't matter which operator you are using, as long as it can be expressed as a valid Dyson series, which is important(if you can't write it as a valid Dyson series, this approach would nor apply, it may happen when you encounter some type of infinity). You don't need to worry about the solution unless you are thinking about approximation, Dyson series is an actual numerical solution in integration form. 
Other useful information may be found here: http://farside.ph.utexas.edu/teaching/qm/lectures/node74.html  or https://www.physicsforums.com/threads/derivation-of-dyson-series.465513/
