I report below (part of) page 73 of the book The Fokker-Planck Equation, by H. Risken
We now derive an expression for the transition probability density for small $\tau$ \begin{equation}\tag{1} p(x,t+\tau|x', t)=\bigg(1+L_{\mathrm{FP}}(x,t)+O(\tau^2)\bigg)\delta(x-x') \end{equation} with \begin{equation}\tag{2} L_{\mathrm{FP}}(x,t):=-\frac{\partial}{\partial t}D_1(x,t)+\frac{\partial^2}{\partial x^2}D_2(x, t) \end{equation} We get up to corrections of the order $\tau^2$: \begin{equation} \begin{aligned} p(x,t+\tau|x', t)&=\bigg(1-\frac{\partial}{\partial t}D_1(x',t)\tau+\frac{\partial^2}{\partial x^2}D_2(x', t)\tau\bigg)\delta(x-x')\\ &=\exp\bigg(-\frac{\partial}{\partial t}D_1(x',t)\tau+\frac{\partial^2}{\partial x^2}D_2(x', t)\tau\bigg)\delta(x-x') \end{aligned} \tag{3} \end{equation}
I don't get the last equality in equation $\mathrm{(3)}$. At first glance, it would appear to be just a replacement. After all $\exp(L_{\mathrm{FP}}\,\tau)\simeq 1+L_{\mathrm{FP}}\,\tau$ for $\tau\to 0$. But is it?
After a few other steps, he writes the solution as
\begin{equation}\tag{4} p(x,t+\tau|x',t)=\frac{1}{\sqrt{4\pi\,D_2(x',t)}}\exp\left(\frac{[(x-x')-D_1(x',t)\tau]^2}{4D_2(x', t)\tau}\right) \end{equation}
and then he says
for drift and diffusion coefficients independent of $x$ and $t$, $\mathrm{(4)}$ is not only valid for small $\tau$, but for arbitrary $\tau>0$ (the last line in equation $\mathrm{(3)}$ is then the formal solution).
So... did he just replace the approximate solution with the exact one? One is not supposed to know it ahead.