# Generalized random walk process: Fokker-Planck equation

The diffusion equation $$\frac{\partial p(x,t)}{\partial t} = D \frac{\partial^2 p(x,t)}{\partial x^2}$$ can be derived from a simple random walk on a line.

For example, if the probability of particle being on $$i^{th}$$ site at a timestep $$n$$ is given by $$P(i,n)$$, then it can be given as, $$P(i,n) = \frac{1}{2}\left[ P(i-1,n-1) + P(i+1,n-1) \right]$$ subtracting $$P(i,n-1)$$ on both the sides and going to the continuum limit ($$i \rightarrow x; n \rightarrow t$$) one can arrive at the diffusion equation given at the top.

There are two assumptions built into this random walk.

1. Only the position at timestep ($$n$$) depends only on position at timestep ($$n-1$$) - Markovian nature.
2. Jumps only one step is allowed (i.e. particle can jump only from $$i+1$$ or $$i-1$$ to $$i$$, jumps of two or higher steps are not allowed) - Is this associated to Gaussian approximation?

Now how will the differential equation be modified if I don't consider the above mentioned assumptions? Essentially, can we use this kind of a random walk model to arrive at a non-Markovian and non-Gaussian diffusion equation (A generalized Fokker-Planck equation)?

There is no general equation that could describe all the possible types of random walks. The two assumptions mentioned severely limit the number of possibilities, which is how one arrives at such a simple equation.

Markovian assumption means that the value of the process at step $$n$$ depends only on its value on step $$n-1$$. In principle, it could depend on the value at other steps, e.g., $$P(i,n)=\sum_{m=0}^{n-1}\sum_jW_{i,n; j,m}P(j,m)$$ In the above equation I also eased the Locality assumption - that the only the jumps between neighboring values are allowed.

Finally, there are also homogeneuity assumptions in space and time - that is that the probability of jump is independent on the initial and final states ($$j$$ and $$i$$) and that it is independent on the times $$n$$ and $$m$$.

The general equation above contains only linearity assumption. Assuming that the time and space steps are small one could reduce it to a differential equation, which can have infinitely high order in time and space derivatives, but such a general equation is of little use.

Digression:
In machine learning one often talks about the interplay between bias and variance. Bias results from using a specific model, as not all data points will fit it well. Variance describes how broadly the data points are distributed about the model predictions. Too big a variance means that our model is too simplistic and cannot fit the data (under-fitting), whereas too small variance means that the model potentially has too many parameters (overfitting). In this view, the principles of physics serve to introduce some bias in the model - i.e., to come up with models that are sufficiently simple to fit the data with few parameters, yet sufficiently complex to produce useful predictions.

In the question above one starts with a huge number of parameters $$W_{i,n;j,m}$$. Assuming homogenuity in time and space, and locality in time in space (locality in time is the Markovian assumption) one reduces it to the diffusion equation with one parameter, the diffusion coefficient $$D$$. In some cases this model may prove too simplistic, and one might wish to relax some of the assumptions to allow for more parameters - this is the essence of physics. Starting with as many parameters as possible, and gradually reducing their number, till the results eventually become meaningful, is machine learning.

• Thanks for this lovely answer, especially your digression on the essence physics from an ML viewpoint! I have a question following your statement which can have infinitely high order in time and space derivatives, but such a general equation is of little use, do you by any chance refer to the Kramers-Moyal expansion here? Also, my particular interest is trying to figure what kind of relaxation in the assumptions will lead to a non-Gaussian nature in the random walk process. Aug 29, 2022 at 11:42
• @user35952 Gaussian here is largely the result of the constant coefficients. In my experience it is unaffected, if we add a drift-term (first derivative in $x$), but the result becomes manifestly non-Gaussian, if the diffusion coefficient is dependent on $x$. You may want to look at Moran model and Wright-Fisher model in genetics, as interesting examples (see, e.g., here services.math.duke.edu/~rtd/CPSS2006/cornelllect.pdf) Aug 29, 2022 at 11:55
• @user35952 check equation (7.1) in this paper - this is a classic. This is an example of what you say in your last comment. Aug 29, 2022 at 12:08
• Thank you, this seems quite interesting, will have a look at this article and get back! Aug 29, 2022 at 12:11
• @user35952 these notes give a transition from a discrete Moran model to the diffusion approximation. Aug 29, 2022 at 12:16

From probability transition to PDEs: diffusion equation

Basically, you can interpret the probability interpretation as a discret(ized) form of continuum equations.

For the diffusion equation, you start from the probability transition

$$P(i,n) = \dfrac{1}{2} P(i-1,n-1) + \dfrac{1}{2} P(i+1,n-1)$$,

since, for every point in space (and thus, any index $$i$$) and any time (and thus, any index $$n$$), you imagine that there is equal probability to be at $$i$$ at time $$n$$ coming from $$i-1$$ or $$i+1$$ at time $$n-1$$.

Subtracting $$P(i,n-1)$$ on both sides of the equation, you get

$$P(i,n) - P(i,n-1) = \dfrac{1}{2} P(i-1,n-1) - P(i,n-1) + \dfrac{1}{2} P(i+1,n-1)$$.

Dividing by $$\Delta t$$, the interval of time between two discrete time interval, and defining $$D = \frac{\Delta x^2}{2 \Delta t}$$, we get

$$\dfrac{P(i,n) - P(i,n-1)}{\Delta t} = D \dfrac{P(i-1,n-1) - 2 P(i,n-1) + P(i+1,n-1)}{\Delta x^2}$$,

i.e. the discrete version of the diffusion equation using time-explicit Euler scheme for the first order time derivative and centered scheme for the second order space derivative.

From probability transition to PDEs: general equation

If you add "extra terms" in the probability transition relation:

$$P(n,i) = \displaystyle \sum_m \sum_j p_{n,i;m,j} P(i-j,n-m)$$,

where the sum of $$p_{n,i;m,j}$$ is equal to $$1$$, you get different form of the discret(ized) equation, in the form of difference equation. It this equation, you can recognize the discrete version of differential operations and get a differential equation.

• summation over the time index must start $m=0$ for causality (present cannot depend on future), while the space index can go over all the position of the domain in space, ideally Aug 29, 2022 at 8:43
• Hi, thanks for your answer and the neat derivation! But I know how to arrive at the continuum limit for the simplest case that I mentioned (i.e. the diffusion equation). My question is pertaining how will the continuum limit PDE change in the case when I relax these assumptions. WIll I get higher order derivatives? If I do, will it correspond to a valid equation for a probability distribution? Aug 29, 2022 at 11:52
• You usually ends up with other derivatives, as an example higher order time derivatives, or space derivatives of order different from 2, i.e. order=1 for transport, order=3 for dispersion. Which kind of process are you interested in? Non-uniform diffusion? Combination of transport and diffusion? Once you'll tell us, I'll try to give you a more detailed answer Aug 29, 2022 at 13:13
• As a general suggestion, 1. I'd write the continuum PDE you desire (because I managed to have a better understanding of what's happening looking ad a PDE than looking at a probability transition); 2. I'd write the discret(ized) version of the operators, using a time-explicit time scheme (e.g. Explicit Euler); 3. I'd separate the only contribution at time $n$, i.e. $P(i,n)$ and get the expression as a function of the probabilities at time step $n-1$; 4. I'd do the scaling of the coefficients of the terms at $n-1$ to get a sum = 1 (this way you get the definition of the coeffs of the PDE) Aug 29, 2022 at 13:48
• I am looking particularly for an elementary model PDE which can also incorporate non-Gaussian diffusion process. For example, have a look at this question Aug 29, 2022 at 14:56