Extending the other answers to see how "noise averages" are used elsewhere in the book as well, we can think of "noise average" of a dynamical variable ${\bf A}({\bf x},t)$ as
$ \langle {\bf A}({\bf x},t) \rangle_{noise} = \int_\Omega {\bf A}({\bf x},t) \rho({\pmb \epsilon}) d{\pmb \epsilon}$
where ${\pmb \epsilon}$ is a random noise distributed as $\rho({\pmb \epsilon})$ over $\Omega \in \mathbb{C}^n$. From the SDE,
$m \dot{{\pmb v}} = -\xi {\pmb v}(t) + {\pmb \epsilon}(t)$, we get,
$\langle m \dot{{\pmb v}} \rangle_{noise} = -\langle \xi {\pmb v}(t)\rangle_{noise} + \langle {\pmb \epsilon}(t) \rangle_{noise}$.
If $\langle {\pmb \epsilon}(t) \rangle_{noise} = 0$, we obtain the expression
$ \langle {\pmb v(t) }\rangle_{noise} = {\pmb v}(0) \exp{(-\xi t/m )}$.
Now in the actuality experiment you'd probably also have a probability distribution over the initial velocity of the particle, so to truly fit your data with a theory, you'd next need to take that into account as well
To get this complete picture, the "noise-averaged" distribution of velocities (or the state ${\bf x}$, which satisfies the Langevin equation, ${\bf \dot{x}} = {\pmb a}({\pmb x}) + {\pmb \epsilon}(t)$) is derived in Chapter 2 of the book. The distribution of states, $f({\pmb x},t)$ satisfies,
$\begin{align*}
\dot{f}({\pmb x},t) &= -\frac{\partial}{\partial {\pmb x}} \cdot {\pmb a}({\pmb x}) f({\pmb x},t) -
\frac{\partial}{\partial {\pmb x}} \cdot {\pmb \epsilon}({t}) f({\pmb x},0)
+ \\
&\frac{\partial}{\partial {\pmb x}} \cdot {\pmb \epsilon}({t})
\int_0^t ds \exp{\Bigg(-(t-s)\frac{\partial}{\partial {\pmb x}} \cdot {\pmb a}({\pmb x})\Bigg)}
\frac{\partial}{\partial {\pmb x}} \cdot {\pmb \epsilon}({s}) f({\pmb x},s)
\end{align*}
$
We can use the definiton above to take the "noise average" of this equation. We get,
$\begin{align*}
\frac{\partial}{\partial t}\langle {f}({\pmb x},t) \rangle_{noise}
&= -\frac{\partial}{\partial {\pmb x}} \cdot {\pmb a}({\pmb x})
\langle f({\pmb x},t) \rangle_{noise} -
\frac{\partial}{\partial {\pmb x}} \cdot \underbrace{\langle {\pmb \epsilon}({t}) \rangle_{noise} }_{= 0} f({\pmb x},0)
+ \\
&\frac{\partial}{\partial {\pmb x}} \cdot
\int_0^t ds \exp{\Bigg(-(t-s)\frac{\partial}{\partial {\pmb x}} \cdot {\pmb a}({\pmb x})\Bigg)}
\frac{\partial}{\partial {\pmb x}} \cdot \langle {{\pmb \epsilon}({t})\pmb \epsilon}({s}) f({\pmb x},s) \rangle_{noise}
\end{align*}
$
To get the noise average of the last term of the above equation, the property of delta-correlation of the noise is used,
$\langle {\pmb \epsilon}(t) {\pmb \epsilon}(t') \rangle_{noise} =
{\pmb \Gamma }{\delta}(t-t')$. In particular,
$\begin{align}
\langle {{\pmb \epsilon}({t}) \pmb \epsilon}({s}) f({\pmb x},s) \rangle_{noise}
= {\pmb \Gamma} \delta(t-s) \langle f({\pmb x},s) \rangle_{noise}
\end{align}$
The above equation comes from an identity of Gaussian random variables :
$\begin{align}
\langle {\pmb \epsilon}(t_1) G({\pmb \epsilon}(t_2)) \rangle_{noise}
= {\pmb \Gamma} \delta(t_1-t_2) \langle
\frac{\partial}{\partial {\pmb \epsilon}(t_2)} G \rangle_{noise}
\end{align}$ and when we recognize the fact that $f({\pmb x},s)$ depends on $ {\pmb \epsilon}({s'})$ only for $s' < s$. From here, we directly arrive at the Fokker Planck Equation as given in 2.42 of the book.