To make proper sense of this equation, of course it is helpful to put it in some physical context. I will relate some of the explanation to Brownian motion, since it is a very typical example.
I think you are basically asking two questions.
1) How can something with mean 0 have non-zero correlation?
Quite generally, a random noise is considered a generalized force (in Brownian motion: Collisions with the solvent molecules, e.g. water). The averaging you carry out is over all possible values of the force. A mean zero random noise is often a consequence of the assumption of an isotropic noise distribution -- any direction is equally likely, so $\langle \xi(x,t) \rangle = \langle -\xi(x,t) \rangle$ = 0. Obviously, this does not apply to the square of the force, $\langle \xi^2(x,t) \rangle$.
2) Why is "zero correlation in space" sensible?
This is a matter of scales. Every process has its time and length scale. The assumption of $\delta$-correlation is sensible if the length and time scale associated with the fluctuation of your random force are negligible compared to the time and length scales associated with the motion of your particle (or random field, whatever your system is describing). Let's take two length scales, the microscopic length scale $l_{\textrm{mic}}$ and a mesoscopic length scale $l_{\textrm{mac}}$. Now, ignoring time dependence, the random noise correlation in your system may be of the form $\langle\xi(x_1)\xi(x_2)\rangle = C e^{-|x_1 - x_2|/l_{\textrm{mic}}}$. The constant may depend on $l_{\textrm{mic}}$. But for $l_{\textrm{mic}} \ll l_{\textrm{mac}}$, the exponential will drop off very fast on the length scale you are solving your Langevin equation (or what it may be) on. In principle, you will end up with integrals of the form
$$\int_0^l \textrm{d}(|x_1 - x_2|)\langle\xi(x_1)\xi(x_2)\rangle
= C\int_0^l \textrm{d}r e^{-r/l_{\textrm{mic}}}
\ {\color{red}=}\ C\int_0^{{\color{red}\infty}} \textrm{d}r e^{-r/l_{\textrm{mic}}}
= C l_{\textrm{mic}}.$$
The red equality is due to the fact that $l \sim l_{\textrm{mac}}$ will be a macroscopic length scale and we can extend the integral to infinity. Therefore, it is a reasonable approximation to just replace the correlation by a $\delta$-function with a proper coefficient.
Summing that up, if you go back to a particle in a bath, the expression for the noise-noise correlation in your question just means that the random fluctuations are uncorrelated on the length and time scales relevant to the immersed particle.