Isn't the electric field guided entirely through the wire?
The wires are (very nearly) perfect conductors, and therefore the electric field within the wires is (very nearly) zero.
why is there an outside, red, electric field?
Because there is no field inside the wires, the wires are (very nearly) equipotential volumes. And you know there is a potential difference between the upper wire and the lower wire, of (let's say) 1.5 V, because one is connected to the anode of the battery and the other is connected to the cathode.
Therefore you know that if you take a point a on the upper wire and a point b on the lower wire and calculate (based on the definition of electrostatic potential difference)
$$V_{ab} = -\int_b^a\mathbf{E}\cdot d\mathbf{\ell}$$
you will get 1.5 V.
That tells you that the electric field in the region between the wires must be non-zero, and must point from the upper wire to the lower wire.
I can understand an electric field around the battery if no current runs. But doesn't this disappear when the current runs?
No. The electric field is there if there is a potential difference between the wires. It doesn't depend on whether current is running or not. (The magnetic fields, of course, do depend on the current)