Your intuition for the direction of the electric and magnetic fields around a circuit should always come from the position and movement of charges.
If you look at a battery by itself, there are electric field lines that travel from its anode to its cathode. Charge carriers want to follow these field lines, but can't because the resistance of air is too high. (That is, because electrons can't easily rearrange themselves among the atoms in air, in order to move a (negative) charge from the cathode to the anode, you would have to dissociate an electron from an atom somewhere, forming an positive ion and electron. However, that highly positive ion will now strongly attract the electron back, so self-ionization like this only happens with very strong applied electric field.)
When you connect a battery to a conductor that closes the loop in the circuit, charges can now travel easily through the conductor, and follow the electric field lines to do so. However, the act of these charges moving actually changes the field!
What happens is that charges rapidly build up on the surface of the conductor to largely cancel the electric field inside the conductor, but a small field is left because the conductor has finite conductance. Adding resistors to the circuit also causes charges to pile up on both sides of the resistor, causing increased electric field strengths through and thus voltage drop across the resistor. Throughout the circuit, electrons feel whatever residual field is left, and drift to follow it, moving on average from the cathode to the anode, producing a net current.
If you want to look at the electric and magnet fields outside the circuit, there are two things to look at:
- The surface charges on the conductor and lumped elements will source fields. In steady-state, the surface charges don't move, so they only contribute to electrostatic fields.
- The drifting charges within the conductor and surface elements will produce magnetic fields, because they are moving. In steady-state, the current is constant, so these charges contribute to the magnetostatic field.
Outside of steady-state, you still should consider how the drift current and surface charges are changing in order to understand what the field looks like, but the situation can be more complicated.
An in-depth explanation of this comes from the J. D. Jackson in his 1996 paper "Surface charges on circuit wires and resistors play three roles," but I can share perhaps more introductory resources in the comments if need be.