Centripetal force is tricky and counter-intuitive. When I first took physics, it tripped me up because I kept trying to fit it into $F_{net} = ma$ in the wrong way. No matter how I tried to look at it, I couldn't come to any conclusion other than that centripetal force is actually directed away from the center.
In the beautiful diagram above, we have a ball on the end of a string being swung around a center point.
Baby Devsman did not understand. Baby Devsman reasoned that if there is a force $T$ supplied by the string, then the ball must be getting closer to the center point except for this mystical magical force $F_c$ which is pulling it away by virtue of it going in a circle. Then, $F_{net} = ma$ as satisfied as the ball stays a constant distance from the center point. Why did scientists say it was directed toward the center? It clearly couldn't be, or else the ball would move closer to the center really fast.
$$0 = T + F_c???$$
This is wrong! Baby Devsman had much difficulty understanding many concepts as a result of wrong thinking. Baby Devsman would later learn that centripetal force is not a thing. Electric force is a thing. Electric charges attract each other and a force pulls them together. Normal force is a thing. The ground pushes back against stuff that sits on it.
Centripetal force, though, is not a thing. Nothing exerts centripetal force. Moving in a circle does not cause a force to be exerted. Centripetal force is a requirement of circular motion. Now I understand that centripetal force does not oppose $T$ in the beautiful diagram, but that the required centripetal force to satisfy the assumed scenario is provided by $T$. The ball does not get closer to the center point, true, but the ball's circular motion requires a particular $F_c$. That is, if an object is going to move in a circle,
$$F_c = F_{net}$$
Which in the case above, means $F_c = T$.
What does this have to do with Earth?
When you stand on the ground, your assertion that the weight of your body is matched by the ground's normal force is only approximately true. In reality, the centripetal force required for your body to move around the Earth is satisfied by the net of your body weight and the ground's support force:
$$F_c = W - N$$
As DavidZ says, the centripetal force is small compared to your weight, as the Earth's rotation and radius result in a small centripetal acceleration compared to its gravitational acceleration, but it is still there. As far as what accelerates you to move alongside the Earth, friction does.
Friction is modeled by:
$$F_f = \mu N$$
Notice that the $N$ is normal force, not $F_{net}$. This same N that (almost) matches your weight.
Interestingly, this means that walking toward the equator is ever so slightly (not nearly noticeably) more difficult than walking away from it, as you're having to accelerate yourself to keep up with the change in the radius of the cross-section of the Earth at your changing latitude.