'Force' is the rate of change of linear momentum. When a rigid body rotates about its centre of mass, the linear momentum of one side of the body cancels the linear momentum of the other side moving in the opposite direction, so there is always a net zero momentum associated with the rotation. None of the linear momentum a force provides contributes anything to rotation.
Separately, a force has an associated 'torque', which is the rate of angular momentum about a point. The force through the centre of mass applies zero torque about the centre, and the off-centre force applies non-zero torque, so it's no surprise that one contributes angular momentum and the other doesn't.
Your intuition may be thinking about the force contributing to the energy of the body. There is linear kinetic energy associated with the motion of the centre of mass, and rotational kinetic energy associated with rotation about the centre of mass. The contribution of a force to energy is the force times the distance through which the force is applied. (It's called the 'work'.) When a force is applied through the centre of mass for a set time, the body moves only a small distance, as the entire body has to be accelerated. If the force is applied off-centre for the same time, the point of contact can be moved much further, because the acceleration is non-uniform. (To take an extreme case, imagine a dumbell with all the mass concentrated at the ends. Push on one end, and only half the mass gets accelerated, rotating about the other end which barely moves.)
Because the force is applied through a longer distance when off-centre, more energy is transferred by the force, and gets divided between linear and rotational kinetic energies.