At the level of particle physics interactions, the concept of force is relevant as momentum transfer, dp/dt. All Feynman diagrams that describe the mathematics of the interactions transfer a dp/dt at the vertices the momentum carried by the intermediary particles. Take the simple Compton scattering:
the force is carried by the virtual electron, from the incoming real particles to the outgoing real particles.
The term "fundamental forces" is in order to clarify that there are three coupling constants with different strengths, qualifying the vertices, electromagnetic, weak, strong, and these are identified as fundamental , because they are fundamental in building up the $SU(3)xSU(2)xU(1)$$SU(3)\times SU(2)\times U(1)$ model of particle physics. Each "fundamental force" with its own gauge bosons, "force", because the couplings define how strong the interaction is.