To demonstrate how an apparent clockwise torque on an wheel going to the right does not necessarily cause an acceleration to the right, consider the following thought experiment.
In the diagram A and C are two masses at the nd of a rod that that is moving to the right with velocity v and no friction (e.g. in space) and it has no angular momentum. Imagine it represents two opposing spokes of a wheel. It collides with a massive object and the lower part c' momentarily comes to a stop. The top part A' momentarily continues at the same velocity because it takes a while for the impulse to travel up the rod. As you can see in the diagram the Centre Of Mass (COM) is forced to reduce to half its initial velocity. This represents a backward acceleration of the COM and a corresponding backward linear acceleration. Since force is mass times acceleration this represents a momentary backward force acting on the COM. This makes sense, because the rod system has gained angular kinetic energy and to conserve energy it must lose linear kinetic energy.
Now lets look at it in a reference frame initially co-moving with the rod where it might perhaps be even clearer what is going on.
In this reference frame the massive object moving to the left (representing a road with friction) does impart a clockwise angular acceleration to the rod system, but it can be clearly seen that also imparts a linear acceleration to the left on the COM, which in turn must slow down the linear velocity as seen on the road frame. The take home message is that the 'friction' does not only cause a angular acceleration.
However, once a wheel has gained the correct angular momentum to match its linear momentum, there is no longer any friction between the wheel and road, (if the there is no deforming rubber or a deformation of the road due to weight, which effectively causes an uphill ramp).
Rolling motion does not require friction. Consider a wheel moving and rotating in space. It continues to do that indefinitely without the need for a road with friction. Friction is only required when braking or speeding up, by changing the angular velocity of the wheel. It is also worth remembering that rolling without slipping means there is no net force at the contact point of the wheel, by definition.