QED is an approximate description of reality. Even if it did give finite predictions in the continuum limit, those predictions would've been incorrect anyway! Newtonian gravity does give finite predictions for high gravity scenarios, but the numbers are incorrect.
QED can be defined in a mathematically rigorously (non-perturbative) way in the discrete spacetime approximation! Then why do we need to make the continuum QED mathematically rigorous, even when its predictions in the tiny length scales will be incorrect anyway?
I also read that a non-perturbative formulation of Yang Mills is a Millenium problem. But Yang Mills is already non-perturbative in discrete spacetime, i.e. in the length scales it works in the first place. In the tinier length scales, it will be incorrect anyway (Gravity effects will kick in).
So it shouldn't be a problem that QFTs at tiny length scales aren't rigorous / contain infinite quantities. Non-perturbative definitions of the theories exist in the discrete spacetime approximation, i.e. in the domain the theories hold in the first place.