Experience suggests infinities aren't real. Misuse of The Partition Theorem implied runaway energies at certain frequencies due to heating, The Ultraviolet Catastrophe. By some primitive analyses, the night sky should be super bright. It isn't because the universe is expanding and its age is finite. Infinities disappear in QFT, giving us the most accurate theory we have. The infinities at the event horizon of a black hole vanish with a change of coordinates.
As to arguments that infinity exists with some physical manifestation, the center of a black hole has infinite density, but there's reason to believe that is suspicious apart from suspicion of infinities. General relativity is silent on the uncertainty principle which is a bad sign. Apparently some physicists believe the singularity truly has infinite density.
Due to a theorem from Paul Dirac, if there is a magnetic monopole anywhere in the universe, it is expected that electric charge would be quantized. If it doesn't matter where that monopole is, does it suggest it's effects propagate at infinite speed?