You are simply looking at it from an observer's viewpoint. Yes, looking from outside, matter tends to asymptotically approach but never reach the event horizon. If you were part of that matter spiraling into a black hole, there would be no problem reaching the horizon, crossing it, and going right down to the singularity. The event horizon is not a physical barrier. You could be free falling, and your time would not be infinitely dilated. So the answer is yes they can form easily in a finite time.