Inflation is what produces the homogeneous, flat universe that we observe, so if you leave it out, the universe never reaches anything like its present state in any amount of time. If it managed to reach its present size (by whatever metric), it would be far more irregular and probably wouldn't have galaxies, etc.
You could write down a model in which the universe was already homogeneous and flat before inflation, so the universe doesn't "need" inflation to get to its present state. The effect of adding inflation to that model is actually that it takes longer for the universe to reach its present state. The scale factor may increase by a factor of $e^{60}$ or more during inflation, but the scale factor is only meaningful up to an overall rescaling anyway. Physically meaningful quantities like energy density and the Hubble parameter are roughly equal before and after inflation (at least, they change less than during an equivalent period of ordinary expansion), so inflation just "pauses" the expansion for a while. If inflation lasts $10^{-33}\text{ s}$, then it only takes $10^{-33}\text{ s}$ longer to get to the present era, but it does technically take longer.