The universe has to obey General Relativity, and that means its expansion rate can't just change randomly. The expansion rate is related to the energy density of the universe.
The expansion rate doesn't have to change smoothly if there is some mechanism to change the energy density. For example we think the expansion rate temporarily increased massively during a period called the inflationary epoch, though exactly why the energy density changed during this period is uncertain. However if we wind time backwards then barring (currently unknown) effects from quantum gravity we expect the universe to shrink to zero size in a finite time - this moment of time being the Big Bang. There isn't any known mechanism that could cause the universe to remain stable at a constant size then suddenly start expanding.