Spontaneous in this context really just means that the symmetric state is known to be unstable with respect to perturbations. Technically, if you could maintain a perfectly symmetric state, the system under investigation would not be able to collapse, because its lower energy states are asymmetric. But in practice all that this means is that the decision of what state to collapse to comes from some sort of noise, maybe quantum noise: some usually-ignorable inhomogeneity that we cannot ignore here. It is that the world is messy and our perfectly symmetric model at some level fails to be a perfect description of the world, which allows the symmetry to be broken to transition to the ground state: more accurately one might say that the symmetry was approximate in the first place because these "noise" sources, whatever they are, did not respect it.
The classic example is classical, it is a configuration at a potential energy maximum point, like a pencil balanced on its point, or a satellite at the right place between the Earth and the Sun where gravity balances out.
The gradient at this maximum is 0, so there is no force. But it doesn't stay there, because any perturbation from that maximum takes you to a point slightly lower in energy: not lower to first-order, but lower to second-order or higher even order. But the key thing, is that continuity says that those points themselves, then have nonzero forces pointing away from the maximum. If the world were ideal, the symmetric state were perfect, then you would not see any motion from the equilibrium, but the world is not ideal, the symmetry is not respected by everything, and so in practice the pencil falls down, or the satellite needs to do station keeping in order to stay where it is.