I think in some media, light can be significantly slowed down but even if only slightly. Where would the momentum go when the light slows down and where it gets extra momentum when it leaves that medium? An example is a water.