If a can of compressed air is pierced on the right, air pushes out, and the can moves to the left.
If a vacuum container is pierced on the right, which way does it move? Right? Left? Not at all? Oscillate about its original position?
Why does a pierced compressed air can move? One answer is: when it is not pierced at 'the target point', there is a pressure acting on the target point (I should say area, but nevermind) on the right from the inside, as well as on its mirror point on the left, and so for every pair of points, so that the total force is zero. When you pierce the can, there still is some pressure acting on the mirror point, but there is no pressure acting on the target point, so that the total force acting on the can is not zero, and is directed to the left. (One can check that the force is the same as if you use conservation of momentum for the whole can+air system). What is pressure? Pressure is transition of momentum from air to the walls. When you pierce the target point, the momentum goes not to the can, but to the environment, and gets absorbed somewhere there.
What changes when you pierce a vacuum can? Now the pressure acts from the outside, and now, when you pierce the can, the force on the mirror point is again not compensated and is directed to the right. So one may conclude that the can should move. But one thing is different: the momentum that was to be transfered to the target point from the outside (but was not, because there is now no surface at the target point) is not absorbed "somewhere", it goes inside the can, and is finally absorbed by it exactly canceling the momentum received by the mirror point.
So, in this case there is a rather subtle cancelation. However, I believe that there are some further subtleties, which may cause a small difference in these momenta, and if you try to measure the force really hard, then you will see it.