This question is closely related to the so-called Feynman sprinkler problem, but with the complication that, in vacuum, the experiment is impossible.
In the sprinkler problem, some number of L-shaped pipes are connected to a hose at a joint which is allowed to swivel. If water runs out the hose and out the pipes, the momentum of the escaping jets causes the assembly to spin. This type of water-powered motor is commonly used to irrigate lawns and amuse children. The question associate with Feynman (but going back at least to Mach) is what happens if you put the sprinkler head underwater and run it backwards. Does time reversal symmetry make it run the other way? Or does the impact of the incoming water against the corners of the L-shaped pipes mean the sprinkler turns the same way regardless of the direction of water flow?
The experimental result of the reversed-sprinkler problem seems to be that the effects cancel out. Apparently the head undergoes a “tremor” when the flow begins, but does not experience steady-state rotation in either direction.
There’s a long tradition in physics of impractical thought experiments. But your thought experiment here is impossible. A low-pressure chamber containing a high-pressure balloon has less entropy than a medium-pressure chamber containing an empty balloon, so the balloon-emptying transition happens spontaneously. The balloon-filling transition does not happen spontaneously, and any question you have about its momentum exchange is going to be sensitive the mechanism you’ve used to deal with the second-law violation.
If you start with a movie of a balloon emptying and just run it backwards, time-reversibility demands that momentum is still conserved, which you can verify by examining every gas-molecule collision. But in your reversed movie, you can still confirm the pressure inside the balloon is higher than the pressure outside the balloon. Pressure-driven flows are fundamentally entropy-driven flows. When a real balloon is filled, it’s because the pressure on the inside is lower than the pressure on the outside.
If you are a human person, you have almost certainly filled and emptied a balloon several times while reading this: your lung system, using the muscles in your torso. (“That’s not a high-pressure balloon!” you protest. But if you can fill a balloon, it’s because you temporarily made the pressure in your lungs higher than the pressure in the balloon. Puff out your cheeks: ta-da, your internal high pressure has overwhelmed the strength of your facial musculature.) You can certainly propel yourself by blowing out, even though that propulsion is much less dramatic than a low-mass rubber balloon without a high-mass human body attached to it. Do you also propel yourself in the opposite direction by breathing in?
In the realm of Youtube physics debates, the question of whether air intake has any associated thrust, and how that intake thrust compares to the more obvious thrust from an exhaust jet, takes the form of debates about
whether you can power a skateboard with a leaf blower (almost certainly),
whether you can reverse the thrust direction by pointing the leaf blower at an umbrella (probably not as pictured, but)
whether the leaf-blower-plus-umbrella is conceptually different from the thrust reversers on jet aircraft.