The meta-question is: on what is the work being done? When there was a barrier, particles were colliding with the barrier, they were bouncing off and changing their momentum, which implied that there was a force by the particles on the barrier (known as "pressure") and by the barrier on the particles (that led to the momentum kick).
When the barrier is removed, the particles have nothing on which to push, so they have nothing on which to do work. And there is nothing pushing back on the particles, so there is no work being done on the gas.
It is true, as pointed out in the comments, that $W=\int P(V) dV$ only holds for quasistatic processes, in which the pressure of the gas is approximately constant throughout the gas. This is not what is breaking down in this situation; the gas is not moving so quickly that it can't come to equilibrium throughout itself.** What is breaking down is that this type of work comes from force times displacement, so if there is no force then there is no work (here: there is no pressure). It's like saying "how much energy would it take for a ball moving in space to keep moving in that direction" and the answer is zero, if nothing is stopping it.
** There may be a bit of debate of this point on Wikipedia. As the gas expands into the empty chamber, is the density on the left the same as on the right? You might actually get a gradient of densities initially, as some particles start moving into the empty space, so they say that there might not be full equilibrium throughout the gas. But again, pressure exists as a concept only if there is something on which the forces act, so if you let the particles bounce around for a little bit they'll come to equilibrium throughout the bigger volume without having had to push to get there.