The interference pattern disappears if you mess with the electron any time after the slits. You can think of it this way ...
- the electron has chosen a path in advance (before it has even left the emitter), the excited electron in the emitter is already generating changes/fluctations in the EM field (called virtual forces or virtual photons, virtual particles cause force but not energy transmission).
- there are similarly electrical virtual forces being generated in the screen also in the EM field, there are many possible landing targets for the electron ...
- the electron has wave properties, these properties allow propagation along certain probable paths ( especially when there are slits or other obstacles present), the final chosen path appearing random to us.
- the probable paths are generated based on the geometry or setup of the experiment i.e. big slits, small slits, wide slits, screen distance etc.
The electron will travel to the target and generate the "interference" pattern if it it is not disturbed when there are slit(s) .... a typical wave DSE function.
Any electron or any photon can have its path disturbed along the way ... this will cause it to "recalculate" a new path or wave function. For example a photon from a star can hit a mirror on earth and be sent back into space.
The concept of a wave function can be used in different ways: 1) a wave function could be developed to describe all the possible paths and is a probability graph, this is the typical DSE pattern, it shows the average of many impacts; 2) a wave function could be developed for a single photon based on a single known or theorized path.
There is an experiment where the scientist claimed that when light was shone on the slits and the camera was unplugged the interference pattern appeared and when the camera was recording the pattern disappeared .... kind of amazing!
So its not just the interaction with photons but the interaction with the electron with the photon and with the sensor in the camera (not sure of this experiment was ever verified or if it was just a statement based on extrapolation of other experiments.) But in any case if it is true it may just mean that for the electron to "recalculate" its path requires that the the photon must be absorbed at a known position (i.e the photon path or wave function collapses or becomes known).
Also you say in your question the electrons momentum is not known after the slits, that is not true if we consider the electrons one at a time ... the electron has chosen one of the probable paths based on probability and QM .... and it will help show the eventual DSE pattern that emerges.
The energy of a photon is never zero .... the photon energy would affect the probability of interacting with the electron .... a bunch of gamma rays ( high energy ) may never interact ... there would be an interference pattern. At the other end of the spectrum ... say radio waves ... may also have low probability. It may be that 1um light gives the highest probability and thus the pattern is reduced.
The intensity (number of photons) is also important, weak light would have fewer interactions (pattern visible) but strong intensity would reduce the pattern.