You are correct, reflection at the QM level is not absorption and re-emission. Absorption and re-emission would change the energy level of the photons, their relative phase, relative angle (thus creating a diffuse reflection).
Mirror reflection is elastic scattering. That is the only way to keep the energy level, relative phase, relative angle of the photons, thus creating a mirror image (thus creating specular reflection).
Specular reflection, also known as regular reflection, is the mirror-like reflection of waves, such as light, from a surface. In this process, each incident ray is reflected at the same angle to the surface normal as the incident ray, but on the opposing side of the surface normal in the plane formed by incident and reflected rays. The result is that an image reflected by the surface is reproduced in mirror-like (specular) fashion.
You are correct, during elastic scattering (reflection), the photon keeps its energy and phase, and changes angle (direction of momentum vector).
For reflection there should be elastic scattering in the center of mass so that the phases of the photons are kept and the image emerges intact on reflection. So it should be a QED feynman diagram of a photon scattering elastically off a field.
The kinematics are similar to a ball bouncing off a wall, i.e. elastically scattering. The assumption is that the mass of the wall is practically infinite and the center of mass with respect to the ball+wall, where the elastic scattering happens is at the same (x,y,z) as the center of mass of the wall itself.