Lets say that hypothetically we have a rocket with constant mass, and an engine providing a constant force. I understand that it is unrealistic to have a rocket of constant mass with a rocket engine that ejects mass to accelerate, however this simplifies the problem.
As the rocket accelerates the force from the engine will be travelling at a larger speed, therefore increasing the power of the rocket engine, since $W=Fm$, and this makes sense due to the constant acceleration that would occur with a constant force, since $E=\frac{1}{2}mv^2$.
The rate of fuel flow into the engine will remain constant, so the chemical energy that is going into the engine will remain constant. This seems to contradict the increasing power from the force of the engine.