The definition of temperature in the kinetic theory of gases emerges from the notion of pressure. Fundamentally, the temperature of a gas comes from the amount, and the strength of the collisions between molecules or atoms of a gas.
The first step considers an (elastic) impact between two particles, and writes $\Delta p = p_{i,x} - p_{f,x} = p_{i,x} - ( - p_{i,x}) = 2\,m\,v_x $ where the direction $x$ denotes the direction of the collision. This, of course, is considering that the two particles have opposing velocities before impact, which is equivalent to viewing the impact in the simplest frame possible.
This calculation is independent of frame translation, as it will add the same velocity component to both velocities, and the previous equation relies only on the difference in velocities.
The second step uses the ideal gas law to get to $T \propto \frac{1}{2}mv^2$.
For more detail you can check this Wikipedia article.
So the invariance with frame translation of the temperature is due to the invariance of pressure, which only considers relative velocities.