I have a question on the canonical quantisation as described at the linked wiki page: https://en.wikipedia.org/wiki/Quantum_field_theory#Canonical_quantisation
we take the displacement of a classical harmonic oscillator described as $$ x(t)={\frac {1}{\sqrt {2\omega }}}ae^{-i\omega t}+{\frac {1}{\sqrt {2\omega }}}a^{*}e^{i\omega t}, $$
and promote $x(t)$ to a linear operator ${\displaystyle {\hat {x}}(t)}$:
$${\displaystyle {\hat {x}}(t)={\frac {1}{\sqrt {2\omega }}}{\hat {a}}e^{-i\omega t}+{\frac {1}{\sqrt {2\omega }}}{\hat {a}}^{\dagger }e^{i\omega t}.}$$
the coefficients $a$ and it's complex conjugate $a^*$ are replaced ${\hat a}$ and ${\hat a}^{\dagger }$.
Question: why following this instruction ${\hat a}$ becomes creation operator and ${\hat a}^{\dagger }$ annihilation opererator and not conversely? is there any physical reason that justifies it based on the plus or minus sign of $e^{-i\omega t}$ resp. $e^{i\omega t}$? or is it just a "random choice"?