I think that the concept of electromagnetic waves is a bit unclear. Every function can be written as the superposition of plane waves.
Let us look at any electric field $\mathbf{E}(t,\mathbf{r})$. The complete Fourier transform of $\mathbf{E}$ is equal to
$$
\mathbf{\tilde{E}}(w,\mathbf{k}) = \int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\mathbf{E}(t,\mathbf{r})e^{-i(\mathbf{k}\cdot\mathbf{r} - \omega t)}dtdxdydz
$$
by definition. Meanwhile, the inverse Fourier transform states that
$$
\mathbf{E}(t,\mathbf{r}) = \dfrac{1}{(2\pi)^{4}}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\mathbf{\tilde{E}}(w,\mathbf{k})e^{+i(\mathbf{k}\cdot\mathbf{r} - \omega t)}dwdk_xdk_ydk_z
$$
so you can interpret $\mathbf{E}(t,\mathbf{r})$ as the superposition of (perhaps infinite) plane waves, each with amplitude equal to $\mathbf{\tilde{E}}(w,\mathbf{k})$. You can even prove that, in vacuum, these are transversal waves with perpendicular electric and magnetic fields. Take the divergence-related Maxwell equations (in vacuum)
$$
0=\nabla\cdot\mathbf{E}(t,\mathbf{r}) = \dfrac{1}{(2\pi)^{4}}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}i\mathbf{k}\cdot\mathbf{\tilde{E}}(w,\mathbf{k})e^{+i(\mathbf{k}\cdot\mathbf{r} - \omega t)}dwdk_xdk_ydk_z.
$$
Since the inverse Fourier transform of $\mathbf{k}\cdot\mathbf{\tilde{E}}$ is equal to $0$ then
$$
\mathbf{k}\cdot\mathbf{\tilde{E}} = \int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}0e^{-i(\mathbf{k}\cdot\mathbf{r} - \omega t)}dtdxdydz=0
$$
and the same for the magnetic field, i.e. $\mathbf{k}\cdot\mathbf{\tilde{B}}(\omega,\mathbf{k})=0$ because $\nabla\cdot\mathbf{B}(t,\mathbf{r})=0$ as always.
To see that $\mathbf{E}(\omega,\mathbf{k})$ and $\mathbf{B}(\omega,\mathbf{k})$ are perpendicular, use Faraday's law
$$
\begin{array}{rcl}
\mathbf{0} & = & \nabla\times\mathbf{E}(t,\mathbf{r}) + \dfrac{\partial \mathbf{B}}{\partial t}(t,\mathbf{r}) \\
& & \\
& = & \dfrac{i}{(2\pi)^4}\displaystyle\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\left[\mathbf{k}\times\mathbf{\tilde{E}}(w,\mathbf{k}) - \omega\mathbf{\tilde{B}}(\omega,\mathbf{k})\right]e^{+i(\mathbf{k}\cdot\mathbf{r} - \omega t)}dwdk_xdk_ydk_z
\end{array}
$$
so $\mathbf{\tilde{B}}(\omega,\mathbf{k})$ is perpendicular to both $\mathbf{k}$ and $\mathbf{E}$. Plus, $|\mathbf{\tilde{E}}(\omega,\mathbf{k})| = \tfrac{\omega}{|\mathbf{k}|}|\mathbf{\tilde{B}}(\omega,\mathbf{k})|$, where $\tfrac{\omega}{|\mathbf{k}|}$ is the velocity of wave propagation.
The last of Maxwell's equations allows us to see that these waves travel at the speed of $c$.
$$
\begin{array}{rcl}
\mathbf{0} & = & \nabla\times\mathbf{B}(t,\mathbf{r}) - \dfrac{1}{c^2}\dfrac{\partial \mathbf{E}}{\partial t}(t,\mathbf{r}) \\
& & \\
& = & \dfrac{i}{(2\pi)^4}\displaystyle\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\int_{-\infty}^{\infty}\left[\mathbf{k}\times\mathbf{\tilde{B}}(w,\mathbf{k}) + \dfrac{\omega}{c^2}\mathbf{\tilde{E}}(\omega,\mathbf{k})\right]e^{+i(\mathbf{k}\cdot\mathbf{r} - \omega t)}dwdk_xdk_ydk_z
\end{array}
$$
so $\mathbf{\tilde{B}}(w,\mathbf{k})\times\mathbf{k} = \tfrac{\omega}{c^2}\mathbf{\tilde{E}}(\omega,\mathbf{k})$, $|\mathbf{\tilde{B}}(w,\mathbf{k})| = \tfrac{\omega}{|\mathbf{k}|c^2}|\mathbf{\tilde{E}}(w,\mathbf{k})| = \tfrac{\omega^2}{|\mathbf{k}|^2c^2}|\mathbf{\tilde{B}}(w,\mathbf{k})|$ and $\tfrac{\omega}{|\mathbf{k}|}=c$.
Now, I don't know much about quantum electrodynamics, but like @Bohan Xu said, these waves must correspond to virtual photons when the system is not radiating. Free photons correspond to radiation, which I'm going to talk about in a little bit. Virtual photons exist so that charged matter can interact and exchange energy (i.e. so that the electromagnetic field can act as a force). Free photons exist only to transport energy well into arbitrary distances.
So, when do these "pure" electromagnetic waves (free photons) appear? When does the electromagnetic field carry its energy into the great beyond? The answer lies in the law for energy transport, or rather, the energy conservation law.
As always, to get the energy conservation law we must start from the equation of motion. This is the Lorentz force equation.
Let's assume that there are $N$ types of matter, with different masses $m_i$ and charges $e_i$ per particle. The matter densities $\rho_i(t,\mathbf{r})$ and velocity fields $\mathbf{v}_i(t,\mathbf{r})$ go from $i=1$ to $i=N$. Charge densities are equal to $\rho^e_i(t,\mathbf{r})=e_i\rho_i(t,\mathbf{r})$.
The equations of motion for the matter particles are
$$
m_i\dfrac{d\mathbf{v}_i(t,\mathbf{r})}{dt} = e_i\mathbf{E}(t,\mathbf{r}) + e_i\mathbf{v}_i(t,\mathbf{r})\times\mathbf{B}(t,\mathbf{r})
$$
where $\tfrac{d}{dt}$ refers to the derivative along the trajectory of the particle. We can multiply by $\cdot\mathbf{v}_i(t,\mathbf{r})$ in order to get
$$
m_i\dfrac{d\mathbf{v}_i(t,\mathbf{r})}{dt}\cdot\mathbf{v}_i(t,\mathbf{r}) = \dfrac{d}{dt}\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right] = e_i\mathbf{E}(t,\mathbf{r})\cdot\mathbf{v}_i(t,\mathbf{r}).
$$
This means that the electric field parallel to the velocity is responsible for changing the kinetic energy of each particle.
Now, we want to write this as a local conservation law. Let's look into the left part of the equation for a little bit. The change in the kinetic energy of a particle (after going through a trajectory inside a velocity field for a short time $dt$) comes from a Taylor expansion to first order
$$
\begin{array}{rcl}
d\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right] & = & \dfrac{1}{2}m_iv_i^2(t+dt,\mathbf{r}+\mathbf{v}_i(t,\mathbf{r})dt) - \dfrac{1}{2}m_iv_i^2(t,\mathbf{r}) \\
& & \\
& = & \dfrac{\partial}{\partial t}\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right]dt + \left(\mathbf{v}_i(t,\mathbf{r})\cdot\nabla\right)\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right]dt
\end{array}
$$
so
$$
\dfrac{d}{dt}\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right] = \dfrac{\partial}{\partial t}\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right]+ \left(\mathbf{v}_i(t,\mathbf{r})\cdot\nabla\right)\left[\dfrac{1}{2}m_iv_i^2(t,\mathbf{r})\right] = e_i\mathbf{E}(t,\mathbf{r})\cdot\mathbf{v}_i(t,\mathbf{r}).
$$
We can start relating this to the total energy density by the product with $\rho_i(t,\mathbf{r})$. The left-hand side becomes
$$
\begin{array}{rcl}
\rho_i\dfrac{d}{dt}\left(\dfrac{1}{2}m_iv_i^2\right) & = & \rho_i\dfrac{\partial}{\partial t}\left(\dfrac{1}{2}m_iv_i^2\right)+ \left(\rho_i\mathbf{v}_i\cdot\nabla\right)\left(\dfrac{1}{2}m_iv_i^2\right)\\
& & \\
& = & \dfrac{\partial}{\partial t}\left(\rho_i\dfrac{1}{2}m_iv_i^2\right) - \dfrac{\partial\rho_i}{\partial t}\left(\dfrac{1}{2}m_iv_i^2\right) + \nabla\cdot\left[\rho_i\mathbf{v}_i\left(\dfrac{1}{2}m_iv_i^2\right)\right] - \nabla\cdot\left(\rho_i\mathbf{v}_i\right)\left(\dfrac{1}{2}m_iv_i^2\right) \\
& & \\
& = & \dfrac{\partial}{\partial t}\left(\rho_i\dfrac{1}{2}m_iv_i^2\right) + \nabla\cdot\left[\rho_i\mathbf{v}_i\left(\dfrac{1}{2}m_iv_i^2\right)\right]
\end{array}
$$
where we used the conservation of matter law
$$
\dfrac{\partial\rho_i}{\partial t} +\nabla\cdot\left(\rho_i\mathbf{v}_i\right)=0.
$$
So far, we've arrived to
$$
\dfrac{\partial}{\partial t}\left(\rho_i\dfrac{1}{2}m_iv_i^2\right) + \nabla\cdot\left[\rho_i\mathbf{v}_i\left(\dfrac{1}{2}m_iv_i^2\right)\right] = \mathbf{E}\cdot\left(e_i\rho_i\mathbf{v}_i\right)
$$
which we can sum over $i$ in order to get information about the total energy
$$
\dfrac{\partial u_k}{\partial t} + \nabla\cdot\mathbf{S}_k = \mathbf{E}\cdot\mathbf{j}_e
$$
where
$$
u_k = \sum_{i=1}^N\rho_i\dfrac{1}{2}m_iv_i^2
$$
is the kinetic energy density,
$$
\mathbf{S}_k = \sum_{i=1}^N\rho_i\mathbf{v}_i\dfrac{1}{2}m_iv_i^2
$$
is the kinetic energy flux, and
$$
\mathbf{j}_e = \sum_{i=1}^Ne_i\rho_i\mathbf{v}_i
$$
is the net current density.
We can use Poynting's theorem to re-write the right-hand side as
$$
\mathbf{E}\cdot\mathbf{j}_e = -\dfrac{\partial u_e}{\partial t} - \nabla\cdot\mathbf{S}_e
$$
with
$$
u_e = \dfrac{1}{2}\left(\epsilon_0|\mathbf{E}|^2+\dfrac{1}{\mu_0}|\mathbf{B}|^2\right)
$$
and
$$
\mathbf{S}_e = \dfrac{1}{\mu_0}\mathbf{E}\times\mathbf{B}
$$
so
$$
\dfrac{\partial u_k}{\partial t} + \dfrac{\partial u_e}{\partial t} = -\nabla\cdot\mathbf{S}_k - \nabla\cdot\mathbf{S}_e.
$$
This means that $u_e$ is a sort of energy stored in the fields, and $\mathbf{S}_e$ is a flux of energy carried by the dynamics of the fields.
If we integrate this equation over all of space, and use the divergence theorem we get
$$
\dfrac{d}{dt}Energy = \int_{V_\infty} \left(u_k+u_e\right)dV = -\oint_{S_{\infty}}\left(\mathbf{S}_k+\mathbf{S}_e\right)\cdot\hat{\mathbf{r}}dA.
$$
The term
$$
\oint_{S_{\infty}}\mathbf{S}_e\cdot\hat{\mathbf{r}}dA
$$
is the loss of energy from the system due to it being carried away by the fields. This is the energy of the "free" photons!
So when is it non-zero? When are there such photons being emitted? These answers require the solution of Maxwell equations a long distance away from the charges. They are given by Jefimenko's equations
$$
\begin{array}{rcl}
\mathbf{E}(t,\mathbf{r}) & = & \dfrac{1}{4\pi\epsilon_0}\displaystyle\int\left[\dfrac{\hat{\mathbf{r}}}{|\mathbf{r}|^2}\rho_e\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right) + \dfrac{\hat{\mathbf{r}}}{|\mathbf{r}|}\dfrac{1}{c}\dfrac{\partial \rho_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right) - \dfrac{1}{|\mathbf{r}|}\dfrac{1}{c^2}\dfrac{\partial \mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right)\right]dV'\\
& & \\
\mathbf{B}(t,\mathbf{r}) & = & -\dfrac{\mu_0}{4\pi}\displaystyle\int\left[\dfrac{\hat{\mathbf{r}}}{|\mathbf{r}|^2}\times\mathbf{j}_e\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right) + \dfrac{\hat{\mathbf{r}}}{|\mathbf{r}|}\times\dfrac{1}{c}\dfrac{\partial \mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right) \right]dV'
\end{array}
$$
and since $dA = |\mathbf{r}|^2\sin{\theta}d{\theta}d{\phi}$ the only terms from $\mathbf{S}_e$ which survive the integration are those proportional to $\tfrac{1}{|\mathbf{r}|^2}$ instead of $\tfrac{1}{|\mathbf{r}|^3}$ or $\tfrac{1}{|\mathbf{r}|^4}$. This is why we only take
$$
\begin{array}{rcl}
& - & \dfrac{\mu_0}{(4\pi)^2|\mathbf{r}|^2}\left[\hat{\mathbf{r}}\times\displaystyle\int\dfrac{\partial \rho_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right) dV'\int\hat{\mathbf{r}}\times\dfrac{\partial \mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}''\right)dV'' \right.\\
& & \\
& - & \displaystyle\left. \dfrac{1}{c}\int\dfrac{\partial \mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right)dV'\times\int\hat{\mathbf{r}}\times\dfrac{\partial \mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}''\right)dV''\right]
\end{array}
$$
from $\dfrac{1}{\mu_0}\mathbf{E}\times\mathbf{B}$.
The first term is perpendicular to $\hat{\mathbf{r}}$ so it doesn't contribute to the integral. The second term is a triple vector product that can be re-written as
$$
\dfrac{\mu_0}{(4\pi)^2|\mathbf{r}|^2c}\left\{\hat{\mathbf{r}}\left[\displaystyle\int\dfrac{\partial\mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right)dV'\right]^2 - \int\dfrac{\partial\mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}''\right)dV''\int\hat{\mathbf{r}}\cdot\dfrac{\partial\mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right)dV'\right\}
$$
so
$$
\oint_{S_{\infty}}\mathbf{S}_e\cdot\hat{\mathbf{r}}dA = \dfrac{\mu_0}{8\pi c}\displaystyle\int\left\{\left[\displaystyle\int\dfrac{\partial\mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right)dV'\right]^2 - \left[\int\hat{\mathbf{r}}\cdot\dfrac{\partial\mathbf{j}_e}{\partial t}\left(t-\dfrac{|\mathbf{r}|}{c},\mathbf{r}'\right)dV'\right]^2\right\}\sin{\theta}d\theta.
$$
What can we conclude from this formula?
- To get some radiated electromagnetic energy, we need a current that varies explicitly with time
- We also need a $\tfrac{\partial\mathbf{j}_e}{\partial t}$ which is not purely radial (i.e. no monopole antennas)
- The radiated energy reaches $|\mathbf{r}|$ after a time which is equal to $\tfrac{|\mathbf{r}|}{c}$
How does this apply to the case of a single charge $e$ which moves with constant velocity? Take the velocity to lie on the $x$ axis. The current density in that case is equal to
$$
\mathbf{j}_e(t,\mathbf{r}) = e\mathbf{v}\delta(x-vt)\delta(y)\delta(z) = e\dfrac{\mathbf{v}}{v}\delta(t-\tfrac{x}{v})\delta(y)\delta(z)
$$
so
$$
\dfrac{\partial \mathbf{j}_e}{\partial t}(t,\mathbf{r}) = e\dfrac{\mathbf{v}}{v}\delta'(t-\tfrac{x}{v})\delta(y)\delta(z) = -\delta(t-\tfrac{x}{v})\dfrac{\partial}{\partial t}\left[e\dfrac{\mathbf{v}}{v}\delta(y)\delta(z)\right] = \mathbf{0}
$$
and there is no emitted radiation. I used the appropiate formula for the derivative of the delta function.