Actually the "last scattering surface" of the CMB corresponds to the transition of the interstellar/intergalactic medium from an ionized plasma to cooler neutral atoms, about 300 000 years after the big bang. Most atoms have excitation and ionization energies in the visible, so the CMB was probably visible when it formed.
We can be a little more precise about this. The
brightest photons in a blackbody spectrum have energy $E=xkT$, where $x\approx3$ if you mean "brightest per unit energy," and $x\approx5$ if you mean "brightest per unit wavelength." For example, the sun's surface temperature is 0.5 eV, and so it's brightest around 2 eV.
The primordial blackbody gas of photons would have been tightly coupled to the hydrogen in the universe until photons above 13.6 eV became rare; this would have happened as the energy of the most common photons fell somewhere around 4–8 eV, which is pretty far into the ultraviolet. However, the temperature of a blackbody with this spectrum (kT ≈ 1.5 eV) is comparable to the surface of the star Bellatrix. It's worth noting that at this temperature there's still a small but non-negligible fraction of hydrogen ions and hydrogen in excited states.
There's a very good reason why the temperature of the CMB at last scattering should be comparable to the temperature of a stellar surface: it's the same physics! A star's photosphere is the last scattering surface for a gas of photons coupled to a mixture of hydrogen and helium which (mostly) gets hotter and denser as you deeper into the star; beneath the photosphere the temperatures of the photon gas the matter plasma are coupled, while beyond the photosphere the photons are free.
A commenter points out that I never actually answered the question at hand: when would the CMB have been visible? I answered that it started off visible, but how long that would have lasted is also interesting.
From another Physics.SE question we have the (approximate) relation
$$
T(z) = T_0 (1 + z) \approx T_0\left(\frac{t}{t_\text{now}}\right)^{-2/3}
$$
between the current CMB temperature $T_0$, the CMB temperature $T(z)$ seen by an observer at redshift $z$, and the age of the universe $t$ as computed by that observer, compared to its current age $t_\text{now} = 13.6\rm\,Gyr$. If we take "visibly glowing" to mean "at the Draper temperature," that was at time
$$
t = \left(\frac{T_0}{T_\text{glow}}\right)^{3/2} t_\text{now}
%= \left(\frac{2.7\rm\,K}{800\rm\,K}\right)^{3/2} t_\text{now}
%= 2.0\times10^{-4} t_\text{now}
= 2.7\rm\,Myr.
$$
This was before stars, and therefore before metals and planets.
The intensity would have been the same as any other barely-visible glowing blackbody, such as a warm electric cooktop.