To summarise: it depends on the ratio of refractive indices, the angle of incidence and the polarisation state of the incident wave.
Details: The polarisation of the electric field will be perpendicular to the wavevector. Why? Because where there are no free charges then $\nabla \cdot \vec{E} = 0$. If we represent the wave as $\vec{E} = \vec{E_0} f(\omega t - \vec{k}\cdot \vec{r})$, where $f$ can be any function (including a sinusoid), then
$$ \nabla \cdot \vec{E} = \vec{k}\cdot \vec{E_0} f^{\prime}( \omega t - \vec{k}\cdot \vec{r})$$
For this to be true for all $\vec{r}, t$, then $\vec{k}\cdot \vec{E_0}=0$.
This does not uniquely define the E-field vector.
If the plane of incidence is the $x,y$ plane, then in general the wavevector of the evanescent wave is given by
$$ \vec{k}_e = i\alpha \hat{y} + \beta \hat{x}.$$
In order to ensure continuity of the E-field parallel to the interface plane (a consequence of Faraday's law) then the polarisation plane of the evanescent wave must be the same as that of the wave incident at the interface. For the simpler case of s-polarisation (incident E-field perpendicular to the plane of incidence and parallel to the plane of the interface), then the evanescent wave is also polarised perpendicular to the plane of incidence. In the example here, this means if the incident E-field is polarised in the z-direction, then so is the evanescent wave.
$$\vec{E} = E_0 \exp i (\omega t - i\alpha y - \beta x)\ \hat{z} = E_0 \exp(\alpha y) \exp i(\omega t -\beta x)\ \hat{z},$$
which is just a plane wave propagating in the positive x direction, parallel to the interface, with an exponentially decaying amplitude in the y direction (where the form of the wavevector in the wikipedia article implies that if $\alpha$ is real and positive, $y$ becomes more negative as you move away from the interface).
However, there is another possibility. The incident light could be polarised in the plane of incidence (p-polarisation). In which case the E-field of the reflected and evanescent waves will also be in the plane of incidence, but will have components $E_x$ and $E_y$, such that $\vec{k} \cdot \vec{E} =0$. The relative magnitudes of $E_x$ and $E_y$ will depend on the ratio of the refractive indices and the angle of incidence. This is calculated by noting that as the waves on either side of the boundary (where $y=0$) are of the form $f(\omega t - k_{ix} x)$ and $f(\omega t - k_{ex} x)$, where $k_{ix}$ and $k_{ex}$ are the x-components of the wavevectors either side of the interface, then $k_{ix}=k_{ex} = 2\pi \sin \phi /\lambda$, where $\phi$ is the incidence angle, to ensure a constant phase relationship along the interface. It can then be shown that
$$\frac{E_x}{E_y} = i \frac{k_y}{k_x} = i \frac{(N^2 \sin^2 \phi -1)^{1/2}}{N\sin \phi},$$
where $N$ is the high/low ratio of the refractive indices (see Azzam 2011). Because $\vec{k}$ is complex this means that there is a 90 degree phase difference between $E_x$ and $E_y$ which means that the electric field is elliptically polarised in general and that the wave propagating in the x-direction is no longer purely transverse, but has a longitudinal component.
This animation may make things clearer.
For an arbitrary incident polarisation you have to represent it as the sum of a s-polarised and a p-polarised component, then use the Fresnel equations to work out what the transmission coefficients are and calculate the three components of the evanescent wave (note that a form of these are given in the link above, but that these are the intensities rather than the amplitudes).