Here the indication of the particle's spin $s=\frac{3}{2}$ indicates the dimension of the Hilbert space corresponding to its internal states, equal to $2s+1=4$. The energies being given imply that there is no degeneracy and that the energies are $m \epsilon$ for $m=-\frac{3}{2},-\frac{1}{2},\frac{1}{2},\frac{3}{2}$. If you're told that there is in fact a degeneracy then you need to put it in by hand, but the degeneracy scheme you mention in the comments (1, 3, 3, 1) sounds more like three spin-1/2 particles being put together than one spin-3/2 particle.
To get the partition function, then you sum the factors $e^{-\beta E}$, with the correct energies:
$$
\zeta=\sum_{m=-3/2}^{3/2}g_m e^{-\beta \epsilon\cdot m},
$$
where the degeneracies $g_m$ should all be 1 unless you're specifically told otherwise. (Note, in the $g_m\equiv1$ case, that the sum is a geometric sum and can be done explicitly.)
Since the $N$ particles are independent (unless you're told they're not) then you need to combine them appropriately to get
$$Z=\frac{\zeta^N}{N!}.$$