The Pauli and Clifford groups only contain finitely many elements, so almost any unitary is not going to be in them.
Just ask matlab to make you a random unitary. For example, almost any one qubit phase gate is not in these groups.
I'm not aware of a matlab function that checks for membership in these groups. However, you could write a simple code for the small gate sizes you mentioned. Since elements $U$ of the Clifford group satisfy $U (Pauli) U^\dagger = (Pauli)'$ you could run through all Pauli operators and make sure they are mapped to each other e.g. by computing the overlap of operators using something like the matrix inner product $(M,N) = tr(M^\dagger N)$ since one has $(\sigma^a, \sigma^b) = tr(\sigma^a \sigma^b) = 2 \delta^{ab}$.
There is probably a better way, but this silly algorithm should work if you only care about 2x2 and 4x4 gates.