Why isn't spin-statistics taken into account in quantum computing
... like $|0 1\rangle$...
The state
$$
|01\rangle = |0\rangle\otimes|1\rangle\;,
$$
is a direct product state and is neither totally symmetric nor totally anti-symmetric.
- For some reason qubits are considered distinguishable.
Yes. The two-qubit state to which you are referring is a direct product state and the individual spin states are considered distinguishable. This is why you can call one of them the "first" and write it to the right in the direct product notation, and you can call one of them the "second" and write it to the left in the direct product notation. (Or vice versa depending on your notational preference for big-endian or little-endian bit strings.)
In practice, if the two particles are identical (e.g., electrons), the distinguishability must arise from some physical feature of the quantum computing apparatus, like a physical separation in space of the two qubits that are considered distinguishable.
Those practical details are swept under the rug when we, for example, only consider the qubit to have spin degrees of freedom, since clearly any physical realization will have other degrees of freedom. E.g., we can discuss a silver atom as having two different $S_z$ spin eigenstates that are split by a magnetic field in a Stern-Gerlach apparatus. But clearly a silver atom can also move around in the usual three spatial dimensions too.
One difficulty of implementing a multi-qubit quantum computer is having to deal with these practical details.