I am revisiting this topic since I've neglected it the first few times I studied it.
A state of a particle can be represented as:
$$|\psi\rangle = \int dx \psi(x)|x\rangle$$
and naturally, its hermitian conjugate is: $$\langle \psi | = \int dx'\langle x'|\psi^*(x')$$
So shouldn't their inner product be:
$$\langle\psi|\psi\rangle = \iint dxdx' \langle x'|x \rangle \psi^*(x')\psi(x)~?$$