The book where the derivation is described sufficiently pedagogically is Ballentine's Quantum mechanics - A Modern development, chapter 3. I am going to give a sketch of the 30-page chapter. (Beware, I suppress vector notation)
Transformations of the quantum state are expressible as unitary transformations. The first order expansion of a unitary transformation around identity necessarily gives us $1- i \epsilon \hat K$ where $\hat K$ is a hermitean operator. Just by considering the Galilean transforms of usual 3D coordinates (i.e. non-quantum transformations), we are able to derive the commutation relations of these infinitesimal generators which should apply also in the case of transformations of quantum states.
We then have ten infinitesimal generators of the Galilean group and their commutation relations. Say we call $\hat H$ the infinitesimal generator of time translation and we postulate the position operator $\hat Q$ and velocity operator $\hat V$ and just by requiring
$$\frac{\rm d}{{\rm d}t}\langle\hat{Q}\rangle = \langle\hat V\rangle$$
we obtain $$\hat{V} = i [\hat H, \hat Q]$$
and by similar requirements we can recover a large set of commutation relations between the position and velocity operators and the infinitesimal generators. Say we call $G$ the operator which gives the particle an infinitesimal "boost" in the velocity space. We can derive that $$[\hat G, \hat Q]=0$$
In return, by physical considerations of degrees of freedom we can identify $\hat Q=\hat G$. Similarly, under the assumptions of no internal degrees of freedom the operator $\hat Q \times \hat P$ van be identified with the generator of rotations $\hat J$ because of the same commutation relations with the rests. Assuming internal degrees of freedom gives us the commutation relations a spin operator (i.e. $\hat S = \hat J - \hat Q \times \hat P$) should fulfill.
But beware, there are caveats. When the physical situation does not posses translation symmetry (i.e. there is a potential field in which a particle is moving), the general relation between $\hat{V}$ and $\hat{P}$ is not what you would expect
$$\hat P = M \hat V + A(\hat Q)$$
where $A(\hat Q)$ corresponds up to factor to the vector potential of the magnetic field. So $\hat Q \times \hat P$ is not the angular momentum in the classical sense but rather in the sense of the phase space of Hamiltonian mechanics.
This clearly underlines the fact that the infinitesimal generator of rotations cannot be defined as total angular momentum. Rather, an analysis such as the one made by Ballentine should be done to fully understand the meaning of the operators.