I couldn't find past answers that quite match what I wanted, so I will try to ask in slightly different manner. In QM, we have total angular momentum operator $\vec{J}$ (I dropped the hat for convenience) \begin{align} \vec{J} = \vec{L} +\vec{S} \end{align} where $\vec{L}$ is for orbital angular momentum and $\vec{S}$ is for spin angular momentum. For hydrogen atom, this (not addition, but rather $\vec{L}^2$ and $L_z$) gives us two of three quantum numbers, thus we often label the state for fixed energy as $\left|l,m\right>$ (for some reason $m$ is used in standard texts instead of, say, $s$). I think I understand how they work in QM, or at least the fact that $\vec{J},\vec{L},\vec{S}$ all share the same commutation relations (i.e. share the same Lie algebra structure). The addition comes from when one has stuffs like spin-orbit coupling and the like.
In QFT, stuff starts to get a bit/lot confusing. First, angular momentum operator is really used to label states in the irreducible unitary representation of the Poincare group, which is written as $\left|p,\sigma\right>$ (or $\Psi_{p,s}$ following Weinberg); it is an operator in the sense that it appears as a representation of rotation element of the group. Wigner's classification then gives us that we also label states with two quantum numbers: we sometimes also write this as $\left|m,j\right>$, where $m$ is the rest mass and $j$ is the spin. Nowhere in any of these constructions do I see the conventional orbital angular momentum (in the text by Schwartz Chapter 11, for example, he made a comment when there is no angular momentum, so he got the "easy" case of $\vec{J}=\vec{S}$.) In standard QM, we clearly distinguish two versions of angular momenta and their eigenvalues.
Question: does orbital angular momentum make sense in QFT and how does it arise if it does? Should I think of $\vec L$ as furnishing some kind of tensor product representation so that I should be labelling states with $\left|m,j,s\right>$ or something? Another possibility is that one simply does not work with addition of angular momenta in QFT, especially in free theory, but I would like to have an explanation on why this should or should not be the case. I may have understood something really basic but I can't fish out exactly what.
Note: I believe the usual thing about spin-orbit coupling should not work, because that's QM (think about hydrogen atom) and strictly speaking QFT, unless we do something more (2-particle states?). In those cases, the operator $\vec{L}$ even comes from $\vec{r}\times\vec{p}$ which does not appear naturally in QFT (what's $\vec{r}$ in QFT?). I don't think I should go and define $\vec{L}:=\vec{r}\times\vec{\hat{\pi}}$, where $\hat\pi$ is the conjugate momentum of the field.