Let $P := \mathrm{SL}(2,\mathbb{C})\ltimes \mathbb{R}^4$ be the universal cover of the connected component of the identity of the Poincaré group.
Given a classical field $\phi : \mathbb{R}^{1,3}\to V$ where $V$ carries a finite-dimensional irreducible representation $\rho : P\to\mathrm{GL}(V)$ (e.g. spinor, vector, (p,q)-tensor) and the irreducible unitary representation $U : P\to \mathrm{U}(H)$ where $H$ is the space of one-particle states associated to the field, the Wightman axioms impose that $$ \rho(\Lambda,a)\phi(\Lambda^{-1}x+a) = U(\Lambda,a)\phi(x)U(\Lambda,a)^\dagger$$ holds as an operator equation on the space of states.
Does this equation uniquely determine $U$ given $\rho$? If yes, how? If no, how do we know which one to choose? If this does not work for arbitrary fields, is there at least a recipe for free fields?
I'll now describe what thoughts I have so far:
For the massive case I believe the answer is "natural": By Mackey's theory of induced representations, the unitary irreducible representations of $P$ are given by choosing an element of $\alpha\in\mathbb{R}^4$ and a unitary irreducible representation of the stabilizer of $\alpha$ in $\mathrm{SL}(2,\mathbb{C})$ together with a unitary character $\mathbb{R}^4\to\mathrm{U}(1)$, which I think is usually just 1 in physics. The stabilizer is known as the "little group" leaving the momentum of a particle in its rest frame invariant. For massive particles, this is $\mathrm{SU}(2)$, and since the finite-dimensional representations of $\mathrm{SO}(1,3)$ in which the fields transform are given by representations of $\mathrm{SU}(2)\times\mathrm{SU}(2)$, i.e. half-integers $(s_1,s_2)$, we choose the representation $s_1+s_2$ of $\mathrm{SU}(2)$ to induce the full representation.
For the massless case, it becomes less natural - the little group is $\mathrm{ISO}(2) = \mathrm{SO}(2)\ltimes\mathbb{R}^2$, which has one-dimensional representation (labeled by the value of "helicity") as well as infinite-dimensional irreducible representations. The latter, I believe, are the "continuous spin representations" usually not occuring in physics. But what determines which one-dimensional representation to choose? The photon usually gets the reducible representation that is a sum of the representations of helicity +1 and -1, since parity interchanges them - can this be seen simply from the finite-dimensional representation of the field and knowing it's massless?
For the tachyonic case, I'm completely at a loss. The little group is $\mathrm{SU}(1,1)\cong\mathrm{SL}(2,\mathbb{R})$, which has a plethora of rather complicated unitary irreducible representations given by Bargmann's classification. I see no way to connect the representation of the field with any of these representations.