In the functorial approach to QFT, each Cauchy surface $\Sigma$ has an associated Hilbert space $\mathcal{H}_\Sigma$, and each pair of Cauchy surfaces $\Sigma,\Sigma'$ has an associated unitary $U_{\Sigma\to\Sigma'}:\mathcal{H}_\Sigma\to\mathcal{H}_{\Sigma'}$. These unitaries compose functorially. In practice, the unitaries are calculated by the path integral, at least formally.
I'm struggling to understand how the usual Heisenberg field operators are defined in this framework. Presumably, we define a commuting set of field operators on some initial slice $\Sigma$. These form an operator algebra which I'll call $\mathcal{A}_\Sigma$. In the spirit of the Heisenberg picture, we could then define the operator algebra associated to a different slice $\Sigma'$ to be $\mathcal{A}_{\Sigma'} = U_{\Sigma\to\Sigma'} \mathcal{A}_{\Sigma} U_{\Sigma\to\Sigma'}^{\dagger}$. This is nice, but it's not yet the full Heisenberg picture: we want to associate field operators to points, not just sets of field operators to Cauchy slices. Also, we'd like all of our Heisenberg field operators to act on one fixed Hilbert space, not different Hilbert spaces corresponding to each slice.
So it seems that in passing from the functorial/path integral picture to the Heisenberg picture, one must choose some way to identify points, and Hilbert spaces, on different slices. Essentially, we need to make some arbitrary choice of coordinates. However I've been unable to get such a procedure to work, since the definition of the field operators seems to end up depending on the coordinate choice, which is clearly wrong.
So: How are the Heisenberg field operators defined in the functorial/path integral QFT framework?