[EDIT]
Supposing a state basis $|e_i\rangle $, we are going to use the following notation for a state: $|A(x)\rangle = \sum_i A_i(x)|e_i\rangle$
An operator $O$ appying on $A$ gives then: $O|A(x)\rangle = \sum_i OA_i(x)|e_i\rangle$
For instance, $\partial_{\mu}|A(x)\rangle = \sum\partial_{\mu}A_i(x)|e_i\rangle$
Now, instead of working with operators, I think it is simpler to work with states $\left|A(x)\right\rangle$ and $\left|B(x)\right\rangle$ such as:
$$\left|B(x)\right\rangle = \Phi(x) \left|A(x)\right\rangle \tag{1}$$
This is true, of course, for $x-a$, that is:
$$\left|B(x - a)\right\rangle = \Phi(x- a) \left|A(x-a)\right\rangle \tag{2}$$
We know that:
$$P_{\mu}\left|A(x)\right\rangle = i \hbar \partial_{\mu}\left|A(x)\right\rangle.$$
So, we get:
\begin{align}
T(a)^{-1}\left|A(x)\right\rangle
&= e^{\large iP_\mu a^\mu/ \hbar}\left|A(x)\right\rangle\\
&=e^{\large -a^{\mu}\partial_{\mu}} \left|A(x)\right\rangle\\
&= \left|A(x - a)\right\rangle
\end{align}
The last equality is simply the Taylor series of $\left|A(x - a)\right\rangle$ at $x$, that is:
$$\left|A(x - a)\right\rangle = \left|A(x)\right\rangle - a^{\mu}\partial_{\mu} \left|A(x)\right\rangle + \frac{1}{2!} (a^{\mu}\partial_{\mu})^2\left|A(x)\right\rangle +\frac{(-1)^n}{n!}(a^{\mu}\partial_{\mu})^n\left|A(x)\right\rangle + \dots.$$
Now, applying $T(a)^{-1}$ to equation $(1)$, we get:
$$T(a)^{-1}\left|B(x)\right\rangle =T(a)^{-1}\Phi (x)\left|A(x)\right\rangle.$$
That is:
$$T(a)^{-1}\left|B(x)\right\rangle =T(a)^{-1}\Phi (x)T(a)T(a)^{-1}\left|A(x)\right\rangle.$$
So, we get:
$$\left|B(x - a)\right\rangle =T(a)^{-1}\Phi (x)T(a)\left|A(x - a)\right\rangle.$$
Looking at equation $(2)$, we finally get:
$$T(a)^{-1}\Phi (x)T(a) = \Phi (x-a)$$