Is possible to give a proof of this statement (See Griffiths pag. 121):
In a volume $V$ surrounded by conductors the electric field $\textbf{E}$ is uniquely determined if the total charge on each conductor is given.
Now consider your example. I want to know the field due to the charge inside and on the surface of the cavity in a point $P$ external to the cavity. What happens if I let expand the outer surface of the conductor? The charge on the conductor remains the same (zero) and also the cavity remains the same (its shape), so the field inside the cavity doesn't change, thanks to the theorem.
There's more, also the charge configuration on the cavity surface doesn't change because of
$$
\textbf{E} = \sigma/\epsilon_0 \textbf{n}
$$
on the inner surface of the conductor. So the situation in the cavity is exactly the same as before.
But we can enlarge the outer surface as we want, such that the field due the plus charge outside evaluated in $P$ goes to zero (if the outer surface is far away) and $P$ is now inside the conductor. So we are in the same situation of your answer but we have eliminated the contribution from the outer surface. Since $\textbf{E}$ in $P$ is zero (we're now inside the conductor), the field due to the charge inside and on the surface of the cavity is zero.