As stated in the comments, the answer does depend on the Biot-Savart law. But in fact, not all the information from the Biot-Savart law is needed. The only two facts needed from the Biot-Savart law is that 1) $\vec{B}$ is a pseudo-vector, and 2) $\vec{B}$ is linear in the current $I$. In particular if I multiply $I$ by $-1$ then $\vec{B}$ also gets multiplied by $-1$. Any vector field that satisfied these assumptions would have to be purely azimuthal in this geometry.
You already understand why the field must depend only on $\rho$ and not on $\phi$ or $z$, but let's see why the two properties above imply that it cannot have a component in the $\hat{z}$ or $\hat{\rho}$ directions.
We will pick an arbitrary point $p$, and choose coordinate so $p$ lies on the $x$-axis. Then we consider three transformations that each have the effect of flipping the sign of $I$ while leaving $p$ invariant. If I write the magnetic field as $(B_\rho, B_\phi, B_z)$, then the effect of each of these symmetry transformations will be to either leave a component alone or multiply by $-1$. Therefore I will represent the effect of the transformation by a triple of plus or minus signs.
The first transformation we consider is rotation about the $x$ axis. It can be seen that this transformation reverses the $\phi$ and $z$ component, but leaves the $\rho$ component. So its effect is $(+,-,-)$.
The next transformation we will consider is simply inverting $I$. The effect of this transformation is to invert $\vec{B}$, since $\vec{B}$ is linear in $I$. So its effect is $(-,-,-)$.
The third effect we will consider is reflection through the $x$-$y$ plane. I will view this as a composition of parity inversion with a $\pi$ rotation about the $z$-axis. We know that for parity inversion $\vec{B}$ remains invariant because $\vec{B}$ is a pseudo-vector. But when we say invariant we mean that $\vec{B}(p)$ before the transformation is the same as $\vec{B}(-p)$ after the transformation. But $\hat{\rho}(p) = -\hat{\rho}(-p)$, $\hat{\phi}(p) = -\hat{\phi}(-p)$, and $\hat{z}(p) = \hat{z}(-p)$. Thus for $\vec{B}$ to be the same the effect of the transformation must be $(-,-,+)$. Then to this we compose a $\pi$ rotation about the $z$ axis, but this does not change the coordinates.
So we found our three equivalent transformations have different effects. They are $(+,-,-)$, $(-,-,-)$, and $(-,-,+)$. Let's consider the first component. The first transformation rule tells us that $B_\rho$ after the transformation is the same as $B_\rho$ before the transformation. However, the second law tells us that $B_\rho$ after the transformation is the opposite as $B_\rho$ before the transformation. The only way this is possible is if $B_\rho = 0$ after the transformation. Then $B_\rho = 0$ before the transformation as well. So $B_\rho$ must be zero no matter what. Similar logic shows $B_z$ must be zero. However, we have not shown that $B_\phi$ must be zero because we consistently saw that it gets multiplied by $-1$.