If you have an object immersed in air, then you can calculate the forces on it using Archimedes' principle.
There are two forces to consider. Firstly you have the weight of the object, which is simply:
$$ F_g = mg $$
where $m$ is the mass of the object and $g$ is the acceleration due to gravity. This force acts downwards. Secondly you have the bouyant force, which we calculate using Archimedes' principle:
$$ F_b = V\rho g $$
where $V$ is the volume of your object (i.e. the volume of air displaced), $\rho$ is the density of the air and again $g$ is the acceleration due to gravity. The bouyant force acts upwards. The net force acting on the object is calculated by taking the difference between the two forces (we take the difference because the forces act in opposite directions):
$$\begin{align}
F_{net} &= F_b - F_g \\&
= V\rho g - mg \tag{1}
\end{align}$$
I've used the convention that an upwards force is positive, so if $F_{net} \gt 0$ the object will rise and if $F_{net} \lt 0$ the object will fall.
Now consider your experiment. You start with a balloon filled with helium and you know this rises i.e. $F_{net} \gt 0$. Now you take the helium out of the balloon but keep it the same shape. What are you changing? The volume $V$ stays the same, and obviously the density of the air and the acceleration due to gravity are unchanged. So the only thing you are changing is the mass of your balloon $m$, which is reduced. So if you take equation (1) and reduce $m$ you should be able to tell what happens to the net force.