If in the first arrangement the final pressure is $P_2$, temperature
$T_2$ and volume $V_2$, will the state be the same even in the second
arrangement, after infinite time?
No.
You have indicated that the piston/cylinder is thermally insulated. As such, and assuming no friction between the piston and cylinder, the first process (one grain of sand at a time) is a reversible adiabatic process and the second is an irreversible adiabatic process. A reversible and irreversible adiabatic process cannot connect the same two equilibrium states. Fig 1 below assumes they do connect the same states 1 and 2.
The process in black is the reversible adiabatic expansion where the sand is removed one grain at a time. The process in red is the irreversible adiabatic expansion where the external pressure suddenly drops (removal of a chunk of sand equal to the amount removed grain by grain).
Both processes are governed by the first law
$$\Delta U=Q-W$$
Since both processes are adiabatic, $Q=0$ and
$$\Delta U=-W$$
Clearly, the work done by the reversible process (area under the black curve) is greater than the work done by the irreversible process (area under the red curve) and therefore the change in internal energy is different for the two processes (less for the irreversible process). But the change in internal energy has to be the same between the same two equilibrium states since it is a state function independent of the path. Therefore, the two processes cannot connect the same two equilibrium states as shown in the Fig 1.
So how does the final equilibrium state for the irreversible process differ?
Let's assume we are dealing with an ideal gas. For an ideal gas, any process,
$$\Delta U=C_{V}(T_{f}-T_{i})$$
Where $f$ and $i$ are the final and initial states. Therefore, for an ideal gas
$$C_{V}(T_{f}-T_{i})=-W$$
Since $W$ is less for the irreversible process, its decrease in internal energy is less making its final temperature greater than that of the reversible process, i.e., $T_{f}>T_{2}$. From the ideal gas law, for the irreversible process.
$$\frac{P_{1}V_{1}}{T_1}=\frac{P_{2}V_{f}}{T_{f}}$$
For the reversible process it is
$$\frac{P_{1}V_{1}}{T_1}=\frac{P_{2}V_{2}}{T_{2}}$$
Therefore
$$\frac{P_{2}V_{f}}{T_{f}}=\frac{P_{2}V_{2}}{T_{2}}$$
Which tells us that the volume to temperature ratio for the final equilibrium states is the same for the two processes. Given that $T_{f}>T_2$, then $V_{f}>V_2$.
The final equilibrium volume and temperature will be greater for the irreversible process. See FIG 2. @Chet Miller rigorous treatment in his answer gives the actual final volume and temperature for the irreversible process.
Hope this helps.