No.
The particles have a joint spin state, $\left|\uparrow \downarrow \right\rangle - \left|\downarrow \uparrow\right\rangle.$
When you send the left particle through a Stern-Gerlach device then the device changes from $\left|0\right\rangle$ to $\left|1\right\rangle$ when the left particle is detected as down.
So $\left(\left|\uparrow \downarrow \right\rangle - \left|\downarrow \uparrow\right\rangle\right)\otimes \left|0\right\rangle$ evolves into
$\left|\uparrow \downarrow \right\rangle\otimes \left|0\right\rangle- \left|\downarrow \uparrow\right\rangle\otimes \left|1\right\rangle$
At this point you can people that see the detector having gone off can ignore their particles but their particles are already particles with a definite spin. And the people that don't see the detector go off also already have particles with a definite spin state.
Up to this point, the left survivor hasn't actually been measured, so the wave function of the pair is still intact.
The particles have spatial degrees of freedom and a joint spin state and the detectors have states. And they are all evolving. The Stern-Gerlach device isn't magic, it evolves the particles spin states and spatial degrees of freedom by subjecting them to an inhomogeneous magnetic field. Inhomogeneous magnetic fields change the spin state. Since they have a joint spin state, changing the spin state of one of them changes the spin state of both of them.
So sending one particle through a Stern-Gerlach changes the spin state of both. And your claim that you didn't even affect the particle you sent through is even more wrong.
The fact that you could detect one and not the other is because the spatial degrees of freedom of particle one changed. And the spin changed to so that the spatial degree of freedom became entangled with the spin. And then your detector evolved to have the detectors state become entangled with the spatial degree of freedom.
For are changing your particles and the only reason you think you haven't is because people like to call some things measurements and detectors. Really you are evolving things. And sometimes that evolution gets the different parts so separate that they will never interact again. That when the things interacting with them can pretend like just one outcome happened.
But you always evolve things. And a joint spin state means when you evolve the spin state of one you evolve the spin state of the other. And only when you have interacted differently with so many different things that it is impossible to get them to all get back to the same state together that is when you can take one branch as it's own.
If you to see it. Look at $\left(\left|\uparrow \downarrow \right\rangle - \left|\downarrow \uparrow\right\rangle\right)\otimes \left|C\right\rangle\otimes \left|0\right\rangle\otimes \left|B\right\rangle$
Where the $C$ means the spatial degree of freedom of particle 1 isin the center position,and the $B$ means the human is bored.
This evolves into $\left(\left|\uparrow \downarrow \right\rangle\otimes \left|U\right\rangle - \left|\downarrow \uparrow\right\rangle\otimes \left|D\right\rangle\right)\otimes \left|0\right\rangle\otimes \left|B\right\rangle$
Where the $U$ means it was spatially deflected up and the $D$ means it was spatially deflected down. Then we only placed the detector where the left particle is down. So it becomes $\left(\left|\uparrow \downarrow \right\rangle\otimes \left|U\right\rangle\otimes \left|0\right\rangle - \left|\downarrow \uparrow\right\rangle\otimes \left|D\right\rangle\otimes \left|1\right\rangle
\right)\otimes \left|B\right\rangle$ and then the sector interacts with the human $\left|\uparrow \downarrow \right\rangle\otimes \left|U\right\rangle\otimes \left|0\right\rangle\otimes \left|B\right\rangle - \left|\downarrow \uparrow\right\rangle\otimes \left|D\right\rangle\otimes \left|1\right\rangle\otimes \left|E\right\rangle.$
Where $E$ isn't bored. So originally the spins were entangled and notnrslted to anything else. Now we have two whole worlds.
One world with bored humans and detectors that didn't go off and a left particles that was deflected the direction that spin up particles go and the left particle has spin up and the right particle has spin down.
And a second world with excited humans, detectors that are in a fired state and a beam that where the left particles was deflected the direction that spin down particles go and the left particle has spin down and the right particle has spin up.
And to get these worlds to affect each other is impossible because there are actually too many particles with different states in these two worlds you can't get them to overlap. In a double slit you have to the beam from one slit to overlap the beam from the other slit. But the overlap is actually in configuration space so you need every single particle in the universe to be in the same configuration but have gone through those two histories.
Back when all you did was deflect the beam it was possible to deflect them to the same place. But now you'd have to deflect those beams to the same place and undo the changes to he detector and the human and undo those in a way where undoing hem doesn't change anything else. That is hopeless. It is not going to happen.
So the two worlds will not interfere ever again. So they act like a world onto their own. So you either have a world where ...
There are bored humans and detectors that didn't go off and a left particle that was deflected the direction that spin up particles go and the left particle has spin up and the right particle has spin down.
Or else you have a world where there are excited humans, detectors that are in a fired state and a beam that where the left particles was deflected the direction that spin down particles go and the left particle has spin down and the right particle has spin up.
It is those two worlds that are going to throw away something or start messing with particles. They are already as separate as they are going to be. You've done a measurement. But it started back when the beams of particles were deflected different directions by a magnetic field that also polarized the spin. But things became irreversible some time after that and even after that is way too late.
spin of the "right" particles should therefore still have expectation 0, right?
Nope. The right particle has a totally defined spin state and that happened even before the detector went off, it happened when the left particle went through the Stern-Gerlach device.
