The assumption of "freedom" in the Bell inequality derivation is a somewhat misleading statement. It is not an assumption of freedom in the philosophic sense. Rather, it is the statement that the experimenter's choice of measurement basis should not be correlated with the quantum state they are measuring.
For example, one could set the measurement apparatus such that for each run of the experiment the measurement axis is determined by the last digit of the Dow Jones at that moment. Then the relevant assumption of the Bell inequality derivation is that the laws of nature not somehow determine the stock market so that it fluctuates in sync with the secret changes in the true orientation of the entangled spins. You can see why theories that break this assumption are often described as "conspiratorial." You can also see that science itself depends on making assumptions like this. You can't trust the result of any experiment if you start to suppose that, say, the laws of nature are set up so that when you do a particular experiment you always suffer a hallucination that makes you think that you got the opposite result. This is why most people tend to dismiss this possibility. That said, some people do try to construct theories that violate this assumption without being as egregiously conspiratorial as the above example- see, e.g., this
recent question.