While I am well aware of the branch of physics called statistical physics my question does not pertain to this. My background is bioinformatics which very rarely uses causal modelling instead we tend to use linear regression and machine learning to gain insights into experimental manipulations. My guess is this approach would not work well for situations where you are testing for a specific mathematical hypothesis rather than just if we change X we think it will affect Y (which is what most of the reasoning in biology boils down to). Physics has a set of much more complex mathematical models and I am curious how actual statistical analysis is performed to show that validity of a hypothesis? I am guessing it would be different for each field.
In quantum mechanics I guess that statistics would just fall right out of the theory but in for instance astronomy how are models validated and how do they reach statistical significance? How do you build null models?