As the OP points out, many people say
the phase of a wave function doesn't have physical meaning
and there are also some who say
the state space of a physical system shouldn't be a Hilbert space, but rather a projective Hilbert space
But an alternative view that the OP might find less confusing is
The state of a physical system is a vector in a Hilbert space, but is a global U(1) symmetry that prevents us from observing the overall phase factor of the state of the universe. More generally, an observer confined to an isolated system cannot observe the overall phase factor for the system.
One might object that this statement fails to convey some of the information that the previous statement is trying to convey: namely, the fact that any observable properties of a subsystem don't depend on the subsystem's phase. However, this fact just becomes a "theorem" as opposed to a "postulate". It follows from the fact that the phase factor of $|\psi\rangle$ cancels out when we evaluate $\langle \psi | A | \psi \rangle$ for any Hermitian operator $A$. Whenever the phase of $|\psi\rangle$ can be observed, it is only through evaluating something like $\langle \psi' | A | \psi \rangle$ where $|\psi'\rangle$ is some other prepared state that $\psi$ can interact with; this is not an observable of $\psi$ alone.
Another person who answered this question mentioned Weinberg's The Quantum Theory of Fields. Because Weinberg does discuss projective space and rays for a particular reason, I want to address this in case the reader is not convinced that we can do away with the concept.
In Chapter 2 of the text, Weinberg discusses (among other things) the Poincaré transformation and mentions projective representations of the Lorentz group. It's thanks to the existence of these projective representations that we have half-integer spin. But one can use the theory of projective representations without using the projective space formalism as the ontology of quantum mechanics.
There are specific reasons why I think that we shouldn't say states are rays (elements of projective space). I think it's an attempt to make the unobservable phase factor disappear entirely from the ontology (sort of like how you often must do calculations on vectors using their components, but the vector itself has a coordinate-independent existence). However, one can do this only for an isolated system. As soon as we start examining subsystems that can interact with each other, we see that the state of the combined system contains more information than the states of the subsystems, since there are also $N-1$ phase factors if there are $N$ subsystems. I believe that because this violates some people's intuition about what the word "state" is supposed to mean, it leads to confusion.
None of what I'm saying alters the substance of Weinberg's text, though (far be it from me to challenge the actual physics). In particular, the reasoning still stands that each field should correspond to a projective representation of $SO^+(3, 1)$, which may fail to be an ordinary representation (in which case the spin is half-integer). Suppose we have $\Lambda_1, \Lambda_2 \in SO^+(3, 1)$ (the proper orthochronous Lorentz group). We can still assign to each Lorentz transformation an operator that acts on physical states, and we must have, like (2.2.10) in Weinberg,
\begin{equation}
U(\Lambda_2) U(\Lambda_1) |\psi\rangle = e^{i\phi(\Lambda_2, \Lambda_1)} U(\Lambda_2 \Lambda_1) |\psi\rangle
\end{equation}
Weinberg's interpretation of this relation is that performing the Lorentz transformation $\Lambda_1$ then $\Lambda_2$ must yield the same state as performing the Lorentz transformation $\Lambda_2 \Lambda_1$, but since a state is a ray, that means there may be a phase factor when comparing the vectors.
The alternative interpretation I suggest using, which doesn't involve rays, is to say: doing $\Lambda_1$ then $\Lambda_2$ doesn't always yield the same state as doing $\Lambda_2 \Lambda_1$. However, the two states should yield the same values for all observables, therefore they can only differ by a phase factor.