First I'll amplify on the point made by Avantgarde in a comment. Let's say you're in outer space, in free-fall conditions, and you have two gyroscopes. You orient the gyroscopes so that their axes are perpendicular. The directions of their axes can be described by three-vectors, but these three-vectors can also be promoted to four-vectors in a natural way, by requiring that they be vectors of simultaneity in your frame, i.e., they represent purely spatial displacements to you. Let these two vectors be $v^a$ and $w^b$. Then the orthogonality of their axes can be expressed as $v^aw_a=0$, which is equivalent to $g_{ab}v^aw^b=0$.
Now as time goes on, and you free-fall along with the gyroscopes, we expect the axes of these two gyroscopes to remain orthogonal. This is really just the equivalence principle at work. The properties of spacetime are always locally equivalent to the properties of Minkowski space. Mathematically, this means that we expect $v^aw_a$ to remain zero. This can be generalized to cases where the vectors are not necessarily spacelike or where the inner product is nonzero.
At a more philosophical/conceptual level, if this kind of inner product were to change under parallel transport, then we would probably attribute the observed change to a change in the metric. But it doesn't really make sense to talk about measuring a change in the metric, because the metric is our only tool for making measurements in the first place. So for example, if the metric were to change by a factor of 2, how would we know? That would be like saying that all objects, including rulers and clocks, changed by a factor of 2, but that would be unobservable because nothing would change relative to anything else.