I'm a bit late, but I think there's still stuff to contribute in here. To make things a bit easier, I'll give an example not with General Relativity, but with Newtonian gravity instead (just because the calculations are easy enough for me to do them in here).
Suppose you are an engineer in 1900, before Relativity was discovered. You trust Newtonian gravity pretty well and you know that the force between two masses is given by the law
$$F = \frac{G M m}{r^2}, \tag{1}$$
where $G$ is Newton's constant, $M$ and $m$ are the objects' masses, and $r$ is the distance between their centers of mass.
Now let us say you want to build, on Earth, a $10 \text{ m}$ tall building. What is the gravitational force a brick in the building will feel?
Noticing that $r$ can be written as $r = R + h$, where $R$ is the radius of the Earth and $h$ is the height of the brick with respect to the ground, you write the force as
$$F = \frac{G M m}{(R+h)^2}.$$
However, you notice that $h \sim 10 \text{ m}$ is much smaller than $R \sim 6000 \text{ km}$. Hence, you decide to write the force as a Taylor series in $h$. In other words, you do a mathematical trick you learned back in Calculus I to write the force in the form
$$F = \frac{G M m}{R^2}\left(1 - 2 \frac{h}{R} + 3 \frac{h^2}{R^2} - 4\frac{h^3}{R^3} + \cdots\right),$$
where the dots represent terms proportional to $h^4$ or higher. The sum goes on forever, but if you compute it you'll get back to the original expression. For simplicity, you write $g = \frac{GM}{R^2}$ so you get to
$$F = mg\left(1 - 2 \frac{h}{R} + 3 \frac{h^2}{R^2} - 4\frac{h^3}{R^3} + \cdots\right).$$
Plugging in the experimental values for $G$, $M$, and $R$ you'll find roughly $g \approx 9.8 \text{ m}/\text{s}^2$.
You then decide to plug in the values $h = 10 \text{ m}$ and $R = 6000 \text{ km}$ to get an idea of how much each term contributes. You'll then notice that you get
$$F = mg\left(1 - 0.00000333\ldots + 0.000000000008333\ldots - 0.0000000000000000185185185\ldots + \cdots\right),$$
i.e., you notice the contributions proportional to $h$ and higher are really tiny. You think for a while and notice that the building you're constructing is not sensible to forces as tiny as $\frac{mgh}{R} \approx 0.000032666\ldots \text{ m}/\text{s}^2 \times m$. Since these corrections are so small, you choose to drop them and work with
$$F \approx mg.$$
After all, your building won't change if you used the more precise Newtonian theory.
The upshot here is: Physics is an experimental science. Many times we can work with better theories, but choose not to, because old theories are often easier to make computations and are really reliable for some experiments. If your experiment is not sensible enough to notice the difference, there is no reason to use the more complicated theory. Hence, even though the engineer knows the "better theory" to be given by Eq. (1) on the top of this answer, they choose to use $F = mg$ because the building is not sensible enough to notice the difference. Of course, things would change if the engineer was building a satellite. In this case, one might have $\frac{h}{R} \sim 1$, meaning the Newtonian corrections would be extremely relevant. Furthermore, if the engineer was designing a GPS system, the Newtonian theory wouldn't be enough, and they would need to work with General Relativity.
In modern Physics, we see all currently known and well-tested theories as effective theories: they are effective in describing the phenomena we are interested up to a certain scale, and after that they have no compromise of working. However, even if they fail for extreme cases, they work really well in a certain range of validity, and we can get quite good predictions and understanding with them.
If GR was falsified by an experiment, we would continue to use it in the situations we know it works, but search for something new in the cases it doesn't. In some sense, that's what we are already doing. As far as I know, few physicists believe General Relativity to be completely right. Most of us think quantum effects must come into play at very small distances and we'll need a theory of Quantum Gravity to deal with that stuff, which would be close to the Big Bang or within black holes, for example. However, in most situations, General Relativity works amazingly well.
I think it's safe to say most scientists hope for well-trusted theories to be falsified. When something goes wrong between theory and experiment, there is the opportunity to learn more. We get a clue on how the Universe really works and get to be astonished once more with whatever we learn. Few, if any, physicists want things to work perfectly, for that would be quite boring.
In short, if GR was falsified, we'd need a new theory of gravity for those phenomena which GR can't describe, but we'd still trust it for the phenomena we know it describes well.