John has answered this partially, however the fundamental mathematical idea is missing:
If we think of a function being member of some vectorspace, then basisvectors exist. This concept will surely be familiar to you from Quantum mechanics.
But also from there we remember, that problems were alot easier to handle, if we know the Eigenbasis of the Operators that we throw on functions. Then we just change the functions basis into the operators Eigenbasis and we're done.
Just how do we do this? How do we construct the Eigenspace for differential operators that make up differential equations? Let's think about it... First let's state the Eigenvalue Problem in abstract notation
$$ \hat{O} f=cf $$
and then put in that we use $\hat{O} = d/dx$:
$$\frac{df}{dx} = c f$$
And we immediately see, that this is a known equation! For which the solution is $f \sim exp(cx)$
Thus we know that if we deal with linear differential operators, an exponential basis will always faciliate our calculations. All we need to do is to use proper arguments $c$ to fit the order of the equation (i.e. add some $i$s or $\pm$).
The freedom in choosing $c$ for this method still to work has then given not only rise to the Fourier transform and its by John described properties, but also to the Laplace-transform.
By chosing $c$ appropriately we are ofc making also an 'educated guess' about the form of our exponential solution. For example a DEQ
$$\partial_t^2 f + \partial_x^2 f=0$$
will give oscillatory solutions for $c=i(kx \pm \omega t)$, but something that has a 'starting' point and then decays or grows for real c's. That's the idea of a Laplace-transform. You can also look up the examples on the wikipage (scroll down).
Concerning your other question:
The plane-wave-ansatz surely fails as soon as nonlinearities enter the differential equation, like this maximally simplified 1-D Navier-Stokes-Equation:
$$\partial_t v + v \partial_x v = 0$$
Already any attempt to use a Fourier-transform of $v$ will not result in an algebraicly solvable equation.
Numerically modellers adress this problem e.e. by pseudospectral methods, where all the equation is fourier-transformed except for nonlinearities. Those are calculated in real-space and then later numerically transformed.
The other problem you mentioned of infinity, can be also seen as problem of scale: With a box-size $L$ on which you want to solve your problem you will always get discretization effects of the waves that wobble around in this box. However if the wavenumbers $k << L$ then your density of waves is high enough to still be able to obtain a physically meaningful result.
The correctness then increases the better the above condition is fulfilled.