What you're describing here is actually a very interesting phenomenon known as Buckling. Now Buckling does not occur on all cases, so I could see how this sentence
Let's assume that we had some initial non-parallel force that caused the deflection in the beginning, but afterward the force is horizontal.
would make sense. But trust me, reality is much worse. All you need are two coaxial forces, such as the ones your diagram and you can have the dashed curve given that specific criteria are fulfilled.
The force needed to cause buckling, according to your diagram - that is two forces on the same bar is:
$
F=\frac{\pi^2\,\text{E}\,I_{min}}{l^2}
$
So this is, what is known as a critical force, that would cause buckling to start. Now, a procedure of solving a simple differential equation (the elastic line eq), found in most textbooks on Mechanics of Material you can find this equation:
$
y(z)=f\sin\left(\frac{\pi\,z}{l}\right)
$
You might notice the f term there. That is the amplitude, or the maximum deflection that the beam will experience. However, due to the nature of the harmonic solution of the differential equation, computing values for this term is impossible since once buckling starts, it's improbable that we can pinpoint the exact family (or shape of buckling). Hence, I would suggest reading a bit further on this topic, as there's alot of material that one could learn from.