When solving the expression for displacement of an accelerating object and solving for the time variable: $$v_it+\frac{1}{2}at^2=d$$ $$v_it+\frac{1}{2}at^2-d=0$$ $$t=\frac{-v_i\pm \sqrt{v^2_i+2ad}}{a}$$ $$t=\frac{-v_i\pm v_f}{a}$$ where $a$ is acceleration, $t$ is time, $v_i$ is initial velocity, $v_f$ is final velocity, and $d$ is displacement.
How do I know if I should choose + or - on the last step? Is there a way do select the physical solution without any additional information?