I'm going to expand on march's idea, and specifically my own comments underneath his answer, which don't represent the whole picture. This should all be basic textbook stuff, but that's basically what it was supposed to end up as!
$V(x)$ has two components: $V(x) = \frac{1}{2} kx^2 + \lambda x$. If we plot these two simple functions, it becomes evident that for any $\lambda$ (or $a$), there is a region close to the origin in which the linear term is larger than the quadratic term (this is basically QuantumApple's point):
Heuristically, the new ground state will be located where the linear potential maximally counteracts the quadratic potential, which is indicated by the arrow in the diagram. If we consider the blue curve to represent the negative of the perturbation, $-\lambda x$, then we can rephrase the true extremality condition in terms of our heuristic as $\frac{\mathrm{d}}{\mathrm{d}x} \left[\frac{1}{2} kx^2 - (-\lambda x)\right] = 0$. This point of maximal counteraction is located at $x=-\frac{\lambda}{k}$. This result is, of course, the same result as obtained by minimizing the classical Hamilton function, or shifting the axis in the Hamiltonian/Hamilton function as $x \mapsto x + \frac{\lambda}{k}$ by completing the square.
Whatever the sign of $\lambda$, the near-0 region where this holds true will always exist, either left or right of the origin.
Now, this is already (IMO) a more intuitive picture, and additionally it should be valid in either the QM or classical case. However, by going fully classical, it is possible to take another perspective:
Assuming we know, one way or the other, that there is a new minimum at $x=-\frac{\lambda}{k} = -\frac{a}{k}$, we can look at the balance of forces and the energy/work that gets us there. First assume the classical HO (e.g. as a mass on a spring) is initially at its equilibrium position $x=0$, and at rest, $p=0$. This is the classical "ground" state.
Now we introduce the linear perturbation in the energy, which is classically equivalent to a constant force $F = -\frac{\mathrm{d}}{\mathrm{d}x} ax = -a$. This force shall displace the spring-loaded mass from $x=0$ to our newfound minimum at $x=-\frac{a}{k}$. While doing so, it performs work equal to
$$\int_{x=0}^{-\frac{a}{k}} F(x) \mathrm{d} x = - \int_{x=0}^{-\frac{a}{k}} a \mathrm{d} x = \frac{a^2}{k}.$$
However, if we look at the total energy that the mass should have at its new energy minimum, it should be at $H(x,p) = -\frac{a^2}{2k}$, i.e. only half this energy. What's going on?
Well, the external force $F = -a$ has to counteract the "internal" force of the spring (equivalently: the total force acting on $m$ is the sum of the two forces). Counteracting the harmonic force requires work equal to:
$$\int_{x=0}^{-\frac{a}{k}} \left( -kx\right) \mathrm{d} x = -\frac{a^2}{2k}.$$
Note that this counteraction principle is exactly what I described in terms of potentials above.
Therefore, the net work that is performed in moving the particle from its old to its new "ground" state position is equal to $\frac{a^2}{k} -\frac{a^2}{2k} = \frac{a^2}{2k}$. Correspondingly, the total internal energy change should be (due to conservation of energy), and is, $-\frac{a^2}{2k}$—which evidently arises from the fact that the work that can be performed by the external, constant force exceeds the counteracting harmonic force (i.e. $\frac{a^2}{k} > \frac{a^2}{2k}$)!
May this be helpful to some soul in the future.