Revised Answer
This problem is simple enough that you can determine the frequencies of the normal modes quite easily. The Lagrange Method is not necessary.
The 2 minima are mirror images of each other. There will be 2 normal modes : the particles moving anti-symmetrically in the same direction, and symmetrically in opposite directions. In both cases you can ignore the other particle : in the anti-symmetric case because the spring remains relaxed, in the symmetric case because the spring acts as though fixed at the line of symmetry.
Any other small oscillation is a linear combination of these 2 modes.
For small displacements $z=x-a$ from equilibrium, the potential $U(x)$ is parabolic - ie $U(z) \approx \frac12kz^2$. This applies for all potentials, including the spring - exact in this case.
For small displacements from equilibrium at the local minimum, the potential well is equivalent to a spring of constant $k_1$. The restoring force on the particle is $F(z)=-\frac{dU(z)}{dz}$ to 1st order in extension $z$, evaluated at $z=0$. Compare the result with Hooke's Law $F=-k_1 z$ to find the spring constant $k_1$. Then you can immediately write down the angular frequency and period of small oscillations.
In the 2nd case you have 2 springs in parallel; the combined spring constant is $k_2=k_1+2K$, where $K$ is the constant for the given spring. Note that for a given tension in a spring the extension at either end is half the total extension. You are effectively cutting the spring in half. It takes twice the force to produce the same extension in half the spring, so the spring constant is doubled, not halved.