Explicitly, before Maxwell's addition of the $\vec{J}_d$ term Ampere's law was:
$\nabla\times\vec{B} = \mu_0 \vec{J}$
The important thing to understand with all this is that Ampere's law is about conduction current, and conduction current is not the only current. Have a look at Taming Light at the Nanoscale:
"Look around, and you will probably see numerous electronic and optical gadgets, such as mobile phones, personal digital assistants, laptops, TVs and digital cameras. These may all do different things but they have one thing in common: in the electronic circuits that drive these devices, charged particles flow through components and impart power via what is known as the conduction current. But is the motion of charged particles the only current we have available?"
The answer is no, because we also have displacement current. It's "a time-varying electric field", and that's exactly what we see when an electromagnetic wave passes us by. There is no charged particle present, but the displacement current is present, and it's alternating: the field-variation increases to a maximum, then decreases back to zero. Note that we could put this wave through pair production, so we can convert displacement current into charged particles. Then when we move them, we call the phenomenon conduction current. Also note that because of this, displacement current is more fundamental than conduction current. And that knowing all this makes it clear that the original version of Ampere's law doesn't go far enough:
"Ampère's law determines the magnetic field associated with a given current, or the current associated with a given magnetic field, provided that the electric field does not change over time".
Why, then does $\vec{J}_d$ has the form it has and not any of the other possible solutions presented above?
Because of what displacement current is. Maxwell effectively worked backwards from Ampere and conduction current, and ended up saying "light consists of transverse undulations in the same medium that is the cause of electric and magnetic phenomena". When people read this they tend to think of sinusoidal E and B waves:
Image courtesy of mathematica
However that doesn't go far enough either. See the Wikipedia electromagnetic radiation article:
"Also, E and B far-fields in free space, which as wave solutions depend primarily on these two Maxwell equations, are in-phase with each other. This is guaranteed since the generic wave solution is first order in both space and time, and the curl operator on one side of these equations results in first-order spatial derivatives of the wave solution, while the time-derivative on the other side of the equations, which gives the other field, is first order in time, resulting in the same phase shift for both fields in each mathematical operation."
E is the spatial derivative of the wave, and B is the time derivative. So the real wave is the integral of the E and B sine waves. I'll illustrate this with a canoe analogy: imagine you're in a canoe as a ten-metre ocean wave* approaches. Your canoe starts to slope upwards, slowly at first, then faster, then the slope starts to flatten out, and your canoe is momentarily horizontal on the top of the wave. At this point displacement current is at a maximum, at the mid-point of the E and B sine waves. Then the process is reversed, something like this:

The slope of your canoe denotes E, and the rate of change of slope denotes B. One is the spatial derivative, the other is the time derivative. The displacement current is represented by the current of water that lifted you bodily up ↑ by ten metres, then let you down ↓ again. It has a vector nature, and the |direction| is the polarization direction. We write it as:
$$\vec{J}_d = \epsilon_0 \frac{\partial \vec{E}}{\partial t}$$
Adding a constant k would be like repeating the canoe scenario in deeper water. The wave is 10m high, so the deeper water won't alter the tilt of your canoe or how high you go. You can't add something to one side of the expression because each side is telling you about one aspect of the wave, and you can't change one side without changing the other.
* without a trough