If you think of it from practical side, it's
Voltage source = stabilized (fixed) voltage. That is what we usually expect to see as a power source.
Current source = stabilized (fixed) current. This kind of source will increase/decrease it'sits output voltage to match required current. This This is used to power non-linear devices like LEDs, lasers, gas discharge tubes.