But what is potential in this example?
In your people-in-the-street analogy, the electric potential would be a shop with sale in one end of the street, or maybe an accident or something else interesting. People tend to move towards the interesting end (less potential) and away from the other and less interesting end (higher potential). Just like a stone wishes to fall down and not up, because the points up and down are at different potential.
What is the physical meaning of 2 V potential difference?
The unit Volts is Joules/Coulomb, $[\mathrm{V}]=[\frac{\mathrm{J}}{\mathrm{C}}]$. Remember that $\mathrm{C}$ is the charge. So we are talking about energy per charge. And a higher potential has more energy per charge.
Now, back to the people-in-the-street analogy. If suddenly an accident happens, then people suddenly start moving towards it, because it is very interesting (less potential). Maybe they will run to get there fast. The closer they get, the slower they will move since they are soon there and they can already see more and more.
If you are a police officer or store security guard or whoever else holding people back, then the further away they are from the interesting spot, the more they wish to move - the more they push or the more they run. And here it is very hard to hold them back.
If you much closer to the interesting point on the street, then people can already see what is happening and they push less.
Like at a rock concert, if the speakers are bad, the people furthers away will push on the crowd to get nearer. As they come closer, they can hear the music better and better and they gradually stop pushing.
It's like their energy, with which they try to move, gets lower and lower as they get closer. The energy per person (meaning, the energy per charge) decreases as they reach the lower potential.
Does that make sence?
And what is changed in the flow of electrons when the potential is 1 or 2 V?
$1$ or $2 \mathrm{V}$ is just a measure of how much the potential is at some point on the street. If the usual situation (the street at all points before the accident happens) is $0 \mathrm{V}$, then when the the accident takes place suddenly you have a potential difference that will start dragging people in that direction.
If two accidents happen at the same time at different spots on the street, then maybe one involves a biker falling over ($1 \mathrm{V}$) and another involves a big truck with a tank of liquid nitrogen bursting, while a car catches fire and people are screaming ($2 \mathrm{V}$, the point is that is is more interesting).
They are not equally interesting, so the difference in potential $2 \mathrm{V}-1\mathrm{V}=1\mathrm{V}$ is towards the more interesting happening. If the lower potential accident didn't happen, then the flow of people would be more intens and faster, but since two events happened people are not sure where they wanna go. They do though see that the bigger accident is more interesting.
If two tanks of liquid nitrogen blows up at the same time at different spots (meaning, two points with the same potential) then some poor fellow who happens to be right in the middle, he is so confused that he doesn't know where to go! So he just stands there and changes his mind over and over and over, and never moves anywhere!
This analogy appears to be a society of indecisive people...