I apparently cannot post images, so I apologize but you'll have to open this link in a new window to see my atrocious diagrams :) Diagrams -> https://i.sstatic.net/SvxQR.png
EDIT: Here are the diagrams, sorry about my lack of artistic skills, haha.
Voltage is an electrical potential difference, which is essentially a force caused by electrons wanting to evenly distribute in a material since the electrons repel each other. Olin Lathrop is using the common analogy between fluid and electric systems, which is why he calls it a "pressure", because pressure is a type of fluid force, but for this example it might be easier to understand if I keep it in electrical terms.
So the batteries try to maintain a voltage (potential difference) of 1.5 V across the terminals. So in the first part of the diagram I threw together, node 'V0' is going to be my reference node which due to the ground symbol means it will be 0 V. So looking at node 'V1' we know that the battery will try to maintain a 1.5 V potential difference, and we know its negative terminal is 0 V, so the positive terminal, or node 'V1', must be 1.5 V. Now, looking at the second battery, the negative terminal is connected to node 'V1', and if the battery is to maintain its 1.5 V difference across terminals, we can add 1.5 V (battery) to the 1.5 V (at node 'V1') to get the voltage at node 'V2', which turns out to be 3 V, as stated in Olin Lathrop's answer.
So why do the voltages add? Batteries are a container of voltage or electrical potential difference, and the potential force is created by a electron rich side separated from an electron deficit side. The electrons want to disperse evenly through the battery, but cannot pass through the middle, and thus must take the long way around to get to the other side. So with two batteries, you can see that there are actually two (basically) equal forces, two sets of 1.5 V difference.
Now to get to the heart of your question, basically why can't the middle two parts simply intermingle at node 'V1'? I'll use 3 different cases to help explain We also need to keep in mind that positive charges aren't really there, so the last diagram is a little more accurate still, where there are simply electrons and a lack of electrons (the electrical potential difference).
Case 1: Assume that the batteries are connected via node 'V1', but not from 'V0' to 'V2'. If we try to imagine moving electrons from the left battery to the right battery via node 'V1', we are actually pushing electrons CLOSER TOGETHER. We know that electrons repel each other so they don't like to do that. If we magically could though, we would be increasing the electrical potential difference, or voltage, in the right battery and decreasing it in the left. (But the total system would maintain the same total voltage, since we did nothing to the system except move electrons around.) So instead of the electrons forcing their way closer to more electrons, they just sit there and do nothing.
Case 2: The outer terminals, nodes 'V0' and 'V2', are connected but the inner two are not connected. If we push electrons from 'V0' through the circuit to node 'V2', we end up in the same situation as case 1, trying to push electrons into more electrons! This is why electrons don't want to flow if there is not a closed loop, because they'll just end up running into electrons that aren't moving somewhere else.
Case 3: Both sets of terminals are connected, (if there's a closed loop for the electrons to flow through). At the instant that we make a loop for the electrons to travel through, a few things are happening with these forces simultaneously. Remember those electrons that want to flow through node 'V1' but can't because there are too many electrons at node 'V0'? And now, remember the electrons that want to flow from node 'V0' through the circuit to node 'V2' but can't because there are too many electrons at node 'V1'? Well we get a situation where they can work together to solve each other's problems! Imagine we pull an electron from node 'V0', to node 'V2', and as that electron gets close to 'V2', we move another electron at 'V1' from the left battery to the electron depleted area in the right battery. If we do them simultaneously, there is an electron coming and going from both places that were previously causing an electron road-block! So as electrons flow from 'V0' to 'V2' there will simultaneously be electrons flowing through node 'V1'. And now we have two sets of electrons flowing with two 1.5 V potential differences in a row, which is why we get the 3 V potential difference!
Reality Check: There are some differences with reality though. For example, as batteries are used, they will decrease in voltage. Since the electrons are trying to evenly distribute, the electrical potential difference will decrease as well. Also, the barriers between the electron rich and electron deficit areas of the battery aren't perfect. All batteries have a self-discharge rate, which is effectively the electrons making it from one side of the battery to the other, it's just generally so small in comparison to the amount of electrons that we can actually use, that we ignore it. Internal resistance is also mentioned above, another slight deviation from the theoretical operation of batteries. But you can learn about all that stuff as you feel ready.
I hope this helps, and if I made any mistakes, please let me know! :)