In high school I was taught energy was conserved. Then I learned that nuclear reactions allow energy to be converted into mass. Then I also heard that apparently energy can spontaneously appear in quantum mechanics. So, are there any other caveats with the conservation of energy?
The topic of "Energy Conservation" really depends on the particular "theory", paradigm, that you're considering — and it can vary quite a lot.
The same principle can be applied to all other theories in Physics, from Thermodynamics and Statistical Mechanics all the way up to General Relativity and Quantum Field Theory (and Gauge Theories).
Thus, the lesson to learn is that Energy is only conserved if there's translational time symmetry in the problem.
Which brings us to General Relativity: in several interesting cases in GR, it's simply impossible to properly define a "time" direction! Technically speaking, this would imply a certain global property (called "global hyperbolicity") which not all 4-dimensional spacetimes have. So, in general, Energy is not conserved in GR.
As for quantum effects, Energy is conserved in Quantum Field Theory (which is a superset of Quantum Mechanics, so to speak): although it's true that there can be fluctuations, these are bounded by the "uncertainty principle", and do not affect the application of Nöther's Theorem in QFT.
So, the bottom line is that, even though energy is not conserved always, we can always understand what this non-conservation mean via Nöther's Theorem. ;-)
That would be the opposite and in any case, mass is energy (and energy is mass), so converting one into the other does conserve energy.
For a very short time, given by Heisenberg uncertainty principle. And that's not a violation of the conservation of energy.
Why "other" ? There's not any problem with the conservation of energy.
Energy is always conserved without any caveat.
With the advent of special relativity, mass and energy are considered equivalent. In other words, they are represented by a vectorial quantity called energy-momentum vector. Before relativity there were separate laws which have been unified. It is a very fundamental law that is connected to some basic empirical properties of the universe, like the fact that the laws of physics do not change over time.
Energy cannot spontaneously appear in quantum mechanics -- however it cannot be precisely measured and this allows for energy fluctuations. The important difference is that although the total amount of energy can change, this is for very brief amount of time, after which the original quantity is restored. So the energy fluctuation can be considered virtual. You don't get energy out of nothing and energy is still conserved.
Usually, but not always, the Energy is a conserved quantity as the others answers have explained.
In the BB framework where space expands, or in the dual 'shrinking matter' (almost dual)(comoving framework), the ratio matter/space is not invariant and energy is not conserved, i.e. Nöther's Theorem does not apply. It is well known that photons loose energy as they propagate. I can not find an argument to explain why particles shoud not (as they are also matter waves) loose energy.
The other relevant point is that energy can be destroyed, canceled, annihilated, already proved by experiment as described here: real-live-antilaser, paper, and here a tentative discusion. Other example: what is the energy radiated by two dipoles centered in the same frequency and in phase opposition ? zero. The same happens with two photons in similar conditions.
The equations for the interference of parallel polarized light are :
see Kostya answer here and substituting Delta by Pi:
Another two situations that should make us think on energy conservation:
I can not remmember of any other situation where energy is not conserved. I'm not including Dark Energy possible issues (see CosmicVariance)
Those four exceptional cases should make us think about our concepts.