Universality of Planck's Constant As I understand it, the value of Planck's constant $h$ was originally introduced, in some sense, as a fitting parameter to understand blackbody radiation and the quantization of photons. In that sense, one can think of it as simply the proportionality constant between the energy and frequency of a photon.
However, we also have other relations such as the de-Broglie wave relation which use $h$, and some at a deeper theoretical level like in Schrodinger's wave equation, the commutation relation $[x,p] = i\hbar$, and the quantum path integral in the path integral formulation of quantum mechanics or quantum field theory.
Why is $\hbar$, which is essentially a proportionality constant related to light, so deeply tied to and seemingly universal in quantum theory? To be concrete, why does the value of $\hbar$ for the photon have to be the same as that of the de-Broglie wave relation, and why is $\hbar$ the same for all massive particles? Why does it have to be the same as that in Schrodinger's wave equation or the weight in the path integral or in the commutation relation? Why does classical theory generically stop being relevant on action scales close to $\hbar$? Qualitatively speaking, it doesn't feel like quantum theory intrinsically restricts $\hbar$ to be the same in all these cases, in the same way that general relativity identifies inertial mass with gravitational mass. Is it simply black magic that all of these are related, or is there something deeper? Or does it have something to do purely with the observables we can measure being deeply tied to the photon in some way? 
 A: One way to think of Planck's constant is as the factor that relates momenta to spatial frequencies, ie reciprocal lengths. This includes temporal momenta (aka energies), which will be related to temporal frequencies, ie reciprocal durations.
Whenever you see a pairing $p\cdot x$ or $E\cdot t$ (or by implication $p\cdot\dot x$), it might be appropriate to stick a factor $1/\hbar$ in there. An economic way to do so is to just scale all momenta by $1/\hbar$, which is implicitly achieved by using natural units.
A: All of these appearances of $\hbar$ aren't really independent, they're closely linked.


*

*First off, the equations $E = \hbar \omega$ and $p = \hbar k$ aren't independent; they're linked by relativity. Space and time are related in the same way that $E$ and $p$, and $\omega$ and $k$ are.

*The equation $[x, p] = i \hbar$ is more fundamental, and you can use it to derive the other results. Specifically, the Stone von-Neumann theorem states that $[x, p] = i\hbar$ implies that states of definite $p$ are plane waves of wavenumber $k$, with $p = \hbar k$.

*Starting from either of the previous results, you can heuristically "derive" the Schrodinger equation. In this derivation, the $\hbar$ just 'comes along for the ride' the whole time, so it's not really a new appearance.

*The result $p = \hbar k$ can also be used to derived the Heisenberg uncertainty principle $\Delta x \Delta p \sim \hbar$. Again, $\hbar$ just comes along for the ride.

*Starting from these results, you can derive various semiclassical results, such as the Born quantization rule $\int p\,  dx = n \hbar$. The $\hbar$ is still just tagging along here, since it generally appears with every combination of $p$ and $x$.

*By relativity, $\hbar$ should also appear with every combination of $E$ and $t$. This means it should be the unit of action $S$, which is why the path integral weights by $e^{iS/\hbar}$. 

A: 
As I understand it, the value of Planck's constant h was initially introduced, in some sense, as a fitting parameter to understand blackbody radiation and the quantization of photons. 

Pretty much. Max Planck introduced it to get past the ultraviolet catastrophe. 

In that sense, one can think of it as simply the proportionality constant between the energy and frequency of a photon.

Don't. It's more than that. It's telling you something important about the nature of light. 

However, we also have other relations such as the de-Broglie wave relation which use h, and some at a deeper theoretical level like in Schrodinger's wave equation, the commutation relation [x,p]=iħ, and the quantum path integral in the path integral formulation of quantum mechanics or quantum field theory.

Yes we do. Note that it's the de Broglie wave relation and the Schrodinger wave equation. Also note that the path integral formulation is to do with wave function.  

Why is ħ which is essentially a proportionality constant related to light, so deeply tied to and seemingly universal in quantum theory? 

Because quantum theory is the strange theory of light and matter. 

To be concrete, why does the value of ħ for the photon have to be the same as that of the de-Broglie wave relation, and why is ħ the same for all massive particles? 

Because of the wave nature of matter. 

Why does it have to be the same as that in Schrodinger's wave equation or the weight in the path integral or in the commutation relation? 

Because of the wave nature of matter. We make matter out of light in pair production. Then we can diffract electrons and other particles. Because in atomic orbitals electrons exist as standing waves. Then we can annihilate particles with their antiparticles and get the light back. See Newton's Opticks query 30: "Are not gross bodies and light convertible into one another?" Yes they are. 


Why does classical theory generically stop being relevant on action scales close to ħ.

It doesn't. We have classical electromagnetism and optics.  

Qualitatively speaking, it doesn't feel like quantum theory intrinsically restricts ħ to be the same in all these cases, in the same way that general relativity identifies inertial mass with gravitational mass. Is it simply black magic that all of these are related, or is there something deeper? 

There's something deeper. See Leonard Susskind in this video. At 2 minutes 50 he rolls his marker round and round saying angular momentum is quantized. You doubtless know that a sine wave is associated with rotation. The quantum nature of light is to do with that: roll your marker round fast or slow, but roll it round the same circumference, because Planck's constant of action h is common to all photons regardless of wavelength.  Photon momentum is p=h/λ. The momentum can vary, the wavelength can vary, but h doesn't. The dimensionality of action can be given as momentum x distance. And it's the same distance for all wavelengths. Ever played Spanish guitar? You vary the wavelength with your left hand and you pluck with your right. In most situations the amplitude of your pluck doesn't change. Like Maxwell said, light consists of transverse undulations. Take a look at some pictures of the electromagnetic spectrum. Notice how the depicted wave height is the same regardless of wavelength? Note how all those transverse undulations have the same amplitude? You are looking at the quantum nature of light, at that something deeper, and it is hidden in plain view: 
 
