Uncertainty can be derived from the fundamental axioms of quantum mechanics without reference to information (see also these lecture notes). But it is important to distinguish between (1) quantum mechanics itself, (2) the physics that "runs on it". What fields and interactions are possible is not solely defined by quantum mechanics, and theoretical physicists invent new ones all the time to see how they play out. The information content of the world depends on both 1 and 2.
In my opinion the best explanation for the link is due to Scott Aaronson, who outlined an argument (here shortened a bit):
- "Relativity—even just Galilean relativity—demands that, in flat space, the laws of physics must have the same form for all inertial observers"
- "Anything in the physical world that varies in space—say, a field that encodes different bits of information at different locations—also varies in time, from the perspective of an observer who moves through the field at a constant speed."
- "Combining 1 and 2, we conclude that anything that can vary in space can also vary in time."
- The conversion factor is $c$ due to SR.
- "Anything that varies across time carries energy. Why? Because this is essentially the definition of energy in quantum mechanics! Up to a constant multiple (namely, Planck’s constant), energy is the expected speed of rotation of the global phase of the wavefunction, when you apply your Hamiltonian. "
- "Combining 3 and 5, any field that varies across space carries energy."
- "More strongly, combining 4 and 5, if we know how quickly a field varies across space, we can lower-bound how much energy it has to contain."
- "In general relativity, anything that carries energy couples to the gravitational field. This means that anything that carries energy necessarily has an observable effect: if nothing else, its effect on the warping of spacetime."
- "Combining 6 and 8, any field that varies across space couples to the gravitational field."
- "More strongly, combining 7 and 8, if we know how quickly a field varies across space, then we can lower-bound by how much it has to warp spacetime. "
- "But in GR, spacetime can only be warped by so much before we create a black hole: this is the famous Schwarzschild bound."
- "Combining 10 and 11, the information contained in a physical field can only vary so quickly across space, before it causes spacetime to collapse to a black hole."
He concludes "Summarizing where we’ve gotten, we could say: any information that’s spatially localized at all, can only be localized so precisely. "
Note that this argument hinges on both quantum mechanics (the energy-time link, which is because they are complementary, and hence also imply the uncertainty tradeoff between them), and the special and general relativity (the kind of physics we got). In other kinds of spacetimes it might not hold (indeed, when you allow exotic fields that prevent black hole formation in extreme cases you can get infinite information). Plus, of course, we don't have a proper quantum gravity theory so there is more than a bit of handwaving in this argument.
Taking "infinite information density is not possible" as an axiom might allow you to remove another axiom somewhere in this construction. It is noteworthy that one can view the uncertainty relation as derived from "the statement that the position and momentum distributions cannot both be arbitrarily narrow" which would indeed follow from such an axiom. But as mentioned above, it can be derived from the other quantum mechanics axioms too.
Whether you get an interesting axiomatic system by assuming uncertainty and dropping one of the others or using a different set is a bit beyond me, but would not surprise me. Often several different axiom sets can act as "base vectors" for the same theory, and reformulating it to a more information-oriented basis might be illuminating.