From several unrelated sources (such as Scott Aaronson's discussion of hypercomputation or this article about a bound on the number of degrees of freedom of any theory with a positive cosmological constant), I have bumped into the claim that the universe contains a finite amount of information (on the order of $10^{122}$ bits), backed by references to the Bekenstein bound.
I followed the references to Bekenstein's original article. The logic seems to be approximately this:
- General relativity theorems show that (classically) the total area of black hole event horizons cannot decrease.
- If we assume that black holes have zero entropy, then we can break the second law of thermodynamics by throwing matter with some entropy into a black hole.
- Therefore, it is natural to extend the concept of entropy by adding a contribution from black holes, whose entropy should be directly proportional to their surface area.
- The proportionality constant $\frac{S}{A}$, in Planck units, is $\frac{1}{4}$. (This is the step I am having trouble with.)
- When a black hole absorbs an object of energy $E$ and radius $R$, its area must (for general-relativity reasons) increase by at least $8 \pi ER$. This increases the black hole's entropy by $2 \pi ER$. For the second law not to be violated, the body cannot have more entropy than this. This creates a bound on $\frac{S}{E}$ that we can then plug values for the entire observable universe into, getting the $10^{122}$ bits.
But I am having trouble tracking down where that proportionality constant came from. Bekenstein provides three references for it: Ref. 1, Ref. 3, Ref. 6.
- In Ref. 3, Bekenstein calculates it from a thought experiment involving dropping a single particle into a black hole. He makes the assumption that the information associated with the particle is at least one bit (as the answer to the question "does the particle exist?"), but he himself considers this a lower bound, with the true value probably not far away, but unspecified.
- Ref. 6 is also earlier work by Bekenstein; it links to Ref. 3 and makes the additional observation that a higher proportionality constant would forbid particles from being captured by a black hole reversibly (with $\Delta S_g = 0$, where $S_g$ is the generalised entropy, that is, classical entropy plus black hole entropy). This provides some plausibility-based argument for this precise value, but not a derivation from uncontroversial facts.
- Ref. 1 seems to be the original derivation of Hawking radiation; it's above my skill level and I cannot see whether at any point there is a similar assumption made.
In particular, I could imagine the proportionality constant being bigger. There are many thought experiments considered in these papers and their references that show various processes (which involve dropping various kinds of particles or radiation into a black hole) adhere to the bound, but they would also adhere to the same bound if the proportionality constant were artificially increased tenfold. To disprove this possibility, one would instead want some opposite process, where the black hole's surface area decreases while classical entropy increases. I believe Hawking radiation is of this nature. Is there a better, less plausibility-based assumption in that derivation?
These papers are also rather old, perhaps there have been better treatments since then.
My question is: Does Hawking radiation, or some other thought experiment, provide an upper bound on the entropy of black holes? If so, where in the derivation does one find the upper bound on the amount of information? How is the link between black hole area and bits of information established? Does it rest on a similar assumption of "one particle, one bit"?
Note: The question about the proportionality constant has been asked before here, but I hope you agree my question is far more focused and would not be likely to find answers there.