Renormalization That ClicksBonus ① / Why did it start from low entropy?

Being able to coarse-grain and having something interesting happen are two different stories

Why did it start from low entropy? The laws of mechanics do not distinguish past from future.
Eggs break and never unbreak all the same ── and that asymmetry comes not from the laws but from the initial condition.
The initial condition required is a specialness of \(1/10^{10^{123}}\).

Tools you'll need: Episode 1's entropy \(S=k\log W\), time reversal, a feel for orders of magnitude The heart of this one: coarse-grainability + a special initial condition = a world with layers

Episode 1 said "entropy increases = discarded information does not come back on its own." That explanation, in fact, has a hole in it. The microscopic laws are perfectly symmetric under time reversal ── play the video backwards and the equations do not complain at all. So why does reality only run one way? The arrow of time does not come out of coarse-graining alone. One more card is needed ── the assumption that the universe began with extraordinarily low entropy (the past hypothesis). And how extraordinary? By Penrose's estimate, \(1/10^{10^{123}}\). This bonus episode confirms that underneath the "throw it away, same answer" the main series has leaned on all along, there sits another enormous assumption.

01Coarse-graining alone gives you no arrow of time

Boltzmann tried to derive the increase of entropy from coarse-graining (the H-theorem). He immediately met two devastating objections.

ObjectionContentEffect
Loschmidt's reversalReverse every particle's velocity and the system runs toward decreasing entropy. Given that the laws are time-symmetric, that solution is exactly as legitimatederiving "increases" from the laws is impossible
Zermelo's recurrenceA finite system must, if you wait long enough, return arbitrarily close to its initial state (Poincaré recurrence)increasing forever is impossible in principle

Both are correct. Boltzmann's reply was an honest one ── entropy increases not because of the laws but because it is low right now. Start from a low state and the only place to go is the overwhelmingly higher ones (the counts are too lopsided). So it increases. The reversed and recurrent solutions exist; they are just fantastically rare.

But this only shifts the question by one step. So why is it low now? Because yesterday it was lower. And why yesterday? ── Follow the chain and you run into the beginning of the universe.

02Try it ── the laws are reversible, the initial condition is special

You can check it in the box below. The particles only bounce off walls; the law is perfectly time-symmetric.

The third is the crucial one. Same law, same coarse-graining ── no arrow of time unless the initial condition is special. The arrow is not a property of the laws but a property of the initial condition.

Figure: particles in a box (the law is perfectly time-reversal symmetric) and the coarse-grained entropy S=−Σp ln p over time. Start from the left half and S climbs; reverse the velocities and it falls. Start at equilibrium and it is flat ── no arrow of time anywhere
coarse-grained entropy S maximum (equilibrium)

03How special was it? ── \(10^{10^{123}}\)

How rare was the universe's initial condition? Let's follow Penrose's famous estimate.

Order of magnitude ── the probability the Creator hit the target

Gather all the matter in the observable universe into one giant black hole and its entropy (from the Bekenstein–Hawking formula) is

$$S_{\max}\sim 10^{123}\,k_B$$

That is the largest entropy this universe could have. The actual entropy of the early universe, from photon counts and so on, was about \(10^{88}\,k_B\). Inverting Episode 1's \(S=k\log W\) gives \(W=e^{S/k}\), so

$$\frac{W_{\text{initial}}}{W_{\max}}\sim\frac{e^{10^{88}}}{e^{10^{123}}}\ \approx\ \frac{1}{10^{10^{123}}}$$

The denominator is a 1 followed by \(10^{123}\) zeros. Try to write it out and you will run out of elementary particles in the universe before you run out of digits. Penrose put it as: the Creator had to hit a target of \(1/10^{10^{123}}\) in phase space.

04Why is "uniform" low entropy? ── because of gravity

Here something counterintuitive happens. Photographs of the early universe (the cosmic microwave background) show it was almost perfectly uniform. Normally "uniformly mixed" means high entropy ── coffee with milk stirred in. So why is this extraordinarily low entropy?

The heart of this bonus ── with gravity, the story turns upside down
Low entropyHigh entropy
a gas (no gravity)bunched in one cornerspread out uniformly
matter with gravityspread out uniformlygathered into lumps (ultimately a black hole)

Gravity only attracts, so gathering is "more likely" ── more configurations. Hence for gravity, uniform is the anomalous state. The early universe being uniform means the gravitational degrees of freedom were entirely unexcited ── which Penrose formalised as the Weyl curvature hypothesis (the Weyl curvature, i.e. the gravitational degrees of freedom themselves, vanished in the early universe). The history of the universe is the process by which gravity slowly eats that entropy budget, turning uniformity into stars, galaxies and black holes. What we receive from the Sun is not heat so much as low entropy.

05And how this relates to the series

Here is the most important point of Bonus ①. Being able to coarse-grain is not enough to make a world interesting.

Had the universe started in thermal equilibrium, coarse-graining would work perfectly. Same temperature everywhere, same density. A handful of macroscopic variables would suffice and predictions would be 100% right. And nothing would happen. No structure, no layers, no chemistry, no life, no observers.

One line connecting back to the main series
$$\underbrace{\text{coarse-grainable}}_{\text{Episodes 1–4}}\ +\ \underbrace{\text{a special initial condition}}_{\text{this bonus}}\ =\ \underbrace{\text{layers, structure, an arrow of time}}_{\text{our world}}$$

The renormalization group guarantees "throw it away, same answer," but it does not guarantee that anything happens. The world has layers, and interesting things happen in them, because the universe began with \(10^{123}\) bits of headroom and still has not used it up. We live inside that headroom.

◇ ◇ ◇
The honest line ── the past hypothesis is a posit, not an explanation

Established: that the microscopic laws of mechanics are time-reversal symmetric (with the small exception of CP violation); that Loschmidt's reversal paradox and Zermelo's recurrence paradox follow; that the second law of thermodynamics therefore cannot be derived from mechanical laws alone; that in gravitating many-body systems the uniform state is low-entropy and the concentrated state high-entropy (negative heat capacity of gravitating systems); that black hole entropy is proportional to area; and that the maximum entropy of the observable universe is estimated at \(\sim10^{123}k_B\) ── all established physics and standard understanding.

Unsolved / under debate: (1) The past hypothesis itself is a posit, not an explanation. It does not answer "why was the initial condition like that?" (2) It is claimed that inflation explains the low-entropy initial condition, but the persistent objection that "inflation itself needs a low-entropy state to get going" has not been settled. (3) The Weyl curvature hypothesis is Penrose's proposal, not an established law. (4) Penrose's \(10^{10^{123}}\) depends on a particular way of estimating; treat it as a device for feeling the order of magnitude. (5) Whether "the entropy of the whole universe" can even be defined (how to count the entropy of the gravitational field; the system is not isolated) is itself debated in both physics and philosophy. ── This episode is a confirmation that the main series rests on another enormous assumption, not a resolution of it.

Exercises
  1. Why is "entropy increases because it's the law" wrong?
    See the answer
    Microscopic laws are time-reversal symmetric, so solutions with decreasing entropy exist in equal number (Loschmidt). It increases because "right now it is low," and from a low state the only destinations are the far more numerous high states ── a counting argument. So a low initial condition has to be supplied separately.
  2. Why can the early universe count as low entropy when it was "almost uniform"?
    See the answer
    Gravity only attracts, so matter has more configurations the more it clumps = higher entropy. In a gravitating system, therefore, uniform is low entropy. The uniformity of the early universe was the special state in which the gravitational degrees of freedom were entirely unexcited (the Weyl curvature hypothesis).
  3. What would not have happened if the universe had started at thermal equilibrium?
    See the answer
    Coarse-graining would work perfectly, but no structure, no layers and no arrow of time would arise. No stars, no chemistry, no life, no observers. Coarse-grainability alone does not make a world interesting; it has to be combined with a special initial condition.
  4. In the figure, entropy falls when you "reverse time." Is that a counterexample to the second law?
    See the answer
    Not a counterexample but a demonstration that the second law cannot be derived from the laws. The reversed state is perfectly legal but is a fantastically rare configuration in phase space. The chance of drawing it naturally is effectively zero, so we never see it ── that's all.

Bonus ① summaryThe arrow of time comes from the initial condition, not the laws

Because microscopic laws are time-reversal symmetric, the second law does not follow from coarse-graining alone (Loschmidt's reversal, Zermelo's recurrence). Entropy increases because "it is low now," and following that chain backwards runs into the beginning of the universe ── the past hypothesis. The specialness required is \(1/10^{10^{123}}\) by Penrose's estimate. And with gravity the story inverts: being uniform is what counts as low entropy (the Weyl curvature hypothesis). The history of the universe is gravity slowly eating that headroom.

And the connection back to the main series. Coarse-grainable + a special initial condition = layers, structure, an arrow of time. The renormalization group guarantees "throw it away, same answer" but does not guarantee that anything happens. In a universe that started at equilibrium, coarse-graining works perfectly and nothing occurs. We live in a layered, interesting world because the universe began with \(10^{123}\) bits of headroom and has not used it up.

This document is Bonus Episode ① of the "Renormalization That Clicks" series, a reading piece for physics-loving high-schoolers and undergraduates. The time-reversal symmetry of microscopic mechanical laws; Loschmidt's reversal paradox and the Zermelo/Poincaré recurrence paradox; that the second law cannot be derived from mechanical laws alone and requires a low-entropy initial condition (the past hypothesis); the low-entropy character of the uniform state in gravitating many-body systems; Bekenstein–Hawking entropy; the estimate \(\sim10^{123}k_B\) for the maximum entropy of the observable universe together with Penrose's evaluation \(1/10^{10^{123}}\) of the specialness of the initial condition; and the Weyl curvature hypothesis (Penrose's proposal) ── all established physics or widely known proposals. That the past hypothesis is a posit rather than an explanation, that the adequacy of an inflationary explanation is unsettled, that the Weyl curvature hypothesis is not an established law, that Penrose's number depends on the manner of estimation, and that the very definition of the entropy of the whole universe is debated, is spelled out in the body's "honest line." The figure is a demonstration using free particles reflecting off walls and computing \(S=-\sum p\ln p\) on a grid; it is not a molecular-dynamics simulation of a real gas. ── To print, use your browser's "Print" and "Save as PDF" (in the print version the slider and answers are frozen and hidden). Related: Episode 1, Throw it away, same answer / Bonus ②, An observer is a coarse-graining device / Contents / sister series Black Holes That Click.

Print / make a PDF: ⌘+P (Ctrl+P on Windows). On screen, "Start from the left half," "Reverse time" and "Start at equilibrium" let you confirm that the arrow of time comes from the initial condition. "See the answer" opens each solution.