Reference articles on history, science, culture and more
Encyclopedia

Goodstein's theorem

Theorem about natural numbers

In mathematical logic, Goodstein's theorem is a statement about the natural numbers, proved by Reuben Goodstein in 1944, which states that every Goodstein sequence (as defined below) eventually terminates at 0. Laurence Kirby and Jeff Paris showed in 1982 that Goodstein's theorem is unprovable in Peano arithmetic (but it can be proven in stronger systems, such as second-order arithmetic or Zermelo-Fraenkel set theory). This was the third example of a true statement about natural numbers that is unprovable in Peano arithmetic, after the examples provided by Gödel's incompleteness theorem and Gerhard Gentzen's 1943 direct proof of the unprovability of ε0-induction in Peano arithmetic. The Paris-Harrington theorem gave another example.

Kirby and Paris also introduced a graph-theoretic hydra game with behavior similar to that of Goodstein sequences: the "Hydra" (named for the mythological multi-headed Hydra of Lerna) is a rooted tree, and a move by "Hercules" consists of cutting off one of its "heads" (a branch of the tree), to which the Hydra responds by growing a finite number of new heads according to certain rules. Kirby and Paris proved that the Hydra will eventually be killed, regardless of the strategy that Hercules uses to chop off its heads, though this may take a very long time. Just like for Goodstein sequences, Kirby and Paris showed that it cannot be proven in Peano arithmetic alone.

01Hereditary base-n notation

Goodstein sequences are defined in terms of a concept called "hereditary base-n notation". This notation is very similar to usual base-n positional notation for natural numbers, but the usual notation does not suffice for the purposes of Goodstein's theorem.

To achieve the ordinary base-n notation, where n is a natural number greater than 1, an arbitrary natural number m is written as a sum of multiples of powers of n:

m=a_{k}n^{k}+a_{k-1}n^{k-1}+\cdots +a_{0},

where each coefficient ai satisfies 0 ≤ ai < n, and ak ≠ 0.

For example, the base-3 notation of 100:

100=81+18+1=3^{4}+2\cdot 3^{2}+3^{0}.

Here, the exponents of n themselves are not written in base-n notation, as is seen in the case 34, above.

To convert a base-n notation to a hereditary base-n notation, first rewrite all of the exponents as a sum of powers of n (with the limitation on the coefficients 0 ≤ ai < n). Then rewrite any exponent inside the exponents again in base-n notation (with the same limitation on the coefficients), and continue in this way until every number appearing in the expression (except the bases themselves) is written in base-n notation.

For example, 100 in hereditary base-3 notation is

100=3^{3^{1}+1}+2\cdot 3^{2}+1.

02Goodstein sequences

The Goodstein sequence G_{m} of a number m is a sequence of natural numbers. The first element in the sequence, written as G_{m}(1), is m itself. The second element, G_{m}(2), is obtained by writing m in hereditary base-2 notation, changing all the 2s to 3s, then subtracting 1 from the result. In general, the term G_{m}(n+1) of the Goodstein sequence of m is computed by:

  • taking the hereditary base-(n + 1) representation of G_{m}(n),
  • replacing each occurrence of the base (n + 1) with n + 2, then
  • subtracting one.

G_{m}(n+1) depends both on G_{m}(n) and on the index n. Sometimes G_{m}(n) is written as G_{n-1}(m).

A Goodstein sequence terminates when its element reaches 0. Early Goodstein sequences terminate quickly. For example, G_{3} terminates at the sixth step (the column labeled "Hereditary notation" shows how the value is calculated):

BaseHereditary notationValueComputation
22^{1}+13
33^{1}+1-1=3^{1}3Obtained by writing the last element (3) in hereditary base-2 notation, replacing all 2s with 3s, then subtracting 1.
44^{1}-1=33Obtained by writing the last element (3) in hereditary base-3 notation, replacing all 3s with 4s, then subtracting 1.
53-1=22Obtained by subtracting the last element (3) by 1, since there are no 4s to replace.
62-1=11Obtained by subtracting the last element (2) by 1, since there are no 5s to replace.
71-1=00Obtained by subtracting the last element (1) by 1, since there are no 6s to replace.

Later Goodstein sequences increase for a very large number of steps. For example, G_{4} starts as follows (OEIS: A056193):

BaseHereditary notationValue
22^{2^{1}}4
33^{3^{1}}-1=2\cdot 3^{2}+2\cdot 3^{1}+226
42\cdot 4^{2}+2\cdot 4^{1}+141
52\cdot 5^{2}+2\cdot 5^{1}60
62\cdot 6^{2}+2\cdot 6-1=2\cdot 6^{2}+6^{1}+583
72\cdot 7^{2}+7^{1}+4109
\vdots\vdots\vdots
112\cdot 11^{2}+11^{1}253
122\cdot 12^{2}+12^{1}-1=2\cdot 12^{2}+11299
\vdots\vdots\vdots
242\cdot 24^{2}-1=24^{2}+23\cdot 24^{1}+231151
\vdots\vdots\vdots
B=3\cdot 2^{402\,653\,209}-12\cdot B^{1}3\cdot 2^{402\,653\,210}-2
B=3\cdot 2^{402\,653\,209}2\cdot B^{1}-1=B^{1}+(B-1)3\cdot 2^{402\,653\,210}-1
\vdots\vdots\vdots

Elements of G_{4} continue to increase for a while, but at base 3\cdot 2^{402\,653\,209}, they reach the maximum of 3\cdot 2^{402\,653\,210}-1, stay there for the next 3\cdot 2^{402\,653\,209} steps, and then begin descending by 1, reaching 0 when the base reaches 3\cdot 2^{402\,653\,211}-1. The exponent here is equal to 3\cdot 2^{27}+27, so the base is equal to n\cdot 2^{n}-1, a Woodall number with n=3\cdot 2^{27}.

For another example, G_{19} increases much more rapidly and starts as follows:

Hereditary notationValue
2^{2^{2}}+2^{1}+119
3^{3^{3}}+3^{1}7625597484990
4^{4^{4}}+3\approx 1.3\times 10^{154}
5^{5^{5}}+2\approx 1.8\times 10^{2\,184}
6^{6^{6}}+1\approx 2.6\times 10^{36\,305}
7^{7^{7}}\approx 3.8\times 10^{695\,974}

8^{8^{8}}-1=7\cdot 8^{7\cdot 8^{7}+7\cdot 8^{6}+7\cdot 8^{5}+7\cdot 8^{4}+7\cdot 8^{3}+7\cdot 8^{2}+7\cdot 8+7} {}+7\cdot 8^{7\cdot 8^{7}+7\cdot 8^{6}+7\cdot 8^{5}+7\cdot 8^{4}+7\cdot 8^{3}+7\cdot 8^{2}+7\cdot 8+6}+\cdots {}+7\cdot 8^{8+2}+7\cdot 8^{8+1}+7\cdot 8^{8} {}+7\cdot 8^{7}+7\cdot 8^{6}+7\cdot 8^{5}+7\cdot 8^{4} {}+7\cdot 8^{3}+7\cdot 8^{2}+7\cdot 8^{1}+7

\approx 6.0\times 10^{15\,151\,335}

7\cdot 9^{7\cdot 9^{7}+7\cdot 9^{6}+7\cdot 9^{5}+7\cdot 9^{4}+7\cdot 9^{3}+7\cdot 9^{2}+7\cdot 9+7} {}+7\cdot 9^{7\cdot 9^{7}+7\cdot 9^{6}+7\cdot 9^{5}+7\cdot 9^{4}+7\cdot 9^{3}+7\cdot 9^{2}+7\cdot 9+6}+\cdots {}+7\cdot 9^{9+2}+7\cdot 9^{9+1}+7\cdot 9^{9} {}+7\cdot 9^{7}+7\cdot 9^{6}+7\cdot 9^{5}+7\cdot 9^{4} {}+7\cdot 9^{3}+7\cdot 9^{2}+7\cdot 9^{1}+6

\approx 5.6\times 10^{35\,942\,384}
\vdots\vdots

In spite of this rapid growth, Goodstein's theorem states that every Goodstein sequence eventually terminates at 0, no matter what the starting value is.

03Proof of Goodstein's theorem

Goodstein's theorem can be proved (using techniques outside Peano arithmetic, see below) as follows: Given a Goodstein sequence G_{m}, we construct a parallel sequence P_{m} of ordinal numbers in Cantor normal form that is strictly decreasing and terminates. A common misunderstanding of this proof is to believe that G_{m} goes to 0 because it is dominated by P_{m}. Actually, the fact that P_{m} dominates G_{m} plays no role at all. The important point is: G_{m}(k) exists if and only if P_{m}(k) exists (parallelism), and comparison between two members of G_{m} is preserved when comparing corresponding entries of P_{m}. Then if P_{m} terminates, so does G_{m}. By infinite regress, G_{m} must reach 0, which guarantees termination.

We define a function f=f(u,k) that computes the hereditary base k representation of u and then replaces each occurrence of the base k with the first infinite ordinal number \omega. For example, f(100,3)=f(3^{3^{1}+1}+2\cdot 3^{2}+1,3)=\omega ^{\omega ^{1}+1}+\omega ^{2}\cdot 2+1=\omega ^{\omega +1}+\omega ^{2}\cdot 2+1.

Each term P_{m}(n) of the sequence P_{m} is then defined as f(G_{m}(n),n+1). For example, G_{3}(1)=3=2^{1}+2^{0} and P_{3}(1)=f(2^{1}+2^{0},2)=\omega ^{1}+\omega ^{0}=\omega +1. Addition, multiplication and exponentiation of ordinal numbers are well defined.

We claim that f(G_{m}(n),n+1)>f(G_{m}(n+1),n+2):

Let G'_{m}(n) be G_{m}(n) after applying the first, base-changing operation in generating the next element of the Goodstein sequence, but before the second minus 1 operation in this generation. Observe that G_{m}(n+1)=G'_{m}(n)-1.

Then f(G_{m}(n),n+1)=f(G'_{m}(n),n+2). Now we apply the minus 1 operation, and f(G'_{m}(n),n+2)>f(G_{m}(n+1),n+2), as G'_{m}(n)=G_{m}(n+1)+1.

For example, G_{4}(1)=2^{2} and G_{4}(2)=2\cdot 3^{2}+2\cdot 3+2, so f(2^{2},2)=\omega ^{\omega } and f(2\cdot 3^{2}+2\cdot 3+2,3)=\omega ^{2}\cdot 2+\omega \cdot 2+2, which is strictly smaller. Note that in order to calculate f(G_{m}(n),n+1), we first need to write G_{m}(n) in hereditary base n+1 notation, as for instance the expression \omega ^{\omega }-1 is not an ordinal.

Thus the sequence P_{m} is strictly decreasing. As the standard order < on ordinals is well-founded, an infinite strictly decreasing sequence cannot exist, or equivalently, every strictly decreasing sequence of ordinals terminates (and cannot be infinite). But P_{m}(n) is calculated directly from G_{m}(n). Hence the sequence G_{m} must terminate as well, meaning that it must reach 0.

While this proof of Goodstein's theorem is fairly easy, the Kirby-Paris theorem, which shows that Goodstein's theorem is not a theorem of Peano arithmetic, is technical and considerably more difficult. It makes use of countable nonstandard models of Peano arithmetic.

Extended Goodstein's theorem

The above proof still works if the definition of the Goodstein sequence is changed so that the base-changing operation replaces each occurrence of the base b with b+2 instead of b+1. More generally, let b_{1}, b_{2}, b_{3},\ldots be any non-decreasing sequence of integers with b_{1}\geq 2. Then let the (n+1)st term G_{m}(n+1) of the extended Goodstein sequence of m be as follows:

  • Take the hereditary base b_{n} representation of G_{m}(n).
  • Replace each occurrence of the base b_{n} with b_{n+1}.
  • Subtract one.

A simple modification of the above proof shows that this sequence still terminates. For example, if b_{n}=4 and if b_{n+1}=9, then f(3\cdot 4^{4^{4}}+4,4)=3\omega ^{\omega ^{\omega }}+\omega =f(3\cdot 9^{9^{9}}+9,9), hence the ordinal f(3\cdot 4^{4^{4}}+4,4) is strictly greater than the ordinal f{\big (}(3\cdot 9^{9^{9}}+9)-1,9{\big )}.

The extended version is in fact the one considered in Goodstein's original paper, where Goodstein proved that it is equivalent to the restricted ordinal theorem (i.e. the claim that transfinite induction below ε0 is valid), and gave a finitist proof for the case where m\leq b_{1}^{b_{1}^{b_{1}}} (equivalent to transfinite induction up to \omega ^{\omega ^{\omega }}).

The extended Goodstein's theorem without any restriction on the sequence bn is not formalizable in Peano arithmetic (PA), since such an arbitrary infinite sequence cannot be represented in PA. This seems to be what kept Goodstein from claiming back in 1944 that the extended Goodstein's theorem is unprovable in PA due to Gödel's second incompleteness theorem and Gentzen's proof of the consistency of PA using ε0-induction. However, inspection of Gentzen's proof shows that it only needs the fact that there is no primitive recursive strictly decreasing infinite sequence of ordinals, so limiting bn to primitive recursive sequences would have allowed Goodstein to prove an unprovability result. Furthermore, with the relatively elementary technique of the Grzegorczyk hierarchy, it can be shown that every primitive recursive strictly decreasing infinite sequence of ordinals can be "slowed down" so that it can be transformed to a Goodstein sequence where b_{n}=n+1, thus giving an alternative proof to the same result Kirby and Paris proved.

04Sequence length as a function of the starting value

The Goodstein function, {\mathcal {G}}:\mathbb {N} \to \mathbb {N}, is defined such that {\mathcal {G}}(n) is the length of the Goodstein sequence that starts with n. (This is a total function since every Goodstein sequence terminates.) The extremely high growth rate of {\mathcal {G}} can be calibrated by relating it to various standard ordinal-indexed hierarchies of functions, such as the functions H_{\alpha } in the Hardy hierarchy, and the functions f_{\alpha } in the fast-growing hierarchy of Löb and Wainer:

  • Kirby and Paris (1982) proved that
{\mathcal {G}} has approximately the same growth-rate as H_{\epsilon _{0}} (which is the same as that of f_{\epsilon _{0}}); more precisely, {\mathcal {G}} dominates H_{\alpha } for every \alpha <\epsilon _{0}, and H_{\epsilon _{0}} dominates {\mathcal {G}}\,\!.
(For any two functions f,g:\mathbb {N} \to \mathbb {N}, f is said to dominate g if f(n)>g(n) for all sufficiently large n.)
  • Cichon (1983) showed that
{\mathcal {G}}(n)=H_{R_{2}^{\omega }(n+1)}(1)-1,
where R_{2}^{\omega }(n) is the result of putting n in hereditary base-2 notation and then replacing all 2s with ω (as was done in the proof of Goodstein's theorem).
  • Caicedo (2007) showed that if n=2^{m_{1}}+2^{m_{2}}+\cdots +2^{m_{k}} with m_{1}>m_{2}>\cdots >m_{k}, then
{\mathcal {G}}(n)=f_{R_{2}^{\omega }(m_{1})}(f_{R_{2}^{\omega }(m_{2})}(\cdots (f_{R_{2}^{\omega }(m_{k})}(3))\cdots ))-2.

Some examples:

n {\mathcal {G}}(n)
1 2^{0} 2-1 H_{\omega }(1)-1 f_{0}(3)-2 2
2 2^{1} 2^{1}+1-1 H_{\omega +1}(1)-1 f_{1}(3)-2 4
3 2^{1}+2^{0} 2^{2}-1 H_{\omega ^{\omega }}(1)-1 f_{1}(f_{0}(3))-2 6
4 2^{2} 2^{2}+1-1 H_{\omega ^{\omega }+1}(1)-1 f_{\omega }(3)-2 3·2402653211 − 2 ≈ 6.895080803×10121210694
5 2^{2}+2^{0} 2^{2}+2-1 H_{\omega ^{\omega }+\omega }(1)-1 f_{\omega }(f_{0}(3))-2 > A(4,4) > 10101019727
6 2^{2}+2^{1} 2^{2}+2+1-1 H_{\omega ^{\omega }+\omega +1}(1)-1 f_{\omega }(f_{1}(3))-2 > A(6,6)
7 2^{2}+2^{1}+2^{0} 2^{2+1}-1 H_{\omega ^{\omega +1}}(1)-1 f_{\omega }(f_{1}(f_{0}(3)))-2 > A(8,8)
8 2^{2+1} 2^{2+1}+1-1 H_{\omega ^{\omega +1}+1}(1)-1 f_{\omega +1}(3)-2 > A3(3,3) = A(A(61, 61), A(61, 61))
\vdots
12 2^{2+1}+2^{2} 2^{2+1}+2^{2}+1-1 H_{\omega ^{\omega +1}+\omega ^{\omega }+1}(1)-1 f_{\omega +1}(f_{\omega }(3))-2 > fω+1(64) > Graham's number
\vdots
19 2^{2^{2}}+2^{1}+2^{0} 2^{2^{2}}+2^{2}-1 H_{\omega ^{\omega ^{\omega }}+\omega ^{\omega }}(1)-1 f_{\omega ^{\omega }}(f_{1}(f_{0}(3)))-2

(For Ackermann function and Graham's number bounds see fast-growing hierarchy § Functions in fast-growing hierarchies.)

05Application to computable functions

Goodstein's theorem can be used to construct a total computable function that Peano arithmetic cannot prove to be total. The Goodstein sequence of a number can be effectively enumerated by a Turing machine; thus the function that maps n to the number of steps required for the Goodstein sequence of n to terminate is computable by a particular Turing machine. This machine merely enumerates the Goodstein sequence of n and, when the sequence reaches 0, returns the length of the sequence. Because every Goodstein sequence eventually terminates, this function is total. But because Peano arithmetic does not prove that every Goodstein sequence terminates, Peano arithmetic does not prove that this Turing machine computes a total function.

Watch videos about Goodstein's theoremExplainers and documentaries on YouTube (opens in a new tab)

Sources and credits

This article is adapted from the Wikipedia article Goodstein's theorem, written by its contributors and licensed under CC BY-SA 4.0. Fathomly has changed the layout, removed citation markers, navigation and maintenance notices, and adjusted punctuation. This adapted version is shared under the same license. For references, see the original article.

Fathomly is not affiliated with or endorsed by the Wikimedia Foundation. Spotted a problem? Tell us.