Pith. Sign in

REVIEW

Living with Ghosts

High Energy Physics - Theory · Submitted 11 Jul 2001 · 12 references

Pith's verdict: The free-theory calculation is exact and the α→0 check is real, but the step to gravity is an extrapolation from a free scalar, and the cross-term sign in Eq. 22 deserves a careful look.

T0 · AI review

How this review was made: An AI referee (selfhosted/deepseek-v4.1-flash) read the paper on November 11, 2026 and answered a fixed list of questions about it. T0 is the starting level every paper gets. The levels describe how deeply Pith has checked the paper, never the authors.

  1. T0 AI review An AI read the paper and answered a fixed list of questions.
  2. T1 Audit Automatic checks that the references and files the paper relies on exist and match.
  3. T2 Compute The paper's code or calculations re-run with the same results.
  4. T3 Formal statement The claims written out in a formal math language a computer can read.
  5. T4 Proof Those claims proved, and the proof checked by computer.

How Pith checks papers →

· 5 major objections · 6 minor · Ask about this paper · The compiled record · Read the full review →
Challenge this review Comment (0) Read on arXiv ↗
Cite ▾
arXiv IDhep-th/0107088 (version 2)
Pith IDLUB6N6V3, Pith's permanent record of this paper and its review
CitationS.W. Hawking, Thomas Hertog. "Living with Ghosts." arXiv:hep-th/0107088 (2001). https://pith.science/paper/LUB6N6V3
Cite this reviewBibTeX for Pith's review of this paper
Claim paper

Why Pith says this

Highlight any text to comment on it.

Referee report
The paper

The paper claims

Higher-derivative gravity may survive its ghosts: the negative-norm states that seemed to kill curvature-squared quantum gravity are an artifact of the canonical method, and the probabilities one actually observes stay positive and relax to

The reading

Einstein's action plus curvature-squared corrections is renormalizable, but it appears to carry ghosts — quantum states of negative norm that would make some probabilities negative and the S-matrix non-unitary. Hawking and Hertog argue that the ghost is an artifact of the canonical treatment, which promotes $φ$ and $□φ$ to independent coordinates even though both are determined by $φ$. Quantizing instead with a Euclidean path integral over $φ$ alone, where the fourth-order free action is positive definite, forces states to be labelled by $φ$ and $φ_{,τ}$; because the Lorentzian distribution for $φ_{,τ}$ is unbounded, one must trace over it, which costs unitarity but never produces a negative norm or a negative probability. Working the fourth-order harmonic oscillator exactly, they show that the traced-out transition probability tends to the second-order answer as the coefficient $α$ of the fourth-order term goes to zero, so any departure from unitarity is negligible at the energies that occur in the universe today.

What carries the argument

The load-bearing calculation is the Euclidean path integral for the higher-derivative harmonic oscillator, $S = ∫dτ[ (α^2/2) φ_{,ττ}^2 + (1/2) φ_{,τ}^2 + (1/2) m^2 φ^2 ]$, whose Gaussian integral is done exactly in Appendix A. Splitting $φ = φ_{cl} + φ'$ gives an exponent built from the classical action with coefficient functions $E, F, G, H, K, L$ and a state-independent prefactor fixed by the Jacobian of the change of variables. Two further objects carry the argument: the ground-state wave function $Ψ_0(φ_0, φ_{0,τ})$, which is a bounded Gaussian in Euclidean signature, and its Euclidean conjugate, whose product gives the normalizable distribution $P(φ_0, φ_{0,τ})$. Integrating that distribution over $φ_{0,τ}$ produces the observable probability $P(φ_0)$, and the same trace applied to the sandwiched transition amplitude produces the observable transition probability whose $α → 0$ limit is the second-order result.

Extended reading notes

Core claim

The paper's claim is that a fourth-order (higher-derivative) scalar field theory, and by extension $R + R^2$ gravity, can be given a consistent set of rules for computing probabilities even though its free propagator is the difference of two second-order propagators, one of which enters with the wrong sign. The authors locate the source of the ghost not in the theory but in the canonical procedure: treating $φ$ and $□φ$ as independent variables splits the field into $ψ_1$ and $ψ_2$ with opposite-sign actions, and the $ψ_2$ path integral then diverges. If instead one defines the theory by a Euclidean path integral over $φ$, the free action is positive definite and the integral converges. The price is that a quantum state must be specified by $φ$ and $φ_{,τ}$ on a spacelike surface; the corresponding probability distribution is normalizable in Euclidean signature but grows without bound after Wick rotation in the $φ_{,τ}$ direction, so $φ_{,τ}$ cannot be observed. Tracing over $φ_{,τ}$ on the final surface yields a density matrix rather than a pure state — unitarity is lost — but every probability so obtained is positive and normalized. For the higher-derivative oscillator the traced-out transition probability is computed in closed form and, as $α → 0$, reduces exactly to the second-order expression $P(φ_2,φ_1) = (m/2π) (1/π) ... $ of Eq. (22), i.e. to the ordinary quantum mechanics of a second-order field.

Load-bearing premise

The argument rests on the assumption that the Euclidean path integral over $φ$ alone, with its positive-definite fourth-order free action and with $φ_{,τ}$ traced out, defines the correct Lorentzian quantum theory — and that the $α → 0$ agreement demonstrated for the free oscillator survives once interactions and gravity are switched on.

Editorial extensions

If this is right

  • Curvature-squared corrections to gravity need not be discarded on ghost grounds: they can be treated as a low-energy effective theory whose predictions match ordinary (second-order) gravity to excellent accuracy at presently accessible energies.
  • The loss of unitarity is a loss of information, not a loss of positivity — the final state is described by a density matrix, so no experiment can record a negative probability or a negative-norm state.
  • In the early universe, where the fourth-order terms matter, the relevant quantities are $n$-point functions of metric perturbations (and hence of microwave-background fluctuations), not scattering amplitudes or an S-matrix, so the question of unitarity does not arise there.
  • Runaway production of positive- and negative-energy modes is removed by the Euclidean path integral's implicit final boundary condition that fields die off, at the cost of acausal behaviour on a timescale set by the inverse ghost mass.
  • Because the acausal scale in gravity is tied to a mass, the associated time advance is logarithmic in impact parameter, so no standard arrival time exists against which the violation could be registered.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The argument's real hinge is dimensional: if the ghost mass $m_2$ is pushed to the Planck scale, the acausal and non-unitary corrections are suppressed by powers of $E/m_2$, which would make the effective theory quantitatively safe for all accelerator and cosmological data — a suppression the paper asserts but does not estimate.
  • Tracing out $φ_{,τ}$ is equivalent to declaring that only the combination $ψ_1 - ψ_2$ appears on external legs; this suggests a sharper statement than the paper gives, namely that the ghost is confined to internal lines and never appears as asymptotic radiation, which is the property an effective-field-theory reader would want proved.
  • The same Euclidean-then-trace prescription could in principle be applied to other theories with wrong-sign kinetic terms (higher-derivative inflation, Lee-Wick models), and would predict a common signature: decoherence without negative probability, i.e. a density matrix whose off-diagonal terms decay at a rate set by the higher-derivative coefficient.
  • A natural check the paper does not perform is whether the traced-out probability respects Lorentz invariance beyond the free theory; since $φ_{,τ}$ is tied to a chosen time slicing, an interacting calculation could reveal frame dependence that the free oscillator cannot show.
Original abstract

Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. Higher derivatives seem to lead to ghosts, states with negative norm. We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $\phi$ and $\Box \phi $ are regarded as two independent variables. Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. The path integral requires that quantum states be specified by the values of $\phi$ and $\phi_{,\tau}$. To calculate probabilities for observations, one has to trace out over $\phi_{,\tau}$ on the final surface. Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. Hence unitarity is restored at the low energies that now occur in the universe.

The compiled record

The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.

Compiled by classifier-1.13-20260917 via OpenRouter, question bank abstract-p1-20260923, 2026-09-23: 1 request, 6,730 input tokens, $0.0003 reported.

What the abstract itself states, as probabilities: claims first 0.03 · states limitation 0.90 · human participants 0.01 · controlled comparison 0.12 · randomized assignment 0.01 · states quantitative result 0.06 · compares with prior results 0.84 · mentions code or data availability 0.02.

The abstract, sentence by sentence

arXiv listing abstract v2. Results and the main claim are underlined; .

Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. Higher derivatives seem to lead to ghosts, states with negative norm. We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $\phi$ and $\Box \phi $ are regarded as two independent variables. Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. The path integral requires that quantum states be specified by the values of $\phi$ and $\phi_{,\tau}$. To calculate probabilities for observations, one has to trace out over $\phi_{,\tau}$ on the final surface. Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. Hence unitarity is restored at the low energies that now occur in the universe.

background contribution method result interpretation main claim

What the classifier reports for each sentence. The number is the probability it gave the label.
#sentencerolethe authors' own workstates the main conclusionstrength
s0 Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. background 1.00 0.07 0.03 asserted 1.00
s1 Higher derivatives seem to lead to ghosts, states with negative norm. background 1.00 0.05 0.03 hedged possibility 0.95
s2 We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $\phi$ and $\Box \phi $ are regarded as two independent variables. contribution 0.71 0.87 0.12 asserted 1.00
s3 Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. method 0.96 0.86 0.05 asserted 0.99
s4 The path integral requires that quantum states be specified by the values of $\phi$ and $\phi_{,\tau}$. method 0.97 0.51 0.05 asserted 1.00
s5 To calculate probabilities for observations, one has to trace out over $\phi_{,\tau}$ on the final surface. method 0.98 0.51 0.07 asserted 1.00
s6 Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. result 0.80 0.82 0.53 asserted 0.99
s7 It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. result 0.99 0.90 0.18 asserted 1.00
s8 Hence unitarity is restored at the low energies that now occur in the universe. interpretation 0.86 0.68 0.45 asserted 0.99

What kind of paper the classifier reports this is: theoretical result 0.99 · evidence from proof or derivation 0.99.

What was examined, and what was not

sources read
  • arXiv listing abstract v2
not examined
  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers
levels run
  • P abstract
not run
  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. Every number in the measurements table is the authors', checked by code. Record as JSON

References
How later papers used it

68 later papers cite it

Evidence: substantial. 67 of the citing papers share no author with it, and 11 of those carry a confident label from Pith's citation classifier.

Pith read 22 of the 100 citing sentences, choosing only those whose citation markers point at this paper alone, and wrote the paraphrases from them. The summary, the counts, the evidence level, the links and the quotes come from code; the summary counts the papers listed below. A later paper is listed under a label when Pith's citation classifier gives one of its sentences that label at probability 0.8 or more (0.95 for support), Pith's reading finds that the citing paper itself did it, and a second check confirms the paraphrase against the sentence. This section lists uses only. It does not list criticism or disagreement, so their absence here says nothing about how the paper has been received. Papers that share an author with this one are listed apart, under "By the same authors". A quote is the citing authors' own sentence, shown when their paper's licence is CC BY, CC BY-SA or CC0. JSON

Uses its method or tool 1 of 2 papers with this label
How the literature uses it

59 arXiv papers cite this in 91 sentences

Each citing sentence is taken from the citing paper's LaTeX source and typed by Pith's classifier. A label appears at probability 0.8 or more (0.95 for support), a contest at 0.7 or more; the quoted words are the citing authors'. How each label was checked · JSON

Papers citing it · 62 sentences without a confident label

Builds on it 1 paper
Uses its method or tool 1 paper
Compares with it 1 paper
Cites it as support 5 papers
Cites it as background 17 papers

Discussion

Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.