REVIEW
Living with Ghosts
High Energy Physics - Theory · Submitted 11 Jul 2001 · 12 references
Pith's verdict: The free-theory calculation is exact and the α→0 check is real, but the step to gravity is an extrapolation from a free scalar, and the cross-term sign in Eq. 22 deserves a careful look.
T0 · AI review
Why Pith says this
Highlight any text to comment on it.
Referee report
The paper
The paper claims
Higher-derivative gravity may survive its ghosts: the negative-norm states that seemed to kill curvature-squared quantum gravity are an artifact of the canonical method, and the probabilities one actually observes stay positive and relax to
The reading
What carries the argument
The load-bearing calculation is the Euclidean path integral for the higher-derivative harmonic oscillator, $S = ∫dτ[ (α^2/2) φ_{,ττ}^2 + (1/2) φ_{,τ}^2 + (1/2) m^2 φ^2 ]$, whose Gaussian integral is done exactly in Appendix A. Splitting $φ = φ_{cl} + φ'$ gives an exponent built from the classical action with coefficient functions $E, F, G, H, K, L$ and a state-independent prefactor fixed by the Jacobian of the change of variables. Two further objects carry the argument: the ground-state wave function $Ψ_0(φ_0, φ_{0,τ})$, which is a bounded Gaussian in Euclidean signature, and its Euclidean conjugate, whose product gives the normalizable distribution $P(φ_0, φ_{0,τ})$. Integrating that distribution over $φ_{0,τ}$ produces the observable probability $P(φ_0)$, and the same trace applied to the sandwiched transition amplitude produces the observable transition probability whose $α → 0$ limit is the second-order result.
Extended reading notes
Core claim
The paper's claim is that a fourth-order (higher-derivative) scalar field theory, and by extension $R + R^2$ gravity, can be given a consistent set of rules for computing probabilities even though its free propagator is the difference of two second-order propagators, one of which enters with the wrong sign. The authors locate the source of the ghost not in the theory but in the canonical procedure: treating $φ$ and $□φ$ as independent variables splits the field into $ψ_1$ and $ψ_2$ with opposite-sign actions, and the $ψ_2$ path integral then diverges. If instead one defines the theory by a Euclidean path integral over $φ$, the free action is positive definite and the integral converges. The price is that a quantum state must be specified by $φ$ and $φ_{,τ}$ on a spacelike surface; the corresponding probability distribution is normalizable in Euclidean signature but grows without bound after Wick rotation in the $φ_{,τ}$ direction, so $φ_{,τ}$ cannot be observed. Tracing over $φ_{,τ}$ on the final surface yields a density matrix rather than a pure state — unitarity is lost — but every probability so obtained is positive and normalized. For the higher-derivative oscillator the traced-out transition probability is computed in closed form and, as $α → 0$, reduces exactly to the second-order expression $P(φ_2,φ_1) = (m/2π) (1/π) ... $ of Eq. (22), i.e. to the ordinary quantum mechanics of a second-order field.
Load-bearing premise
The argument rests on the assumption that the Euclidean path integral over $φ$ alone, with its positive-definite fourth-order free action and with $φ_{,τ}$ traced out, defines the correct Lorentzian quantum theory — and that the $α → 0$ agreement demonstrated for the free oscillator survives once interactions and gravity are switched on.
Editorial extensions
If this is right
- Curvature-squared corrections to gravity need not be discarded on ghost grounds: they can be treated as a low-energy effective theory whose predictions match ordinary (second-order) gravity to excellent accuracy at presently accessible energies.
- The loss of unitarity is a loss of information, not a loss of positivity — the final state is described by a density matrix, so no experiment can record a negative probability or a negative-norm state.
- In the early universe, where the fourth-order terms matter, the relevant quantities are $n$-point functions of metric perturbations (and hence of microwave-background fluctuations), not scattering amplitudes or an S-matrix, so the question of unitarity does not arise there.
- Runaway production of positive- and negative-energy modes is removed by the Euclidean path integral's implicit final boundary condition that fields die off, at the cost of acausal behaviour on a timescale set by the inverse ghost mass.
- Because the acausal scale in gravity is tied to a mass, the associated time advance is logarithmic in impact parameter, so no standard arrival time exists against which the violation could be registered.
Reading between the lines
- The argument's real hinge is dimensional: if the ghost mass $m_2$ is pushed to the Planck scale, the acausal and non-unitary corrections are suppressed by powers of $E/m_2$, which would make the effective theory quantitatively safe for all accelerator and cosmological data — a suppression the paper asserts but does not estimate.
- Tracing out $φ_{,τ}$ is equivalent to declaring that only the combination $ψ_1 - ψ_2$ appears on external legs; this suggests a sharper statement than the paper gives, namely that the ghost is confined to internal lines and never appears as asymptotic radiation, which is the property an effective-field-theory reader would want proved.
- The same Euclidean-then-trace prescription could in principle be applied to other theories with wrong-sign kinetic terms (higher-derivative inflation, Lee-Wick models), and would predict a common signature: decoherence without negative probability, i.e. a density matrix whose off-diagonal terms decay at a rate set by the higher-derivative coefficient.
- A natural check the paper does not perform is whether the traced-out probability respects Lorentz invariance beyond the free theory; since $φ_{,τ}$ is tied to a chosen time slicing, an interacting calculation could reveal frame dependence that the free oscillator cannot show.
Original abstract
Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. Higher derivatives seem to lead to ghosts, states with negative norm. We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $\phi$ and $\Box \phi $ are regarded as two independent variables. Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. The path integral requires that quantum states be specified by the values of $\phi$ and $\phi_{,\tau}$. To calculate probabilities for observations, one has to trace out over $\phi_{,\tau}$ on the final surface. Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. Hence unitarity is restored at the low energies that now occur in the universe.
The compiled record
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
The abstract, sentence by sentence
Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. Higher derivatives seem to lead to ghosts, states with negative norm. We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $\phi$ and $\Box \phi $ are regarded as two independent variables. Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. The path integral requires that quantum states be specified by the values of $\phi$ and $\phi_{,\tau}$. To calculate probabilities for observations, one has to trace out over $\phi_{,\tau}$ on the final surface. Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. Hence unitarity is restored at the low energies that now occur in the universe.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. | background 1.00 | 0.07 | 0.03 | asserted 1.00 |
| s1 | Higher derivatives seem to lead to ghosts, states with negative norm. | background 1.00 | 0.05 | 0.03 | hedged possibility 0.95 |
| s2 | We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $\phi$ and $\Box \phi $ are regarded as two independent variables. | contribution 0.71 | 0.87 | 0.12 | asserted 1.00 |
| s3 | Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. | method 0.96 | 0.86 | 0.05 | asserted 0.99 |
| s4 | The path integral requires that quantum states be specified by the values of $\phi$ and $\phi_{,\tau}$. | method 0.97 | 0.51 | 0.05 | asserted 1.00 |
| s5 | To calculate probabilities for observations, one has to trace out over $\phi_{,\tau}$ on the final surface. | method 0.98 | 0.51 | 0.07 | asserted 1.00 |
| s6 | Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. | result 0.80 | 0.82 | 0.53 | asserted 0.99 |
| s7 | It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. | result 0.99 | 0.90 | 0.18 | asserted 1.00 |
| s8 | Hence unitarity is restored at the low energies that now occur in the universe. | interpretation 0.86 | 0.68 | 0.45 | asserted 0.99 |
What was examined, and what was not
- arXiv listing abstract v2
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
References
How later papers used it
68 later papers cite it
1 later paper by other authors is listed below: 1 used its method or tool.
Uses its method or tool 1 of 2 papers with this label
-
Following this paper, defined the path integral by specifying the field and its first time derivative on initial and final time slices.
Cancelling the vacuum energy and Weyl anomaly in the standard model with dimension-zero scalar fields (2021) · 1.00 · paraphrased: the licence does not allow quoting
How the literature uses it
59 arXiv papers cite this in 91 sentences
Papers citing it · 62 sentences without a confident label
Builds on it 1 paper
-
We can see that the probability can be integrated over all values of $|γ_0|$ giving a sensible extension of the method in [ref] to the sixth order case.
Tackling Higher Derivative Ghosts with the Euclidean Path Integral · The de Sitter background · 1.00
Uses its method or tool 1 paper
-
Following Hawking and Hertog [ref] , we define the path integral by specifying $φ$ and its first time derivative $φ_,τ$ on initial and final time slices.
Cancelling the vacuum energy and Weyl anomaly in the standard model with dimension-zero scalar fields · No ghosts · 1.00
Compares with it 1 paper
-
Both the Cutkowski et al. contour deformation [ref] and also the Hertog and Hawking [ref] approach are, classically, equivalent to adopting stability as a future boundary condition.
A New Formulation of the Initial Value Problem for Nonlocal Theories · Conclusions · 0.91
Cites it as support 5 papers
-
Since the mass of the ghost is $m∼ηM_p$, as long as $η$ is not fine tuned to values $≪1$, the ghost is massive, can be integrated out and there is no instability in the theory [ref] .
Standard Model in conformal geometry: local vs gauged scale invariance · Weyl integrable geometry and Einstein gravity · 0.99
-
Because mass states degenerated there is no conflict in this case with unitarity (see [ref] ).
On superluminal fermions within the second derivative equation · Conclusion · 1.00
-
It does affect the unitarity of the theory, but one does not create such a state in the initial or final state of the theory [ref] .
The fall and the rise of Weyl gauge theory · [1]. Weyl conformal geometry and its symmetry · 0.98
Cites it as background 17 papers
-
Despite the ubiquity of the effective field theory idea, alternative procedures have been proposed to deal with higher derivative terms in the action [ref] .
Tackling Higher Derivative Ghosts with the Euclidean Path Integral · Introduction · 0.93
-
These results are familiar from the many discussions of the (four-derivative) Pais-Uhlenbeck oscillator [ref] in the recent literature [ref] .
Cancelling the vacuum energy and Weyl anomaly in the standard model with dimension-zero scalar fields · No ghosts · 0.98
-
The existence of runaway solutions in higher order theories has been first pointed out by Dirac [ref] in his classic paper, and in the context of quadratic gravity, in [ref] [ref] .
Divergences of the scalar sector of quadratic gravity · Introduction. · 0.87
Discussion
Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.