First order resonance overlap and the stability of close two planet systems

Motivated by the population of multi-planet systems with orbital period ratios 1<P2/P1<2, we study the long-term stability of packed two planet systems. The Hamiltonian for two massive planets on nearly circular and nearly coplanar orbits near a first order mean motion resonance can be reduced to a one degree of freedom problem (Sessin & Ferraz Mello (1984), Wisdom (1986), Henrard et al. (1986)). Using this analytically tractable Hamiltonian, we apply the resonance overlap criterion to predict the onset of large scale chaotic motion in close two planet systems. The reduced Hamiltonian has only a weak dependence on the planetary mass ratio, and hence the overlap criterion is independent of the planetary mass ratio at lowest order. Numerical integrations confirm that the planetary mass ratio has little effect on the structure of the chaotic phase space for close orbits in the low eccentricity (e <~0.1) regime. We show numerically that orbits in the chaotic web produced primarily by first order resonance overlap eventually experience large scale erratic variation in semimajor axes and are Lagrange unstable. This is also true of the orbits in this overlap region which are Hill stable. As a result, we can use the first order resonance overlap criterion as an effective stability criterion for pairs of observed planets. We show that for low mass (<~10 M_Earth) planetary systems with initially circular orbits the period ratio at which complete overlap occurs and widespread chaos results lies in a region of parameter space which is Hill stable. Our work indicates that a resonance overlap criterion which would apply for initially eccentric orbits needs to take into account second order resonances. Finally, we address the connection found in previous work between the Hill stability criterion and numerically determined Lagrange instability boundaries in the context of resonance overlap.