High-fidelity neutral atom gates leveraging low-rank Hessian optimization

Quantum optimal control can produce fast and robust multi-qubit gates, but experimentally calibrating the resulting high-dimensional waveforms remains challenging because direct searches over large parameter spaces converge slowly. Building on the low-rank structure of quantum-control landscapes, we develop and benchmark a Hessian-based calibration method for optimal-control gates. The method identifies the few waveform directions that affect fidelity to leading order, with the number of directions set by the accessible leakage and coherent error channels, and optimizes only within this principal space using closed-loop experimental feedback. We apply this approach to an amplitude-robust controlled-Z gate on metastable-state 171Yb nuclear-spin qubits. Experimentally, we verify the predicted Hessian-sensitive directions and demonstrate rapid convergence of the optimization protocol. The optimized gate reaches a raw fidelity of 0.9959(2), increasing to 0.99902(7) after postselection on no detected loss, and the performance is essentially unchanged under laser-power variations of up to 20%. We further show that the same fidelity Hessian directions can correct certain Hamiltonian parameter errors. These results establish low-rank Hessian optimization as an efficient and physically motivated calibration strategy for high-dimensional optimal-control gates, which is broadly applicable to many qubit types.