When is a quantum heat engine quantum?

Quantum thermodynamics studies quantum effects in thermal machines. But when is a heat engine, which cyclically interacts with external reservoirs that unavoidably destroy its quantum coherence, really quantum? We here use the Leggett-Garg inequality to assess the nonclassical properties of a single two-level Otto engine. We provide the complete phase diagram characterizing the quantumness of the engine as a function of its parameters and identify three distinct phases. We further derive an explicit expression for the transition temperature.