{"id":"0101cc6f-8acb-4def-98b1-09e31f85fa8d","arxiv_id":"1908.02691","paper_version":2,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":4,"one_line_summary":"By quenching a D-Wave 2000Q at many intermediate anneal times, the authors measure how the solution energy and individual qubit values evolve, and use an engineered QUBO to visualize per-qubit freeze-out.","lead":"This paper uses the D-Wave 2000Q's custom anneal scheduling to 'slice' the annealing run at many intermediate times, capturing approximate snapshots of the solution as it evolves. It then watches individual qubits flip and freeze during the process, and introduces a genetic algorithm that constructs optimization problems for which those changes are especially dramatic.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Quench-based slicing assumes the fast ramp from s(t) to 1 freezes the state at time t, but this is unvalidated; the GA-optimized QUBO may amplify quench artifacts, so inferred freeze-out points could be spurious.","rationale":"Both the reader and I identify the unvalidated quench assumption as the load-bearing point. The paper's own caveat in Section 2.1 ('we expect this jump to not considerably change the solution') is an assertion, not evidence, and the omission of the pause-based comparison weakens the claim. A further aggravating factor, not explicitly raised by the reader, is that the genetic algorithm's fitness function (Section 2.2) directly rewards large apparent changes under the slicing technique, so the optimized QUBO is selected to maximize any quench artifact. Thus the key visualization results may be partly circular. A control experiment varying quench duration would provide a decisive test. If the trajectories are insensitive to quench duration, the method is likely sound; if not, the verdict should remain conditional or become reject. Since the reader already set CONDITIONAL, I do not change the verdict.","tokens_in":7418,"tokens_out":6633,"duration_ms":70577,"concrete_test":"Repeat the slicing experiment for the optimized QUBO with quench durations of 1 μs and 10 μs (jump to s=1 at t+1 vs t+10) at identical slice times; if the measured energy/Hamming trajectories or the inferred freeze-out points differ by more than the reported error bars, the quench is not a faithful freeze of the state at time t.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central method rests on the assumption in Section 2.1 that quenching from s(t) to s=1 at t+1 'freezes' the solution as it was at slice time t. This is not validated. The quench is a finite-time ramp (1 μs) during which the Hamiltonian changes from H(s(t)) to H(1); the state can evolve non-adiabatically, causing bit flips and energy changes that are then attributed to the anneal itself. The authors justify this only by an expectation (Section 2.1: 'we expect this jump to not considerably change the solution, due in large part to the properties our genetic algorithm optimizes for'), and they mention investigating pause-based schedules (Section 2.1) but do not show the comparison. Moreover, the genetic algorithm (Section 2.2) selects QUBOs by maximizing the Hamming distance between the 1 μs slice and the full anneal, measured using this very slicing technique. The optimized QUBO is therefore chosen to amplify any artifact the quench introduces, so the pronounced evolution in Figures 5-7 and the inferred freeze-out points in Section 3.5 may be dominated by quench-induced transitions rather than genuine anneal dynamics.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper introduces 'slicing', an experimental technique for probing the intermediate dynamics of a D-Wave 2000Q quantum annealer. Using the custom anneal-schedule feature, the authors follow the standard anneal curve up to a chosen time t and then quench the anneal fraction to 1 at time t+1, assuming that this fast ramp freezes the solution as it was at time t. Repeating this over many slice times produces an approximate per-slice distribution of solutions, from which the evolution of the minimum energy (Figure 5), the Hamming distance between adjacent slices (Figure 6), and per-qubit freeze-out points (Figure 7) are inferred. To make the dynamics visible, the authors use a genetic algorithm that selects QUBO instances whose 1-microsecond-versus-1000-microsecond energy difference and whose Hamming distance between the 1-microsecond slice and the full anneal are large, and they compare these optimized instances with random QUBOs (Figures 3-4). The main findings are that the optimized QUBO displays pronounced energy decrease and bit-flip activity during the first half of the anneal with a freeze-out at roughly slice 600 of 1000, that the energy and Hamming-distance freeze-out points roughly coincide, and that many qubits never flip while actively flipping qubits appear to cluster on the chimera graph.","tokens_in":7817,"tokens_out":10029,"duration_ms":91437,"significance":"If the central assumption holds, the slicing technique would be a genuinely new observational tool for commercial quantum annealers, enabling direct study of freeze-out, thermalization, and bit dynamics that are otherwise unobservable from final readouts. The paper is clearly written, the experimental protocol is described in enough detail to be reproduced, results (except Figure 4) carry error bars based on 10 runs of 1000 anneals, and the authors are appropriately modest, framing the work as a first attempt and explicitly flagging the expectation underlying the quench. The decisive weakness is that the validity of the quench assumption is not demonstrated anywhere in the manuscript, and the genetic-algorithm fitness function partially selects for quantities measured by the very technique whose validity is in question. These issues are fixable with additional experiments, but they are load-bearing for the paper's conclusions.","major_comments":[{"comment":"The paper's central methodological assumption, that quenching from the anneal fraction s(t) to s=1 at time t+1 preserves the solution state as of time t, is stated as an expectation rather than being validated. The text reads 'we expect this jump to not considerably change the solution, due in large part to the properties our genetic algorithm optimizes for', and while the authors say they investigated pause-based schedules with 'qualitatively similar' results, that comparison is not shown. During the 1-microsecond quench the Hamiltonian sweeps through intermediate values of the A(s)/B(s) ratio, and the state can evolve non-adiabatically, so bit flips and energy changes occurring during the ramp would be misattributed to the anneal itself. Since the energy trajectories of Section 3.3, the Hamming-distance trajectories of Section 3.4, and the per-qubit freeze-out points of Section 3.5 all inherit this assumption, the manuscript should provide a direct validation, for instance by comparing quench slices with pause-then-quench schedules at matched times or by demonstrating insensitivity of the measured slice distributions to the quench ramp rate.","section":"Section 2.1"},{"comment":"The genetic-algorithm fitness function fQ = Δ·(d/n·100) includes the Hamming distance d between the 1-microsecond slice, measured through the slicing technique, and the full 1000-microsecond anneal. If the quench induces spurious bit flips, the GA will preferentially select QUBO instances in which those artifacts are largest, so the pronounced evolution in Figures 5-7 and the freeze-out points of Section 3.5 may partly reflect amplified quench artifacts rather than genuine anneal dynamics. The energy term Δ is independent of the slicing technique, but the Hamming term is not, so the concern is concrete. A test would be to recompute the fitness with d obtained from an independent probe (for example a pause-based schedule or reverse-annealing measurement) and to check whether the inferred freeze-out points and trajectories are stable; alternatively, the method could be validated on instances with a known intermediate classical state.","section":"Section 2.2"},{"comment":"Figure 4, which is the central comparison between the random and the GA-optimized QUBO, is the only figure without error bars; the paper itself states that 'The results of the following subsections are reported with error bars, with the exception of Figure 4'. This figure supports two load-bearing claims: that the optimized QUBO shows a significantly larger energy decrease during the anneal and that both curves plateau around slice 600, which motivates the freeze-out definition in Section 3.2. Without error bars, or without the same 10 runs of 1000 anneals averaging used elsewhere, the separation between the curves and the flatness of the plateaus cannot be assessed, so the figure should be regenerated using the standard error-bar procedure.","section":"Figure 4"}],"minor_comments":[{"comment":"The phrase 'by inserting a pause is the anneal schedule' contains a typo and should read 'by inserting a pause in the anneal schedule'.","section":"Section 1"},{"comment":"The sentence 'This process, referred to as quenching, and is a standard feature provided by the D-Wave 2000Q' is ungrammatical; a main verb is missing.","section":"Section 2.1"},{"comment":"The horizontal axis of Figure 2 is labeled 'anneal time [ms]', which is inconsistent with the text and experiments, which report times in microseconds.","section":"Figure 2"},{"comment":"The Hamiltonian written in the introduction, H(s) = -A(s)/2 Σ ai σx_i + B(s)/2 (Σ σz_i + Σ aij σz_i σz_j), differs from the Hamiltonian in the QPU property box: the linear coefficients ai multiply the transverse-field term, and the longitudinal-field term omits the local fields hi. This is presumably a typographical error, but it should be corrected so the theory section is consistent with the QUBO definition and with the D-Wave Hamiltonian.","section":"Section 1, Eq. (1)"},{"comment":"The hardware constraint 'the maximal degree of the anneal curve to not exceed 45 degrees' is unclear; if this is a slope constraint on the anneal function, it deserves a brief clarification because it is the stated reason for jumping at t+1 rather than at t.","section":"Section 2.1"},{"comment":"The clustering observation is phrased as 'It also seems as if qubits with either low or high rates of bit flips somehow cluster together', and the leakage explanation is presented as known fact without a citation; the clustering could be quantified (for example with a spatial correlation statistic) or the wording softened.","section":"Section 3.5"},{"comment":"The freeze-out point is defined as 'roughly slice 600' by visual inspection of the curves; since the freeze-out point is one of the paper's main quantities, the definition could be made more precise, for example as the first slice after which the mean energy change stays below a threshold.","section":"Section 3.2"}],"recommendation":"major_revision","confidential_remarks":"The decisive issue for my verdict is the unvalidated quench assumption in Section 2.1. The authors state they already ran pause-based schedules with qualitatively similar results, yet that comparison is not in the paper; if that data exists, adding it would substantially strengthen the manuscript and would likely resolve the main objection. I would also ask the editor to treat the missing error bars in Figure 4 as a correctness issue rather than a presentation issue, since the freeze-out definition rests on it. The self-citations are proportionate to the topic, and I see no novelty disclosure problem."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: this is a genuinely new way to probe intermediate anneal dynamics on D-Wave 2000Q, and the per-qubit freeze-out maps are a nice visualization. But the central assumption—that a fast quench from s(t) to s=1 preserves the state at time t—is asserted, not demonstrated, and the one validation check they mention (pause-based slices) is described but never shown. That soft spot is load-bearing.\n\nWhat is new: previous work used pauses to improve solution quality; this paper uses quench schedules as a measurement tool, slicing at many points and tracking energy, Hamming distance, and individual qubit values. The genetic algorithm for finding QUBOs with pronounced evolution is straightforward and the parameter study is honest. They have real hardware data with error bars on most figures, and they explicitly report the exception, Figure 4. That is good practice.\n\nWhere I have trouble: Section 2.1 says a jump from intermediate s to 1 at t+1 is expected \"to not considerably change the solution\" because of the GA-optimized properties. That expectation is doing all the work. A 1 μs ramp is finite-time and non-adiabatic; the state can evolve during the quench, especially when the problem Hamiltonian is already strong. If that happens, the measured energy and bit strings at slice t are not the unperturbed anneal states. The authors mention investigating pause-based schedules and getting \"qualitatively similar\" results, but no comparison figure or numbers appear. Given that a pause comparison is exactly the control needed—holding the Hamiltonian fixed rather than ramping it—omitting it undermines the central claim. Moreover, the GA fitness uses the same slicing technique to maximize Hamming distance between a 1 μs slice and full anneal. So the optimized QUBO is selected to make the quench look like dramatic evolution. That doesn't make the result false, but it makes it possible that freeze-out points are artifacts of the quench, not physical features of the anneal. The paper itself could be right; the point is we have no evidence yet.\n\nAlso Figure 4 has no error bars, and it is the figure that justifies the whole GA approach. They say explicitly no error bars there; that is a hole in the key comparison. And all the strong claims about freeze-out come from a single engineered QUBO, so generalization to random or real problems is unearned. The authors do frame the paper as a first step, which softens this.\n\nWho should read it: anyone working on D-Wave schedule design or trying to understand thermalization and freeze-out empirically. It deserves a serious referee, not a desk reject, but the referee should require either a pause-versus-quench control, a simulation of the quench, or both before the method is trusted.","headline":"A genuinely new slicing technique for peeking inside a D-Wave anneal, but the freeze assumption is unvalidated and the GA-optimized instances may amplify exactly the artifact the method needs to rule out.","tokens_in":8179,"tokens_out":2187,"would_cite":false,"duration_ms":23136,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":["03.67.Lx","85.25.-j"],"model":"deepseek-v4-flash","headline":"Quench-slicing reveals when each qubit freezes in a quantum anneal.","keywords":["quantum annealing","D-Wave 2000Q","anneal schedule","quenching","slicing","freeze-out point","QUBO","genetic algorithm"],"falsifier":"Run the same optimized QUBO with a pause-and-hold schedule at each slice time instead of a quench, and compare the energy and Hamming trajectories; a systematic divergence would show that the quench itself alters the state being measured.","tokens_in":7210,"feed_emoji":"⚛️","tokens_out":8035,"duration_ms":82464,"temperature":0.7,"pith_summary":"Quantum annealers only return the final bit string of each anneal, leaving the evolution of the solution invisible. This paper tries to make that evolution observable by using the D-Wave 2000Q's programmable anneal schedule: at a chosen time t, the anneal is quenched to the full anneal, and the readout is taken as an approximate snapshot of the state at t. Repeating this 'slicing' at many times gives an approximate distribution of solutions across the anneal. The authors use the method to show where the energy stops improving, when individual qubits freeze into their final values, and that qubits with high bit-flip rates cluster on the chip. The value is a direct experimental window into a process that was previously only inferred from final outputs.","feed_headline":"Slicing a quantum anneal shows when each qubit freezes","feed_subtitle":"Quench jumps at chosen slice times turn the hidden evolution of a D-Wave anneal into measurable snapshots.","key_machinery":"The mechanism is 'slicing': a custom anneal schedule that follows the normal curve to time t, then includes a near-vertical quench to the full anneal at t+1, freezing the state for readout. The hardware constraint that the anneal curve slope stay within 45 degrees means the jump is not perfectly vertical, so the paper defines the last slice as the full anneal and assumes the quench does not materially change the solution. A genetic algorithm is the supporting device: it searches over QUBOs, scoring each by the energy decrease and percentage of bit flips between a 1 microsecond slice and a full 1000 microsecond anneal, in order to produce instances where the slice-resolved evolution is pronounced enough to visualize.","core_discovery":"The central claim is that the anneal process of the D-Wave 2000Q can be meaningfully dissected. By following the standard anneal curve up to a slice time t and then jumping to anneal fraction 1 at t+1, the machine returns a solution that approximates the state at t; repeating this for many t yields a slice-resolved picture of energy and bit-string evolution. The paper reports that for a QUBO engineered to evolve strongly during annealing, the best energy stays nearly flat for the first quarter of the anneal, then drops steadily, and freezes near the anneal midpoint, with the Hamming distance between adjacent slices following the same trend. On the individual-qubit level, most qubits keep their initial measured value, while a minority flip at high rates and cluster together, consistent with chip leakage. These observations are offered as a first direct look at freeze-out dynamics in a commercial quantum annealer.","pith_inferences":["One step beyond the paper: the per-qubit freeze-out map could be used as a calibration diagnostic, since qubits that flip at high rates in one QUBO should be tested against other instances before being attributed to the problem structure.","The assumption that quenching is non-perturbative is testable in simulation: evolving the same Hamiltonian with and without the quench and comparing slice distributions would quantify how much the jump itself distorts the snapshot.","For minor-embedded problems, applying slicing to chains rather than individual qubits could reveal when logical chains decohere, which is a natural extension of the method."],"forward_implications":["The anneal can be probed at arbitrary intermediate times, giving an empirical freeze-out time for every qubit rather than a single final readout.","Energy trajectories show a plateau followed by a sharp decline and then stabilization, so slice-resolved measurements can indicate when additional anneal time stops improving solution quality.","Hamming-distance curves between adjacent slices provide a second, independent signature of the same freeze-out point.","Bit-flip maps of the chip support the picture of neighbor-to-neighbor leakage and could be used to study crosstalk in annealing hardware."],"supporting_citations":[{"why":"This supplies the hardware specification for programmable anneal schedules and the quenching feature that the slicing procedure is built on.","marker":"D-Wave Systems (2019a)"},{"why":"This provides the A(s) and B(s) anneal-curve functions used to construct the slice schedules and to interpret the energy scales.","marker":"D-Wave Systems (2019b)"},{"why":"This sets out the quantum annealing process whose intermediate evolution the paper aims to observe.","marker":"D-Wave Systems (2017)"}],"fun_headline_variants":["Slicing D-Wave anneal reveals qubit freeze-out points","Quantum anneal sliced: watch qubits freeze mid-run","Peeking at anneal steps: when each qubit freezes","Slice-by-slice view of D-Wave anneal dynamics"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that the near-vertical quench from slice time t to full anneal at t+1 preserves the solution as it was at t, so the measured snapshot is not itself changed by the jump.","fun_headline_variants_meta":{"raw":{"variants":["Slicing D-Wave anneal reveals qubit freeze-out points","Quantum anneal sliced: watch qubits freeze mid-run","Peeking at anneal steps: when each qubit freezes","Slice-by-slice view of D-Wave anneal dynamics"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000198,"raw_usage":{"total_tokens":1359,"prompt_tokens":928,"completion_tokens":431,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":544,"completion_tokens_details":{"reasoning_tokens":358}},"tokens_in":544,"tokens_out":431,"duration_ms":4488,"temperature":1.0,"reasoning_tokens":358,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T14:37:03.693210+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run the same optimized QUBO with a pause-and-hold schedule at each slice time instead of a quench, and compare the energy and Hamming trajectories; a systematic divergence would show that the quench itself alters the state being measured.","supporting_citations":[{"cited_title":"Quantum Computing for the Real World Today https://www.dwavesys.com/sites/default/files/D-Wave-Overview-Jan2017F3.pdf","cited_arxiv_id":null,"evidence_quote":"This sets out the quantum annealing process whose intermediate evolution the paper aims to observe."}],"review_version":1}