{"id":"494c150e-12f1-437d-871e-513ac61363e8","arxiv_id":"2608.09156","paper_version":1,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"The EPS framework is a conceptual tool that locates esports performance breakdowns across strategy, tactics, tasks, actions, and operations, distinguishing mental errors from motor slips.","lead":"This paper introduces a new coaching framework for esports that sorts performance errors into five levels, from big-picture strategy down to physical button-press slips. Its goal is to give coaches a shared language for deciding whether a bad play was a thinking mistake or an execution slip.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The framework's central diagnostic claim presumes errors have a unique recoverable level, but level boundaries are not operationalized; the dragon example's 'tactical' verdict is a narrative elimination, not a rule-based finding.","rationale":"Good faith reading: the paper is a clearly scoped conceptual synthesis; it explicitly disclaims empirical validation and lists future work in Section 7. That does not remove the burden on the central claim, which is not merely 'proposes a vocabulary' but 'helps coaches diagnose ... by systematically locating' error levels. The weakest point is therefore not the transfer of soccer principles of play alone but the assumption that level assignment is a well-defined operation. If two trained coaches using the same framework can place the same dragon-sequence breakdown at different levels, then the framework cannot deliver the promised diagnosis; it can only relabel disagreement. The reader's weakest_assumption already contained this concern ('errors can be localized to one level'); I isolate it and sharpen it into an inter-rater reliability test. The principles-of-play transfer (Section 3.4) is real but secondary, because the tactical level could be re-anchored to esports-specific principles while preserving the hierarchy. The illustrative scenarios are carefully written but are constructed to have a clean answer; they do not demonstrate that real-world cases have one. Hence UNCHANGED: accept the conceptual contribution but require the empirical coding study before the diagnostic claim is taken as established.","tokens_in":17856,"tokens_out":4473,"duration_ms":46325,"concrete_test":"Take 20-30 short VOD-review clips from real League of Legends team sessions. Have 3-5 coaches or analysts trained only on Section 2.2 through Section 3.4 definitions independently assign each identified breakdown to exactly one EPS level and also mark whether they felt a single-level assignment was forced. Compute multi-rater free-marginal kappa for the level assignments. If kappa is below 0.6, or if coders judge more than 30% of clips as genuinely multi-level with no defensible primary level, the diagnostic logic is not operational and the central claim is not supported. If kappa is high and single-level assignments dominate, the concern is answered.","verdict_should_be":"UNCHANGED","load_bearing_attack":"Section 2.2 defines the five levels as 'interconnected', and Section 4.1 states that superiorities 'often interact' and are not 'exhaustive or mutually exclusive'. Yet the central claim (abstract; Section 5.2) is that a coach can 'locate' a breakdown at one level. The framework supplies no operational decision rule for assigning an observed event to a level: the levels are specified by verbal definitions, and Example 1 reaches its 'weakest structural link was located at the tactical layer' verdict by eliminating other levels ('no concentrated mechanical breakdown was identified'), rather than by applying a criterion that would yield the same answer for independent raters. The same dragon sequence could be coded as a task-level ambiguity (what 'consolidate' requires), an action-level divergence (locally coherent but uncoordinated choices), or a strategic gap (no post-objective rule), depending on the coder's framing. Because every real breakdown plausibly involves several levels, the assertion that the framework 'systematically' locates an origin level is not yet a diagnostic method; it is an interpretive vocabulary. The authors themselves restrict the implications to 'conceptual and applied possibilities rather than empirically validated outcomes' (Section 6), which is honest but leaves the central claim unsupported in its current form.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper introduces the Esports Performance Screening (EPS) framework, a conceptual synthesis of the Principles of Play from soccer, the Core Tasks Framework from gaming research, Wharton's stability/instability exchange model, and an author-defined taxonomy of superiorities. The framework organizes esports performance into five interconnected levels—strategy, tactics, tasks, actions, operations—and proposes two modes of use: diagnostic screening during reflective review and real-time screening during live play. Two hypothetical League of Legends scenarios illustrate how the framework can be used to locate the origin of a performance breakdown and to regulate decision-making after a major objective. The authors repeatedly state that the framework is not empirically validated and that its implications are conceptual and applied possibilities, with empirical testing deferred to future work.","tokens_in":18122,"tokens_out":3883,"duration_ms":39027,"significance":"The paper addresses a real gap in esports coaching: a lack of structured vocabulary for distinguishing mental mistakes from physical slips. Its integration of existing models into a single hierarchy is a useful pedagogical and analytical starting point, and it is transparent about its status as a conceptual synthesis rather than an empirically tested intervention. The explicit provenance of the component theories, the careful hedging throughout, and the concrete hypothetical illustrations are strengths. However, the central diagnostic claim—that the framework allows coaches to 'systematically locate' the origin of a breakdown—is underspecified because the level boundaries are not operationalized and the illustrative analysis is author-constructed rather than independently testable. With a modest reframing and an explicit application protocol, the framework could be a valuable foundation for future tool development and empirical study.","major_comments":[{"comment":"The central claim is that the framework enables coaches to 'systematically diagnose performance breakdowns' by locating errors at one of five hierarchical levels. In the dragon example, however, the tactical-layer verdict is reached by verbal elimination ('No concentrated mechanical breakdown was identified') rather than by applying a decision rule that an independent coder could apply. Given that §2.2 describes the levels as 'interconnected' and §4.1 states that superiorities 'often interact' and are not 'exhaustive or mutually exclusive', the framework currently supplies an interpretive vocabulary, not a diagnostic method. Please add an explicit decision procedure—for example, ordered questions, observable indicators per level, or exclusion rules—or soften the central claim to 'structured interpretation' rather than 'systematic diagnosis'.","section":"Abstract; §5.2 (Example Scenario 1)"},{"comment":"The superiority taxonomy is developed through iterative author discussion and informally stress-tested against game situations, and the categories are explicitly non-exhaustive and non-exclusive. This is acceptable for a descriptive vocabulary, but the manuscript then uses superiorities to explain transitions between stability and instability (§4.2) as if the taxonomy had empirical content. If 'superiority' is defined simply as 'game-relevant advantage', the statement that teams pursue superiorities is close to tautological, and the claim that superiorities drive stability/instability is not testable as stated. Please specify what would count as evidence for or against the taxonomy's usefulness—for example, inter-coder agreement on tagging gameplay events, or a prediction that certain superiority combinations precede objective outcomes.","section":"§2.1; §4.1; Table 3"},{"comment":"The framework imports the soccer Principles of Play and generalizes their terminology to invasion-based esports without an explicit justification of the mapping to MOBA mechanics. For example, 'Offensive Unity' and 'Balance' are defined abstractly, and the LoL illustration in §5.3 is the only concrete instantiation. If these principles do not map cleanly onto esports, the tactical-level diagnostic logic loses its foundation. Please provide a more systematic mapping of each principle to observable esports behaviours, or explicitly frame the transfer as a hypothesis to be tested in future work rather than as an established basis of the framework.","section":"§2.1; §3.4; Table 2"}],"minor_comments":[{"comment":"The sentence 'Superiorities are defined here as the game-relevant advantages ... (Table 2)' refers to a table that actually lists Principles of Play; the superiority taxonomy appears in Table 3. Please correct the cross-reference.","section":"§4.1"},{"comment":"The phrase 'the specific motor tasks which are preformed during the game' contains a typo: 'preformed' should be 'performed'.","section":"§2.3"},{"comment":"The sentence 'In invasion-games opponents offensive and defensive offensive decisions and behaviours can rapidly alter the balance of stability and instability' is garbled and should be rewritten for clarity.","section":"§3.4"},{"comment":"The abstract describes the framework as 'title-agnostic', but the illustrative material and most of the discussion are specific to League of Legends; the paper would benefit from an early clarification of the intended generalization, e.g., which structural features of MOBAs are assumed to carry over to other invasion-based esports.","section":"Abstract; §5"}],"recommendation":"major_revision","confidential_remarks":"The paper is an honest conceptual synthesis that clearly labels its own limitations, and I do not see any citation or disclosure issues. Its suitability for a venue such as CHI PLAY depends on whether the venue accepts purely conceptual framework papers without empirical evaluation; if so, the manuscript could be publishable after the requested revisions. The main risk is that the central 'systematic diagnosis' claim overstates what the framework currently delivers, and this should be addressed in revision."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"This is a useful conceptual synthesis, honestly labeled as unvalidated, but the word 'diagnose' in the abstract promises more than the operational definitions deliver. If you work on esports coaching or replay tools, the EPS framework is worth reading; if you are looking for a validated diagnostic instrument, it is not there yet.\n\nWhat is actually new is the integration. Soccer's Principles of Play, Hougaard and Knoche's core task framework, and Wharton's stability/instability model are combined into a five-level hierarchy (strategy, tactics, tasks, actions, operations) with a three-type superiority taxonomy and two modes of screening. That combination does not appear in the prior work cited here. The two League of Legends scenarios are clear and show how the vocabulary can shift a review conversation away from 'bad mechanics vs bad decision-making' toward a shared level-based vocabulary. The authors are also honest: Section 6 explicitly frames the implications as conceptual and applied possibilities rather than empirically validated outcomes.\n\nThe main soft spot is the one the stress-test note identifies. The central claim is that coaches can 'systematically locate' the origin of a breakdown, but no operational decision rule is provided for assigning an observed event to a level. The levels are defined verbally, and Example 1 reaches the tactical-layer verdict by ruling out the other layers rather than by applying a criterion that independent coders could reproduce. The same dragon sequence could reasonably be coded as task-level ambiguity, action-level divergence, or a strategic gap. The authors acknowledge that levels are interconnected and superiorities interact, but they never confront what that implies for unique-level diagnosis. So the framework currently is an interpretive vocabulary, not yet a diagnostic method. That is a meaningful gap between the abstract and the mechanics.\n\nTwo lesser points. The superiority taxonomy was built through author discussion and informal stress-testing, so inter-rater reliability is unknown; fine for a conceptual paper, but worth flagging. And the invasion-games definition is attributed to Palmer et al. while the reference list points to Lord et al. 2020, a minor mechanical error.\n\nWho this is for: researchers and practitioners in esports coaching, performance analysis, and HCI tool design. It deserves a serious referee. I would accept it with revisions that either soften the systematic-diagnosis claim or add a concrete coding procedure for level assignment, plus the citation fix.","headline":"Useful conceptual synthesis for esports coaching; the diagnostic claim outruns the operational definitions, but the vocabulary is genuinely worth having.","tokens_in":18625,"tokens_out":3532,"would_cite":true,"duration_ms":32790,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper argues that a five-level Esports Performance Screening framework lets coaches locate performance breakdowns at the strategic, tactical, task, action, or operational level, and distinguish mental mistakes from motor slips.","keywords":["esports","coaching","invasion games","principles of play","performance analysis","error diagnosis","League of Legends","stability–instability"],"falsifier":"Take a set of professional League of Legends matches, have multiple coaches independently use the EPS hierarchy to label the primary level of each critical error, and measure inter-rater agreement. If agreement is no higher than unstructured review, or if most errors are tagged at several levels at once, the diagnostic logic collapses. A second observation: if telemetry after objective captures shows that teams with clear tactical anchoring still lose advantage as often as teams with conflicting anchors, the framework's real-time screening claim would fail.","tokens_in":17644,"feed_emoji":"🎮","tokens_out":5691,"duration_ms":50316,"temperature":0.7,"pith_summary":"The paper argues that esports coaching lacks a structured way to tell mental errors from motor slips, and offers the Esports Performance Screening (EPS) framework to fill that gap. The framework maps performance onto five connected levels—strategy, tactics, tasks, actions, and operations—and claims that coaches working through this hierarchy during video review can pinpoint where a breakdown actually began, then choose a training response matched to that level. The same hierarchy is meant to work in compressed form during live play, where shared tactical principles act as quick anchors for coordination. The authors are explicit that the framework is a conceptual synthesis, not an empirically validated model; its case demonstrations are hypothetical League of Legends scenarios. If it works, it would give coaches a shared vocabulary for diagnosis, reduce misattribution of failures, and connect reflection to targeted practice.","feed_headline":"Esports coaching gets a five-level diagnostic for breakdowns","feed_subtitle":"Coaches can now separate mental errors from motor slips and target training to the right level.","key_machinery":"The central object is the five-level hierarchy of strategy, tactics, tasks, actions, and operations, assembled by integrating the Principles of Play from soccer, the Core Task Framework from gameplay research, and the Stability/Instability Exchange Model from interceptive sports coaching. The Principles of Play supply the tactical heuristics (e.g., Penetration, Delay, Balance, Offensive Unity); the Core Task Framework supplies the motor and perceptual task vocabulary (aiming, pointing, steering, activation); and the stability–instability cycle supplies the dynamic layer that lets coaches read whether a team's current plan can be sustained. A new taxonomy of superiorities—mechanical, contextual, and player—connects hierarchical decisions to the evolving game state. The mechanism does its work by making each failure type visible as a distinct level, so a coach can ask which level would yield the largest training gain.","core_discovery":"The central claim is that performance breakdowns in invasion-based esports can be located at one of five hierarchical levels, and that the observable outcome of a play does not reveal which level produced it. The EPS framework therefore gives coaches a diagnostic path: first check strategic alignment, then tactical principle selection, then task definition, then action-level judgement, then operational execution, distinguishing the standard mistakes-versus-slips split (wrong plan or interpretation versus right plan with failed execution). Across these levels, teams create, preserve, exploit, or deny superiorities—mechanical, contextual, and player advantages—and those superiorities drive transitions between stability and instability. The paper claims this structure works in two temporal modes: retrospective diagnostic screening during VOD review, and real-time screening where players use principles of play as heuristics under time pressure. Two illustrative League of Legends scenarios show instability arising from conflicting tactical principles after a dragon objective, rather than from mechanical failure.","pith_inferences":["Beyond the paper, the framework's taxonomy is testable as an annotation scheme: if expert raters tag VOD events with the five levels plus superiority types, one can measure inter-rater agreement; low agreement would indicate the levels are not as distinct as the diagnostic logic requires.","Beyond the paper, the claim that tactical incoherence after objectives is a common failure point in MOBAs could be tested with telemetry, e.g., measuring spatial dispersion in the seconds after a dragon or Baron capture; the framework predicts that coordinated transitions convert objective advantages into map control more often than fragmented ones.","Beyond the paper, the title-agnostic claim suggests the framework should transfer from MOBAs to shooters like Counter-Strike and Valorant; a comparative study across genres could identify which principles and superiority subtypes need game-specific calibration, thereby delimiting the framework's actual scope."],"forward_implications":["Coaches can move from vague labels like 'bad mechanics' or 'bad decision-making' to level-specific diagnoses, and each diagnosis maps to a different intervention: strategy work, clearer tactical principles, task clarification, situational judgement, or mechanical practice.","In post-game review, the hierarchy lets teams separate slips (operational execution failures) from mistakes (strategic or tactical reasoning failures), reducing the tendency to over-attribute losses to logical errors.","In live play, a compressed version of the hierarchy—anchoring to shared principles such as Balance before switching to Penetration—can help teams regulate transitions without traversing all five layers under time pressure.","The framework implies that replay tools and dashboards could tag events by level, principle of play, and superiority gained or lost, surfacing patterns such as repeated tactical incoherence during defence–attack transitions.","Teams gain a shared vocabulary that reduces cross-talk, because players analysing the same event at different levels can name those differences explicitly."],"supporting_citations":[{"why":"Supplies the Core Task Framework whose task, action, and operation levels distinguish motor–perceptual execution from conscious action selection.","marker":"[7]"},{"why":"Source of the tactical Principles of Play adapted to the strategy and tactics levels of the framework.","marker":"[26]"},{"why":"Provides the Stability/Instability Exchange Model used as the dynamic diagnostic layer for reading whether a team's plan can be sustained.","marker":"[32]"},{"why":"Supplies the mistakes-versus-slips distinction that motivates separating reasoning errors from execution failures.","marker":"[17]"},{"why":"Provides observational evidence that esports coaches focus on logical errors while physical slips are hard to detect, the gap the framework targets.","marker":"[12]"},{"why":"Earlier articulation of the Principles of Play used to ground the tactical heuristics in invasion games.","marker":"[6]"},{"why":"Reviews performance-analysis methods in team invasion sports, motivating the integration of strategic, tactical, and operational levels.","marker":"[13]"}],"fun_headline_variants":["Five-level EPS framework separates mental errors from motor slips","Esports breakdowns pinpointed to five levels with screening tool","Diagnostic path from strategy to execution for esports failures","Coaching aid distinguishes thinking errors from physical slips"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The framework assumes that tactical principles of play developed for soccer transfer to invasion-based esports and that each performance breakdown can be located at one of the five levels.","fun_headline_variants_meta":{"raw":{"variants":["Five-level EPS framework separates mental errors from motor slips","Esports breakdowns pinpointed to five levels with screening tool","Diagnostic path from strategy to execution for esports failures","Coaching aid distinguishes thinking errors from physical slips"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00036,"raw_usage":{"total_tokens":1948,"prompt_tokens":947,"completion_tokens":1001,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":563,"completion_tokens_details":{"reasoning_tokens":936}},"tokens_in":563,"tokens_out":1001,"duration_ms":9519,"temperature":1.0,"reasoning_tokens":936,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-11T22:26:02.301363+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Take a set of professional League of Legends matches, have multiple coaches independently use the EPS hierarchy to label the primary level of each critical error, and measure inter-rater agreement. If agreement is no higher than unstructured review, or if most errors are tagged at several levels at once, the diagnostic logic collapses. A second observation: if telemetry after objective captures shows that teams with clear tactical anchoring still lose advantage as often as teams with conflicting anchors, the framework's real-time screening claim would fail.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Source of the tactical Principles of Play adapted to the strategy and tactics levels of the framework."},{"cited_title":"2014.Expertise in Coaching Interceptive Sports: A Grounded Theory Model","cited_arxiv_id":null,"evidence_quote":"Provides the Stability/Instability Exchange Model used as the dynamic diagnostic layer for reading whether a team's plan can be sustained."},{"cited_title":"2013.The Design of Everyday Things(revised and expanded edition ed.)","cited_arxiv_id":null,"evidence_quote":"Supplies the mistakes-versus-slips distinction that motivates separating reasoning errors from execution failures."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Earlier articulation of the Principles of Play used to ground the tactical heuristics in invasion games."}],"review_version":1}