{"id":"63fe0ab2-3dee-480f-9a28-a3c3d4926d73","arxiv_id":"2608.08034","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A workshop with 27 XR and HCI researchers produces a structured design framework, Empathy-Driven Reality, that re-centers XR design on empathy across three themes.","lead":"This paper introduces Empathy-Driven Reality (EDR), a conceptual design framework that organizes extended reality (XR) design around empathy, based on a two-month workshop with 27 researchers. It offers three themes, design guidelines, and a research agenda for building more inclusive and emotionally aware XR spaces.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The EDR framework's generalizability is the load-bearing assumption: the design space is built from a self-selected, co-author expert panel with acknowledged underrepresentation, and the manuscript does not test whether independent designers can apply it.","rationale":"The reader's CONDITIONAL verdict is appropriate. I agree in substance with the weakest assumption: external validity of a self-selected, co-author expert panel is not established. My framing adds specificity: the missing evidence is not just a larger or more diverse panel, but a demonstration that the framework is usable by independent designers and yields added value over existing guidance. The paper's own limitation section (Section 6) names external reviewers, independent member checking, and dissensus sessions as future work, which is the honest location of the weakness. I do not see an internal inconsistency that warrants rejection; the claims are carefully scoped as conceptual. However, the central claim's usefulness depends on exactly this validation, so conditional acceptance is appropriate, and the proposed test would settle whether the concern lands.","tokens_in":24699,"tokens_out":4979,"duration_ms":76332,"concrete_test":"Run a pre-registered between-subjects design exercise: recruit 12–16 XR practitioners with no affiliation to the authors and no prior exposure to EDR; randomly assign them to either (A) the EDR framework (themes plus Table 2) or (B) a matched set of existing guidelines on accessibility, privacy, and affective computing; ask each to produce a design concept for a fixed social XR scenario (e.g., a cross-reality collaboration task with one deaf user). Have independent judges, blind to condition, rate the concepts on coverage of empathic concerns, identification of tensions, and novelty, and code whether the concepts reflect distinct EDR mechanisms. If condition A does not outperform B on coverage or tension identification, or if practitioners cannot apply the framework, the generalizability claim is not supported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim (Section 7) is that EDR offers a structured design space—three themes, 16 design implications, and the Table 2 mechanisms—that future XR systems can use as a foundation. That claim requires the framework to be more than one group's shared vocabulary. The evidence base is a two-month workshop with 27 experts recruited as co-authors (Section 2.1), only 12 of whom completed all rounds; six organisers, including the first author, did the coding, with 87% agreement reported only on an initial subset (Section 2.3). The paper is transparent: Section 6 concedes optimism bias from the authorship-as-participation model and underrepresentation of cognitive neuroscience, environmental psychology, animal-computer interaction, non-Western design traditions, and lived-experience experts. But this limitation is load-bearing because Sections 5.2 and 7 present the framework as a foundation for the field, not as a description of this group's priors. Moreover, the Table 2 mapping from themes to design mechanisms and the three Section 5.2 scenarios are explicitly author-synthesized analytical projections, not validated deployments. Nothing in the manuscript shows that an independent XR designer, given Table 2, would produce designs or identify tensions that differ from what existing accessibility, privacy, and affective-computing guidance already provides. If the framework is not generalizable or not actionable, the contribution reduces to a plausible but unsubstantiated reorganisation.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper introduces Empathy-Driven Reality (EDR), a conceptual design framework for XR that places empathy at the center of design across avatars, environments, and interactions. Building on a two-month hybrid workshop with 27 industry and academic researchers recruited as co-authors, the paper derives three overarching themes, five definitions, five challenges, 16 design implications, and four potential applications, organized into a treemap design space (Figure 1) and a table linking themes to conceptual requirements and design mechanisms (Table 2). The paper explicitly frames EDR as a conceptual framework rather than a validated system, and it presents three illustrative scenarios to show how the design space could be applied. The contribution is claimed to be a reorganization of familiar XR concerns around empathy as a single design principle, with the value lying in the named tensions between design goals.","tokens_in":24947,"tokens_out":3648,"duration_ms":38437,"significance":"If the framework is adopted as intended, it could provide a useful shared vocabulary and a structured starting point for future empathy-centered XR research and practice. The paper is transparent about its methodology and limitations, including the authorship-as-participation model, optimism bias, and underrepresentation of several perspectives (Section 6). It also explicitly exposes its load-bearing assumptions: the design space is prospective, the scenarios are analytical projections, and future validation with users beyond the authorship group is needed. However, the significance of the paper as a generalizable design space is not yet established, because the evidence base is the consensus of a self-selected group of experts who are all co-authors, and the analysis was performed by the organizing team from the same group. The notion that the framework 'sets the agenda for empathy-driven XR' (Section 7) is a strong claim that goes beyond what the presented data and analysis can currently support.","major_comments":[{"comment":"The central claim that EDR provides a generalizable structured design space rests on the opinions of a group in which every contributor is a co-author and the analysis is performed by the organizing team drawn from the same group. Section 6 acknowledges optimism bias, but the circularity is not addressed: the findings reduce to the shared perspective of the paper's own authors. To sustain the claim in Section 7 that EDR 'sets the agenda for empathy-driven XR,' the manuscript should either re-frame the contribution as a position paper presenting this group's perspective, or provide independent validation such as external expert review, a study in which non-author designers apply Table 2 to a design task, or a dissensus-oriented analysis that examines the framework against critical external input.","section":"§2.1, §7"},{"comment":"The report of '87% agreement' on an initial subset is insufficient to characterize the reliability of the analysis. The manuscript does not state how many excerpts were in the initial subset, how the agreement percentage was computed, or whether the two coders came from different backgrounds. More critically, the remaining data were coded through 'iterative author meetings' involving the organizing team, so the final themes and tensions are effectively the product of consensus coding rather than independent inter-rater agreement. This is acceptable for exploratory qualitative research, but the paper should provide a fuller account of the coding process and ideally an audit trail or an external check, especially because the resulting themes are presented as a foundation for the field rather than as one group's interpretation.","section":"§2.3"},{"comment":"Table 2 is presented as 'the concrete levers' through which the EDR requirements can be met, and the three scenarios are offered as illustrations of applicability. However, Section 5.2 states the scenarios are 'author-synthesized analytical projections rather than validated deployments,' and Section 6 says the design space 'should be interpreted as prospective and generative.' No evidence is provided that an independent designer can use Table 2 to produce designs that differ from existing accessibility, privacy, or affective-computing guidance, nor that the named tensions are specific to EDR. Given the explicit claim that EDR is a foundation for future systems, at least a small-scale evaluation of the table's actionability and distinctiveness would materially strengthen the argument.","section":"§5.2, Table 2, §6"},{"comment":"The related work section is explicitly 'a synthesis of the literature shared by each contributor,' and the findings in Section 4 are presented with participant IDs but without supporting quotes, excerpts, or a data appendix. This makes it difficult for a reader to verify that the themes and tensions are grounded in the workshop data rather than imposed by the organizers. The paper would be strengthened by representative quotes or a supplementary appendix with coded excerpts, so that the link between the workshop activities and the resulting design space is transparent.","section":"§3, §4"}],"minor_comments":[{"comment":"The typo 'Y et' appears repeatedly where 'Yet' is intended; please correct throughout.","section":"§4.1.2, §4.2.1, §4.2.2, §4.3.1, §5.1"},{"comment":"The 'Y ear(s)' column uses arrows such as '→7 years,' which is non-standard and should be formatted consistently (e.g., '7 years' or '>7 years').","section":"Table 1"},{"comment":"The 'privacy avatar' concept is introduced as a design idea but does not appear in the design mechanisms listed in Table 2; consider adding it or explaining why it is not a mechanism.","section":"§4.2.2"},{"comment":"The DOI placeholders ('xx.xxxx/TVCG.201x.xxxxxxx/') should be replaced with the actual DOI or removed before publication.","section":"Copyright line"}],"recommendation":"major_revision","confidential_remarks":"The manuscript is carefully written and unusually transparent about its limitations, which I appreciate. The main risk is that the EDR framework is presented as a generalizable design space when it is, in fact, the collective viewpoint of a self-selected group of co-authors. This is a load-bearing issue because the paper's contribution is the framework itself, not just a report of the workshop. A major revision that either reframes the contribution as a position paper or adds independent empirical grounding (even modest) would make the claims defensible for a journal venue. I would also flag the authorship model for editorial review: all workshop participants are listed as co-authors, and the paper states that no contributor declined authorship, which raises questions about whether all listed authors qualify under the journal's authorship criteria."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"First thing to know: this is a well-scoped conceptual paper, not an empirical validation. It delivers a structured design space for 'Empathy-Driven Reality'—three themes, 16 design implications, a treemap, and a table mapping requirements to mechanisms—and it is upfront that this is a scaffold for future work, not a tested system. If you read it as a proposal, it largely delivers; if you read it as a generalizable framework, it overreaches.\n\nWhat's actually new is the synthesis itself. Individual pieces—biofeedback avatars, privacy filters, accessibility tools, non-human embodiment—are all known, but the paper reorganizes them around empathy as a single organizing principle and names the tensions between them (e.g., disclosure vs. privacy, personalization vs. shared reality, interpretability vs. authenticity). That reorganization is absent from prior literature. The method is transparent: the workshop procedure, analysis steps, and even the 87% initial agreement are reported. Section 6 explicitly concedes optimism bias and underrepresentation. The Miro worksheet is shared via OSF. The three scenarios in Section 5.2 are clearly labeled as analytical projections, not deployments.\n\nThe soft spot is the one the authors themselves identify: the whole framework rests on a self-selected group of 27 experts, most of whom are co-authors, only 12 of whom completed all rounds, and the coding was done by the organizing team with consensus coding after the initial subset. The paper acknowledges missing perspectives—cognitive neuroscience, environmental psychology, animal-computer interaction, non-Western design traditions, lived-experience experts—and those are not marginal to the third theme (empathy beyond humans). So the stress-test concern is fair: the generalizability of the design space is load-bearing, and nothing in the manuscript shows an independent designer would reach the same implications. But the paper does not pretend otherwise; it says the framework is 'prospective and generative' and calls for external validation. The limitation is proportionate to the claim, as long as the claim is read as 'here is a structured starting point' rather than 'here is the design space for the field.'\n\nWho this is for: people working on social XR, affective computing, or inclusive design who want a curated map of the design tensions. It would be useful in a reading group. It deserves serious peer review—it's a coherent, honest synthesis with a clear contribution, even though it needs external validation before the framework can carry much weight. I'd send it to review, and I'd suggest the reviewers push for either independent application studies or a more diverse participant pool in the revision.","headline":"A transparent, well-organized conceptual synthesis that renames familiar XR concerns around empathy; its generalizability is unproven, but the paper is honest about that and deserves review.","tokens_in":25608,"tokens_out":3012,"would_cite":true,"duration_ms":29837,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper argues that Empathy-Driven Reality (EDR)—a conceptual design framework that makes empathy the single organizing principle for social XR—reframes accessibility, privacy, and emotion recognition as tensions to be designed for…","keywords":["empathy-driven reality","extended reality","social XR","affective computing","accessibility","inclusive design","expert workshop","safe spaces"],"falsifier":"Run the same two-month hybrid workshop protocol with a fresh group of practitioners and researchers who are not co-authors, then compare the themes and tensions that emerge; if the new group does not reproduce the three themes and the named tensions, the framework's generality is falsified.","tokens_in":24492,"feed_emoji":"🥽","tokens_out":6055,"duration_ms":55865,"temperature":0.7,"pith_summary":"Empathy-Driven Reality (EDR) is proposed as a conceptual design framework that makes empathy the single organizing principle for social extended reality (XR), rather than one feature among many. The paper reports a two-month hybrid workshop with 27 researchers from industry and academia, whose discussion was distilled into three themes: recognizing and adapting across realities, redefining safe spaces, and empathy beyond humans. The intended contribution is not a new checklist of XR problems but a reorganisation of familiar concerns—accessibility, privacy, emotion recognition, safety—around empathy, with the tensions between them named explicitly so they can drive design and research. The authors present EDR as a design space linking conceptual requirements to concrete design mechanisms, meant to orient future systems rather than as an empirically validated product.","feed_headline":"Empathy-first framework reorganizes XR design around shared states","feed_subtitle":"Three themes and 16 design implications turn accessibility, privacy, and emotion into empathic tensions for future XR systems.","key_machinery":"The central object is the EDR design space itself, a treemap-like structure that organizes themes, subthemes, and design implications into a single reference. Its load-bearing parts are the three themes and the tensions between design values, plus a requirements-to-mechanisms table that gives designers concrete levers (multi-layer empathic cues, cross-reality continuity indicators, disclosure control panels, contextual gating, AI-mediated inference explanations, embodied non-human perspective-taking modes). The workshop functions as the generative mechanism: a hybrid multi-session expert process using future sketching, personas, empathy maps, SWOT analysis, and self-determination theory to elicit challenges and guidelines. The design space is what carries the argument, because it is meant to turn empathy from an aspiration into a set of named trade-offs that can guide system building.","core_discovery":"The central claim is that empathy can serve as the organizing design principle for XR, reframing accessibility, privacy, and affective computing as conditions for empathic participation rather than separate concerns. From the workshop output, the paper derives five definitions, five challenges, 16 design implications (five for environment, six for interaction, five for avatars), and four potentials, organized into the three themes. EDR's distinctive value is said to lie in the tensions the experts surfaced—affective disclosure versus privacy, immersion versus accessibility, interpretability versus authenticity—tensions that are named rather than dissolved and that set the agenda for future empathy-driven XR. The framework is offered as a structured design space that maps requirements to design mechanisms such as confidence annotations, multi-layer empathic cues, disclosure control panels, and non-human perspective-taking modes, with the expectation that these mechanisms become the targets of implementation and empirical evaluation.","pith_inferences":["A testable extension is to turn the two recurring expert disagreements—default biosignal sharing, and non-human empathy competing with human empathy—into empirical design probes that measure trust and comfort under default-on versus default-off disclosure.","The framework's generalizability could be tested by running the same workshop protocol with an independent, non-author group of practitioners and comparing the resulting themes and tensions.","If EDR is right, empathy metrics in XR should be relational and longitudinal, tracking whether understanding persists across reality transitions, rather than per-session self-report scores.","The mechanisms table invites a modular implementation roadmap, where each row becomes an independent prototype that can be validated before integration."],"forward_implications":["Designers of social XR can use the three themes as a checklist of tensions to balance rather than features to add.","Empathic cues in XR should carry context, provenance, and confidence across reality transitions instead of being recomputed from scratch.","Accessibility and privacy become preconditions for empathy, so safety infrastructure must be built into the empathic channel rather than bolted on.","Empathy can be extended to AI agents, animals, and ecological systems through perspective translation, with explicit caution against anthropomorphism.","The requirements-to-mechanisms table gives a concrete starting point for building and evaluating the first EDR prototypes."],"supporting_citations":[{"why":"Provides the meta-analytic baseline that VR improves emotional but not cognitive empathy, motivating the need for a broader empathic design framework.","marker":"[61]"},{"why":"Supplies the three-way distinction between cognitive, affective, and compassionate empathy that anchors EDR's definitional framing.","marker":"[79,81]"},{"why":"Provided prior technological strategies for fostering empathy that the workshop synthesis extends into an XR design space.","marker":"[103]"},{"why":"Contributes the ability-based design philosophy that underpins Theme 2's accessibility requirements.","marker":"[120]"},{"why":"Defines the reality-virtuality continuum that grounds Theme 1's cross-reality continuity requirement.","marker":"[65]"},{"why":"Names the 'toxic empathy' risk that EDR treats as a design tension rather than dismissing.","marker":"[69]"},{"why":"Supplies the authorship-as-participation methodological precedent whose optimism bias the paper acknowledges as a limitation.","marker":"[68]"},{"why":"Provides the thematic analysis method used to code workshop transcripts and worksheets.","marker":"[14]"},{"why":"Supports the hybrid human-AI moderation approach EDR adopts for safe-space governance.","marker":"[88]"},{"why":"Grounds the argument that accessibility must be co-designed with disabled people rather than simulated, shaping Theme 2.","marker":"[10]"}],"fun_headline_variants":["XR design gets empathy-first framework from expert workshop","Empathy-Driven Reality: new framework for XR social spaces","Workshop yields 16 design implications for empathy-centric XR","EDR: a design space where empathy organizes XR requirements","Empathy as the missing link for inclusive XR socializing"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The framework's generality rests on the consensus of 27 self-selected experts, most of them co-authors invested in the field, and the paper itself notes this may introduce optimism bias; if that consensus does not transfer to outside designers and users, the design space loses its authority.","fun_headline_variants_meta":{"raw":{"variants":["XR design gets empathy-first framework from expert workshop","Empathy-Driven Reality: new framework for XR social spaces","Workshop yields 16 design implications for empathy-centric XR","EDR: a design space where empathy organizes XR requirements","Empathy as the missing link for inclusive XR socializing"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000668,"raw_usage":{"total_tokens":3040,"prompt_tokens":930,"completion_tokens":2110,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":546,"completion_tokens_details":{"reasoning_tokens":2027}},"tokens_in":546,"tokens_out":2110,"duration_ms":14809,"temperature":1.0,"reasoning_tokens":2027,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-12T00:30:29.695028+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run the same two-month hybrid workshop protocol with a fresh group of practitioners and researchers who are not co-authors, then compare the themes and tensions that emerge; if the new group does not reproduce the three themes and the named tensions, the framework's generality is falsified.","supporting_citations":[],"review_version":1}