{"id":"c55d8095-3117-4c89-8d62-028ea5ec7dcd","arxiv_id":"2506.04267","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"A multivocal literature review finds that 81.4% of studies labeled 'twin transition' do not genuinely link digitalization and sustainability in both directions.","lead":"This paper systematically reviews academic and gray literature on \"twin transition,\" the idea that digitalization and sustainability should reinforce each other. It finds that most work labeled twin transition actually describes one-way or disconnected transitions, and it offers a classification and research agenda for the field.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Headline 81.4% is definition-dependent: if one-way 'informed' transitions count as twin transition, mislabeling drops to 37.2%, so the field's term use is less imprecise than claimed.","rationale":"The reader's weakest assumption identifies the same core issue: the 81.4% statistic depends on a strict bidirectional definition of twin transition. I agree that this is the most load-bearing point. However, the reader also claims the paper does not report inter-rater reliability for applying the definition; the paper actually reports Cohen's kappa=0.854 for the E1-E5 exclusion criteria, which includes E3/E4 and therefore the parallel/informed distinction. The more precise weakness is that the operational criteria do not cleanly encode the bidirectional requirement, and the paper does not independently justify that requirement as the field's consensus definition. The paper otherwise is methodologically careful: the search is transparent, the replication package is available, the exclusion counts are internally consistent (472 - 448 = 24 included), and the RQ2-RQ5 findings are clearly grounded in the included primary studies. The central claim is valuable if the definitional boundary is accepted, but the correctness risk is real and can be settled by a direct re-coding study under competing definitions. The verdict should therefore remain conditional, awaiting that auditable classification.","tokens_in":16519,"tokens_out":6874,"duration_ms":74392,"concrete_test":"Recode all 113 self-labeled twin-transition studies with two independent coders under two pre-registered definitions: (A) strict bidirectional coordination as in Section IV-A, and (B) any recognized link, i.e., parallel or one-way digitalization-for-sustainability counts as twin transition. Report per-definition mislabeling rates and category-specific Cohen's kappa for the bidirectional judgment. If definition (B) yields approximately 37.2% rather than 81.4%, or if kappa for the bidirectional judgment is below 0.6, the headline claim is definition-dependent rather than a robust property of the literature.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The headline statistic is conditional on a normative definition. RQ1 counts as 'imprecise' any self-labeled twin-transition study that is not bidirectional (no link = parallel, one-way = informed), but the only authority cited for this boundary is the WEF playbook [16] and the JRC page [41]. The paper's own data show the dominant usage is one-way: 71/161 studies are 'informed transition,' with digitalization serving sustainability. On the broader reading that 'twin transition' means a joint green+digital transition (with digital as enabler, as in much EU policy usage), those 50 self-labeled informed-transition papers are correctly labeled, and the 'imprecise' share drops from 81.4% (92/113) to 37.2% (42/113). The E3/E4 exclusion criteria in Table I are phrased as 'not related to' rather than 'one-directional'; the later mapping of E4 to 'informed transition' introduces the bidirectional condition after screening, so the headline split is not fully auditable from the stated protocol. The paper does report Cohen's kappa=0.854 for E1-E5, so the concern is not absence of reliability data but absence of evidence that the strict bidirectional definition is the field's operative definition. If common usage of 'twin transition' legitimately includes one-way or loosely coupled transitions, the central claim is an artifact of the chosen boundary.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This manuscript reports a multivocal literature review (MLR) on the 'twin transition' concept, defined as the mutually supporting digital and sustainability transitions ('greening of and by IT and data'). The authors searched eight databases on 3 September 2024, screened 472 unique references with explicit exclusion criteria, and selected 24 primary studies. In RQ1 they classify 161 digital/sustainability transition studies into parallel (66), informed (71), and twin (24) transitions, and report that 92 of 113 (81.4%) self-labeled twin-transition studies use an imprecise notion. RQ2-RQ5 characterize sustainability dimensions, stakeholders, enablers, and challenges, and Section V derives five research-and-practice recommendations.","tokens_in":16809,"tokens_out":6317,"duration_ms":60743,"significance":"If the RQ1 classification is accepted, the paper provides the first systematic quantitative evidence that the term 'twin transition' is frequently used for one-way or uncoordinated transitions, which is a useful and timely corrective for the information systems community. The study's strengths include a documented and reproducible protocol, a public replication package, a high inter-rater agreement (Cohen's kappa = 0.854) at the screening stage, a quality-checklist self-assessment, and the inclusion of gray literature following established guidelines. The multivocal design is appropriate for an emerging topic. However, the headline 81.4% statistic is conditional on a strict bidirectional definition of twin transition that is not independently validated; the main contribution therefore needs a sensitivity analysis or a stronger justification of the definitional boundary before the claim can be considered robust.","major_comments":[{"comment":"The headline finding that 81.4% (92 of 113) of self-labeled twin-transition studies are imprecise depends entirely on counting the 50 'informed transition' papers as mislabeled. The protocol, however, does not justify this boundary. Table I defines E4 as 'Sustainability is clear but not related to digitalization,' while Sec. IV-A describes informed transition as recognizing a one-directional link in which digitalization serves sustainability; these two descriptions are contradictory, and the mapping from E4 to 'informed transition' is introduced only after screening. If one-way digitalization-for-sustainability is accepted as a legitimate reading of 'twin transition' (as in much EU policy usage where digitalization is an enabler of the green transition), the mislabeling share drops to 42 of 113 (37.2%). Please provide an independent justification that the strict bidirectional condition from [16,41] is the operative definition in the field, or report results under both definitions as a sensitivity analysis.","section":"Sec. IV-A, RQ1; Table I"},{"comment":"The reported Cohen's kappa of 0.854 applies to the E1-E5 inclusion/exclusion screening, not to the three-way classification of the 161 studies into parallel, informed, and twin transitions that drives RQ1. No inter-rater reliability is reported for that classification, and the categories are not defined with decision rules (e.g., what counts as 'recognizing a link' in one or both directions). Please add a reliability assessment for the RQ1 classification, or at least a second-round coding of the 161 studies with disagreement resolution, so that the headline counts are auditable.","section":"Sec. III-B-4"}],"minor_comments":[{"comment":"The last row of Table I (198 excluded, 24 included, 3.07%, 0.854) needs clearer labels; as printed, the row is difficult to parse against the E0-E5 rows.","section":"Table I"},{"comment":"Add a caption that explains the three left bars (66, 71, 24) and the split of TT-labeled versus not TT-labeled within each category; the current figure is hard to interpret without the text.","section":"Fig. 2"},{"comment":"Table III reports non-technical stakeholders in 24 of 24 primary studies, while the text in Sec. V-C says 20 of 24 (83.3%); please correct this inconsistency and check whether the downstream conclusions are affected.","section":"Sec. V-C"},{"comment":"The claim that in all 71 informed-transition studies 'digitalization serves sustainability ambitions' is asserted without a per-study table or a coding rule; please provide the underlying classification in the replication package or an appendix.","section":"Sec. IV-A"},{"comment":"The related-work section would benefit from a more detailed comparison with Mouthaan et al. [50] and Wang et al. [67] to clarify what the new MLR adds beyond those reviews.","section":"Sec. II-C"},{"comment":"Reference [7] is a social-media post; for a claim about greenwashing in mainstream media, consider citing the associated news article or a more durable source.","section":"References"},{"comment":"The abbreviation GL (gray literature) is used in Sec. III-A-1 but is not defined at first use; please define it when it first appears.","section":"Sec. III-A-1"},{"comment":"The quality checklist score is given as 7 of 11 points, and the itemized points (1+1+2+2+1=7) sum correctly; please state the maximum score for each item to make the 11-point total transparent.","section":"Sec. III-C-d"}],"recommendation":"major_revision","confidential_remarks":"The manuscript is likely within scope for a venue on ICT for sustainability, and the authors have been transparent about their protocol. The main risk to the paper's central claim is the definitional boundary of RQ1; please request the sensitivity analysis or stronger justification before publication. There is no indication of any integrity problem."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Colleague,\n\nThe short version: this is a solid multivocal review with a genuinely useful taxonomy (parallel/informed/twin transition), and the headline “81.4% of self-labeled twin transition work is imprecise” is real but more definition-dependent than the paper admits. If common usage counts one-way digital-for-sustainability as twin transition, the mislabeling share drops to 37.2%. That is the main thing to know before citing the number.\n\nWhat is new: the first systematic survey of twin transition that includes gray literature, and a three-way classification that gives researchers a firmer vocabulary. The protocol is transparent: eight databases, exclusion criteria E0–E5, Cohen’s kappa 0.854 for screening, a quality checklist score, and a replication package on Zenodo. The stakeholder and enabler/challenge syntheses are credible and carefully tied to the primary studies. Credit where due: the counting is internally consistent and the paper is honest about its design choices.\n\nThe soft spots are moderate. First, the central finding rests on a strict definition of twin transition as bidirectional coordination, taken from the WEF and JRC sources. The paper never shows this is the field’s operative definition. EU policy usage often treats twin transition as a joint green+digital agenda with digitalization as enabler, which is exactly the “informed transition” category the paper counts as imprecise. Under that reading, 92/113 becomes 42/113. The authors should either defend the normative definition more explicitly or frame the finding as conditional. Second, the E3/E4 exclusion criteria in Table I are worded as “not related to,” but the RQ1 analysis maps them to “no link” and “one-way link.” That mapping is introduced after screening and is not fully auditable from the stated protocol. Third, the reported inter-rater reliability applies to screening criteria E1–E5, not to the three-way classification of the 161 studies; the RQ1 coding needs its own reliability check or a published coding scheme. The Section V recommendations are expert opinion, fine as recommendations but not as tested results.\n\nBottom line: a useful, well-structured contribution. It deserves peer review and should be accepted after the authors clarify the definitional grounding and make the RQ1 classification auditable. I’d point anyone working on digitalization and sustainability to it, and it will generate a good discussion about who gets to define a contested term.","headline":"Useful taxonomy and transparent review, but the 81.4% mislabeling headline is more definition-dependent than the paper lets on.","tokens_in":17290,"tokens_out":3746,"would_cite":true,"duration_ms":34485,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Most research labeled 'twin transition' never coordinates digital and sustainability transitions.","keywords":["twin transition","digital transformation","sustainability","multivocal literature review","gray literature","green transition","digitalization","sustainable digitalization"],"falsifier":"Re-code the same 161-study corpus with a definition that accepts one-way digitalization-enabled sustainability as a valid twin transition and recompute the share of self-labeled twin transition studies that are correctly labeled; a large jump in that share would show the headline figure depends on the strict definition, while little change would confirm the paper's boundary.","tokens_in":16307,"feed_emoji":"♻️","tokens_out":8751,"duration_ms":70914,"temperature":0.7,"pith_summary":"This paper tries to establish that the research literature on 'twin transition' — the idea that digitalization and sustainability should advance in a mutually reinforcing way, 'greening of and by IT and data' — mostly misuses the term. Reviewing 781 candidate works and classifying 161 that address both digital and sustainability transitions, the authors find that only 24 meet the bidirectional criterion, while 92 of 113 self-labeled twin transition studies describe transitions that are parallel or only one-way (digitalization serving sustainability). The paper then maps sustainability dimensions, stakeholders, enablers, and challenges across the 24 genuine twin transition studies, and argues that the field's imprecision feeds unwarranted techno-optimism and neglects the ecological cost of digitalization itself. A sympathetic reader would care because if the diagnosis holds, a large body of policy and innovation advice labeled as twin transition is pursuing the wrong target.","feed_headline":"81% of 'twin transition' studies misuse the term, review shows","feed_subtitle":"Only 24 of 161 works treat digitalization and sustainability as mutually dependent; the rest are parallel or one-way.","key_machinery":"The classification scheme that carries the argument is a three-way distinction among transition models based on the degree of coordination between digitalization and sustainability: parallel transition (no link between the two), informed transition (one-way link, in practice always digitalization aiding sustainability), and twin transition proper (bidirectional coordination). The scheme operationalizes the definition of twin transition from the European Green Deal and the phrasing 'greening of and by IT and data,' and it is applied to 161 studies that address both transitions. The 81.4% figure is the share of self-labeled twin transition studies that fall into the first two categories.","core_discovery":"The paper's central claim is that the dominant usage of 'twin transition' in academic and gray literature is imprecise: 81.4% (92 of 113) of studies that call themselves twin transition do not actually coordinate digital and sustainability transitions in both directions. Of these, 42 (37.2%) treat the two transitions as parallel with no link, and 50 (44.2%) treat digitalization as a tool serving sustainability while ignoring the sustainability of digitalization. Only 14.9% (24 of 161) of works addressing both transitions meet the bidirectional definition, and 21 of those label themselves correctly. The authors further report that genuine twin transition studies consistently include environmental sustainability (100%), usually combine it with economic and/or social dimensions, involve almost no technical stakeholders, and identify complexity and cost as the main challenges.","pith_inferences":["The headline statistic is definition-sensitive: if one accepts one-way digitalization-to-sustainability links as a legitimate early-stage twin transition, the 81.4% mislabeling figure would shrink substantially; the paper's contribution is partly a recommendation about how the term should be used, not only a measurement of how it is used.","A natural testable extension is to survey authors of the 92 'mislabeled' studies: if many deliberately use 'twin transition' to mean any joint consideration of digitalization and sustainability, then the field has a terminological dispute rather than a competence gap.","The paper's stakeholder finding suggests a concrete design opportunity: building decision-support dashboards, digital twins, or applied-observability tools for government and business leaders could shift the stakeholder mix toward technical actors, though the paper does not itself test such interventions.","The exclusive use of the classic three sustainability dimensions in the corpus, with no attention to technical or individual sustainability, may reflect the term's provenance in European policy; a broader sampling of non-European literature might change the dimension counts."],"forward_implications":["Researchers and policy analysts should treat 'twin transition' as a loaded term: a large share of publications using it do not study coordinated transitions, so evidence syntheses based on self-reported labels will overstate the maturity of the field.","Funding and innovation programs aimed at twin transition should require explicit demonstration of bidirectional coordination, such as assessing the ecological footprint of the digital technologies themselves, not only their benefits for sustainability.","The near-total absence of technical stakeholders in the corpus suggests that information systems and software engineering expertise is underused in current twin transition work; the paper's recommendations point to modeling, ontologies, and participatory methods as entry points.","Because environmental sustainability appears in all genuine twin transition studies while technical and individual sustainability appear in none, the 'green' framing of twin transition may be crowding out social and longevity dimensions of sustainability.","The field's imprecision reinforces techno-optimism: if digitalization is assumed to be automatically green, the projected growth of ICT's carbon footprint (2-4% of global emissions now, up to 14% by 2040) goes unaddressed."],"supporting_citations":[{"why":"Supplies the operative definition of twin transition as 'greening of and by IT and data'; the criterion against which the 113 self-labeled studies are judged.","marker":"[16]"},{"why":"Traces twin transition to the European Green Deal and frames it as parallel green and digital transitions in a mutually supporting way; the origin of the bidirectional requirement.","marker":"[41]"},{"why":"Provides the multivocal literature review guidelines that shape the search, selection, and gray-literature inclusion procedure.","marker":"[33]"},{"why":"Quantifies ICT's current and projected share of global CO2 emissions, establishing why the definitional gap matters ecologically.","marker":"[13]"},{"why":"Supplies the critique of techno-optimism used to interpret the 81.4% mislabeling as unwarranted faith in technology alone.","marker":"[4]"}],"fun_headline_variants":["Only 15% of dual-transition works meet twin transition definition","Most 'twin transition' research is one-way or parallel, review finds","True twin transition: rare, with only 24 of 161 studies","Study: 81% of 'twin transition' papers miss bidirectional core"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is the strict definition that twin transition requires bidirectional coordination between digitalization and sustainability, taken from [16,41]; if common usage legitimately includes one-way or loosely linked transitions, the 81.4% mislabeling statistic is an artifact of the chosen definition.","fun_headline_variants_meta":{"raw":{"variants":["Only 15% of dual-transition works meet twin transition definition","Most 'twin transition' research is one-way or parallel, review finds","True twin transition: rare, with only 24 of 161 studies","Study: 81% of 'twin transition' papers miss bidirectional core"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000301,"raw_usage":{"total_tokens":1674,"prompt_tokens":825,"completion_tokens":849,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":441,"completion_tokens_details":{"reasoning_tokens":769}},"tokens_in":441,"tokens_out":849,"duration_ms":8031,"temperature":1.0,"reasoning_tokens":769,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-07T11:15:21.266126+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-code the same 161-study corpus with a definition that accepts one-way digitalization-enabled sustainability as a valid twin transition and recompute the share of self-labeled twin transition studies that are correctly labeled; a large jump in that share would show the headline figure depends on the strict definition, while little change would confirm the paper's boundary.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the operative definition of twin transition as 'greening of and by IT and data'; the criterion against which the 113 self-labeled studies are judged."},{"cited_title":"The twin green & digital transition: How sustainable digital technologies could enable a carbon-neutral EU by 2050","cited_arxiv_id":null,"evidence_quote":"Traces twin transition to the European Green Deal and frames it as parallel green and digital transitions in a mutually supporting way; the origin of the bidirectional requirement."},{"cited_title":"Guidelines for including grey literature and conducting multivocal literature reviews in software engineering","cited_arxiv_id":null,"evidence_quote":"Provides the multivocal literature review guidelines that shape the search, selection, and gray-literature inclusion procedure."},{"cited_title":"Assessing ICT global emissions footprint: Trends to 2040 & recommen- dations","cited_arxiv_id":null,"evidence_quote":"Quantifies ICT's current and projected share of global CO2 emissions, establishing why the definitional gap matters ecologically."},{"cited_title":"A critique of techno-optimism: Efficiency without sufficiency is lost","cited_arxiv_id":null,"evidence_quote":"Supplies the critique of techno-optimism used to interpret the 81.4% mislabeling as unwarranted faith in technology alone."}],"review_version":1}