{"id":"8a8f0a59-3205-4102-99c5-5bb372be89c2","arxiv_id":"1908.01546","paper_version":1,"verdict":"UNVERDICTED","confidence":"MODERATE","novelty_score":3.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"ESA should shift from one-way outreach to embedded, community-led education and public engagement, funded by at least 2% of each mission's lifecycle cost.","lead":"This white paper argues that ESA's Voyage 2050 space science programme should spend at least 2% of each mission's lifecycle cost on education and public engagement. It offers a list of concrete recommendations on how ESA could improve outreach, translation, and citizen science across Europe.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The 2% EPE budget recommendation rests on an untested causal assumption and an underived cost target; the paper itself calls for the missing research.","rationale":"The reader's weakest_assumption identifies the same load-bearing concern: the recommendations rest on an untested causal assumption that more engagement will increase public trust and support, and the 2% figure is asserted without derivation. My stress-test confirms this and adds specificity by locating the exact assertions (pp.06 and 14) and noting that the paper itself calls for the missing research. The paper is a policy white paper, not a scientific research paper, so no scientific verdict can be assigned; the reader's UNVERDICTED verdict remains appropriate. The concern does not reveal an internal inconsistency or a fraudulent argument, so there is no basis for rejection. It does, however, mean that if ESA were to adopt the 2% target on the strength of this white paper alone, the decision would rest on an empirical premise that has not been tested. The proposed systematic review and meta-analysis would settle whether that premise holds, so the concern is actionable rather than merely philosophical.","tokens_in":12122,"tokens_out":3115,"duration_ms":34780,"concrete_test":"Conduct a preregistered systematic review and meta-analysis of published evaluations of space-agency and science-communication EPE programs, comparing participatory/embedded approaches against one-way outreach on outcomes such as public trust, support for funding, and science literacy. If the pooled effect size is not significantly positive, the premise underlying the 2% recommendation fails. A complementary check would be a natural experiment using Eurobarometer trust-in-ESA data across member states with varying per-capita ESA EPE spending, after controlling for national science culture and mission activity; if no positive association emerges, the causal assumption is unsupported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim—that ESA Science should treat EPE as core and spend at least 2% of lifecycle costs on it—depends on two unstated premises: (1) that increased, earlier, and more participatory engagement will produce public trust and support worth the investment, and (2) that 2% is the right amount. Neither is supported by evidence in the paper. The Executive Summary asserts the 2% figure without derivation, and the Conclusion repeats that ESA is 'nowhere near spending the recommended 2%' without offering a cost-benefit or opportunity-cost analysis. The causal premise appears in statements such as 'A more visible ESA and its achievements will, in any event, lead to greater public appreciation and support of its missions' (p.06) and 'Public engagement with ESA can only come from public trust' (p.14), but these are treated as axioms rather than testable hypotheses. The paper cites examples like Ambition, JunoCam, and ARIEL's machine-learning challenge as evidence that participatory engagement works, but these are anecdotal successes, not systematic evaluations. The paper also explicitly recommends that ESA base its EPE on its own research (p.05) and calls for research into audiences and methods (p.13), which acknowledges the evidence gap but does not fill it. If the causal link from EPE spending to public support is weak, the entire case for reallocating mission budgets to EPE collapses. This is a load-bearing concern because the 2% recommendation is the paper's most concrete and actionable claim, and it is currently unsubstantiated.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This white paper, submitted to ESA's Voyage 2050 planning cycle, argues that education, communication and public engagement (EPE) should be a core component of every ESA Science mission. It proposes a shift from one-way outreach to participatory engagement, with a specific recommendation that at least 2% of each mission's lifecycle costs be spent on EPE. The paper reviews perceived shortcomings in ESA's current communications and education activities, offers recommendations on embedded EPE teams, translation and localization, citizen science, formal and informal education, and diversity and inclusion, and illustrates its argument with examples such as Ambition, JunoCam, and the ARIEL machine-learning challenge.","tokens_in":12362,"tokens_out":4241,"duration_ms":39886,"significance":"If taken up by ESA, the paper's recommendations would materially change how ESA Science allocates resources and interacts with the public. The paper is strongest as an expert-opinion piece: it is concrete, actionable, attentive to diversity and inclusion, and it explicitly calls for ESA to base EPE on research rather than assumptions. Its central quantitative claim, the 2% budget target, is, however, asserted rather than derived, and the causal link between engagement spending and public trust or support is not demonstrated. The paper therefore makes a useful contribution to a policy conversation, but it does not meet the evidentiary standard of a research article.","major_comments":[{"comment":"The central recommendation that 'at least 2% of the budget of a mission's life cycle costs should be spent on EPE' appears without derivation, benchmark, or cost-benefit analysis. The paper does not report ESA's current EPE spending, compare with other agencies, or define which costs count as EPE. As written, the 2% figure is a placeholder; the recommendation must either be supported by comparative data or explicitly reframed as a starting point for a pilot study.","section":"Executive Summary, p.04; Conclusions, p.20"},{"comment":"The core causal premise, that greater visibility and earlier, more participatory engagement will increase public appreciation and trust, is asserted rather than tested. The claim on p.06 ('A more visible ESA and its achievements will, in any event, lead to greater public appreciation and support of its missions') and the claim on p.14 ('Public engagement with ESA can only come from public trust') are treated as axioms. The examples given, such as Ambition, JunoCam, and the ARIEL challenge, are anecdotal and lack outcome metrics. Because the entire case for reallocating mission budgets depends on this link, the paper should either present existing evidence or commit to an evaluation design.","section":"ESA's Science Missions and Society, p.06; Public Engagement, p.14"},{"comment":"The paper itself acknowledges the evidence gap: it recommends that ESA's EPE 'be based on its own research' (p.05) and calls for research into audiences and methods (p.13). This is internally inconsistent with recommending a specific spending target now. The recommendations would be more defensible if framed as hypotheses to be validated through the proposed R&D and evaluation activities, rather than as firm budgetary requirements.","section":"Executive Summary, p.05; Public Engagement, p.13"},{"comment":"The Ambition example is described as a 'stand-out success', but no success metrics are provided. Similarly, JunoCam and the ARIEL challenge are cited as evidence that participatory engagement works, but the paper does not report measures of public trust, learning, or support. If these examples are meant to support a general policy conclusion, they need to be backed by evaluation data or clearly labelled as case illustrations rather than evidence of effectiveness.","section":"Public Engagement, p.14"}],"minor_comments":[{"comment":"There is a duplicated 'and' in the sentence 'However this important change has not permeated fully and and requires a buy-in'.","section":"p.09"},{"comment":"The phrase 'built upon the the existing ESA partnership programme' contains a duplicated 'the', and the preceding sentence contains a doubled comma in 'In some cases, , the injection'.","section":"p.12"},{"comment":"The sentence beginning 'Now that YouTube is the biggest public education platform on the planet' is a run-on and contains a duplicated 'must' in 'ESA must must abandon'.","section":"p.16"},{"comment":"The curly apostrophe in 'child´s own interest' should be regularized to a standard apostrophe, and the sentence would benefit from restructuring for clarity.","section":"p.17"},{"comment":"The statement 'Communications over social media need to be plentiful, timely and consistent' is a truism that could be cut or supported with concrete guidance, as the surrounding discussion already makes this point more specifically.","section":"p.10"}],"recommendation":"major_revision","confidential_remarks":"The manuscript is a white paper rather than a research article; for a research journal, the lack of empirical support for the central 2% recommendation is a barrier that cannot be fixed by minor edits. A major revision could reframe the piece as a policy or perspective article with the 2% figure presented as a proposal to be evaluated. I also note that most authors are EPE professionals whose organizations could plausibly benefit from the recommended budget increases; a formal competing-interests statement would improve transparency and help readers assess the proposal."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Quick take: this is not a research paper, and it should not be evaluated as one. It is a policy white paper from a group of experienced education/public engagement professionals, aimed at ESA's Voyage 2050 planning. It makes a clear, well-structured case that EPE should be embedded in missions from conception, with a specific target of at least 2% of lifecycle cost.\n\nWhat it does well: the paper is unusually honest. It repeatedly flags the need for research into audiences and methods (pp. 5, 13), describes itself as a 'modest attempt', and gives concrete examples (Ambition, JunoCam, ARIEL challenge) without claiming they prove anything. The recommendations—embedded communication teams, translation/localization, open educational resources, citizen science, astroEDU peer review—are sensible and mostly drawn from established practice in the field. The writing is clear and the tone is collaborative rather than preachy.\n\nSoft spots: the 2% figure appears without derivation or cost-benefit analysis. The causal chain from more/better engagement to public trust and support is asserted, not tested. The examples are anecdotal successes, not systematic evaluations. And the authors are largely EPE practitioners who would plausibly benefit from increased EPE spending; that isn't disqualifying, but it does mean the reader should hold the budget claim to a higher standard. The stress-test note is right that the 2% recommendation is load-bearing for the paper's actionability. I would say it is a load-bearing *weakness*, but not a fatal one, because the paper positions itself as the start of a conversation, not a completed cost-benefit analysis. For a policy white paper, the absence of empirical support for the central target is a real limitation, but it is the kind of limitation that is normal for this genre.\n\nWho it is for: ESA decision-makers, science communication researchers, and anyone interested in how space agencies think about public engagement. It would be a useful reading in an STS or science-communication course as an example of evidence-informed advocacy.\n\nRecommendation: I would not send this to a traditional peer review as a scientific paper. But it deserves a serious read by the ESA Science management and by referees with expertise in science communication and science policy. If it goes to peer review, the key question to put to the authors is: what evidence, or what pilot, would convince you the 2% is the right order of magnitude? I would engage with it.","headline":"A coherent, well-crafted advocacy white paper from EPE professionals; the 2% budget target is asserted rather than derived, but the paper is honest about that and is best read as a policy proposal, not a research result.","tokens_in":12979,"tokens_out":2073,"would_cite":false,"duration_ms":21283,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper argues that ESA's Voyage 2050 missions should treat education and public engagement as a core funded part of every mission, with at least 2% of lifecycle costs and engagement starting at mission conception.","keywords":["ESA Science Programme","Voyage 2050","education and public engagement","science communication","citizen science","informal learning","mission narrative","public trust in science"],"falsifier":"Compare missions with embedded EPE teams and the full 2% budget from the concept stage against otherwise similar missions without them, tracking public trust and awareness in every member state; if no measurable difference appears by the end of a mission lifecycle, the paper's central claim is wrong.","tokens_in":11916,"feed_emoji":"🛰️","tokens_out":7892,"duration_ms":74014,"temperature":0.7,"pith_summary":"This white paper argues that education, communication and public engagement (EPE) should be a core component of every mission in ESA's Voyage 2050 science programme, not a publicity afterthought. Its central proposal is that at least 2% of each mission's lifecycle budget be reserved for EPE, and that engagement begin at the mission-concept stage with teams embedded in the mission itself. The paper contends that a decentralized, participatory, person-centred approach will build public trust and support for space science more effectively than today's centralized, milestone-driven communications. If ESA adopts the plan, mission budgets and staffing would be reshaped, and the agency's relationship with European citizens would shift from broadcasting results to co-creating the mission story.","feed_headline":"ESA urged to spend 2% of mission budget on public engagement","feed_subtitle":"White paper says early, embedded, localized outreach should be a core part of every Voyage 2050 mission.","key_machinery":"The organising mechanism is the mission itself, treated as a storytelling container with a three-part narrative: a human story, a science question, and a technical puzzle. That narrative is carried by embedded EPE teams, dedicated communicators who work with a mission from conception through operations, and supported by a central agency that provides strategy, training, translation, open resources, and experimental R&D for new formats. The paper argues that localising stories through national offices and involving citizens through co-creation and citizen science is what turns one-way broadcasting into genuine engagement.","core_discovery":"The paper's central claim is that ESA Science should shift from education and public outreach (EPO) to education and public engagement (EPE), treating EPE as an integral part of each Voyage 2050 mission rather than a separate activity. Concretely, it recommends that at least 2% of each mission's lifecycle costs be spent on EPE; that embedded communication teams work alongside each mission from the earliest concept stage; that engagement be person-centred, narrative-driven, and localised into all member-state languages; and that citizen-science components be included in mission data analysis. If this is right, a space agency's success should be judged not only by its scientific returns but by how deeply and diversely it involves the public in the life of a mission.","pith_inferences":["The paper leaves implicit that adopting the 2% norm would mean a standing reallocation of science funds; whether the engagement payoff justifies that cost is testable but not demonstrated.","The same mission-narrative template could plausibly be carried into other large public-funded scientific facilities that lack a single iconic mission, offering a generalisation beyond space science.","The paper's emphasis on starting engagement before mission selection implies a measurable prediction: public trust and awareness should track early-stage story output more strongly than launch-era press releases.","If public trust is the real goal, the recommendation could be extended to require post-mission evaluation of EPE impact as a condition of receiving the 2% allocation."],"forward_implications":["Voyage 2050 missions would carry a dedicated EPE budget line of at least 2% of lifecycle costs, making engagement a contractual part of every mission.","Public engagement would begin at the mission-concept stage through competitions, early visual assets, and team training, rather than ramping up only near launch.","Each mission would have an embedded communications team empowered to tell local, personal stories, with the central agency providing strategy, translation, and coordination.","ESA materials would be professionally translated and localised into all member-state languages, and educational resources would be peer-reviewed and openly licensed.","Voyage 2050 data-analysis programmes would include citizen-science components, building on existing platforms and early-stage competitions."],"supporting_citations":[{"why":"Policy reports cited to justify shifting from one-way communication toward dialogue, co-creation, and participation.","marker":"6"},{"why":"A model classroom programme that produced widely used astronomy education products, used as a template for an education R&D lab.","marker":"7"},{"why":"A short film campaign that illustrates both the potential of an agile production team and the distribution bottlenecks such efforts hit.","marker":"10"},{"why":"A camera public-jury example where citizens contributed external expertise to mission science.","marker":"11"},{"why":"An early machine-learning competition that drew over 100 teams and showed pre-launch citizen engagement.","marker":"13"},{"why":"A project demonstrating that local curriculum research, done through national offices, is needed for effective formal education.","marker":"19"},{"why":"A working group with science centres and museums used as a template for co-creation with informal learning venues.","marker":"22"}],"fun_headline_variants":["ESA: public engagement must be core to every mission","2% of mission budget for public engagement, ESA told","Voyage 2050: shift from outreach to engagement","Embed engagement teams in every Voyage mission"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The central premise, stated in the introduction and public-engagement sections, is that earlier and more widespread public engagement will increase public trust and support for the agency's science; the paper presents no evidence that this causal link holds, nor that 2% is the right investment level.","fun_headline_variants_meta":{"raw":{"variants":["ESA: public engagement must be core to every mission","2% of mission budget for public engagement, ESA told","Voyage 2050: shift from outreach to engagement","Embed engagement teams in every Voyage mission"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.0003,"raw_usage":{"total_tokens":1753,"prompt_tokens":989,"completion_tokens":764,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":605,"completion_tokens_details":{"reasoning_tokens":700}},"tokens_in":605,"tokens_out":764,"duration_ms":8311,"temperature":1.0,"reasoning_tokens":700,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T15:08:51.069936+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Compare missions with embedded EPE teams and the full 2% budget from the concept stage against otherwise similar missions without them, tracking public trust and awareness in every member state; if no measurable difference appears by the end of a mission lifecycle, the paper's central claim is wrong.","supporting_citations":[],"review_version":1}