{"id":"927468a2-d332-4760-9469-6d088a6ebec3","arxiv_id":"1908.02822","paper_version":1,"verdict":"UNVERDICTED","confidence":"UNKNOWN","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"Astronomy should fund long-term, culturally grounded collaboration with indigenous knowledge systems, treating oral traditions as scientific references and expanding indigenous participation.","lead":"This white paper asks funding agencies to invest in partnerships between professional astronomers and indigenous knowledge holders, and lays out six recommendations. It argues that existing programs like IEI, 'Imiloa, and I-WISE show how astronomy can respect indigenous ways of knowing.","discovery_kind":"review","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Central funding claim rests on asserted program success; no external evaluation or outcome metrics are provided to verify it.","rationale":"The reader's weakest_assumption precisely identifies the same load-bearing concern: the cited programs' success is asserted rather than demonstrated. My review confirms that the paper's own text offers no evidence that would settle that premise. The white paper is an advocacy document, and much of its argument is normative and not directly testable; however, the claim 'highly successful current initiatives' is a factual claim that is load-bearing for the central funding recommendation. Without external evaluation or outcome metrics, the argument cannot move from 'these programs exist and are valued by their participants' to 'these models have had very positive results and deserve sustained agency funding.' The concern is not internal inconsistency or fraud; it is an evidence gap in an empirical premise. A concrete test, such as reviewing external program evaluations, would settle the concern in either direction: positive independent evaluations would strengthen the recommendation, while their absence would confirm that the white paper's central empirical claim is unverified. I therefore agree with the reader's UNVERDICTED verdict; the text is coherent and actionable, but the central empirical assertion remains unverified.","tokens_in":7985,"tokens_out":2112,"duration_ms":28018,"concrete_test":"Obtain and independently review outcome data and external evaluation reports for the cited programs: participant counts, retention and completion rates, career or educational trajectories, pre/post knowledge or attitude assessments, and any comparison groups. If such data do not exist or do not show measurable positive outcomes relative to baselines, the 'highly successful' premise in Recommendation 2 is unsupported. Separately, locate the original source for the claim that two-thirds of Hawaiians support scientific efforts on Mauna Kea; if no source exists, that factual assertion should be removed or qualified.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's central claim is that the named initiatives (IEI, 'Imiloa, I-WISE, and their products such as Cosmic Serpent, A Hua He Inoa, Envision MaunaKea, Native Universe, MaunaKea Scholars) are 'highly successful' and 'have already had very positive results' (Executive Summary and Recommendation 2), and therefore deserve sustained funding. This is an empirical premise, but the paper supplies no outcome metrics, external evaluations, control or comparison baselines, or independently documented evidence of effectiveness. The success claims are supported largely by program-internal publications and by the authors' own accounts, and no attempt is made to operationalize 'success' or to address possible selection or confirmation effects. The uncited claim that 'two-thirds of Hawaiians currently support scientific efforts on Mauna Kea' (Recommendation 2) is a further factual assertion that would need independent sourcing if it is used to support the recommendation. Because the funding recommendation depends directly on the demonstrated success of these programs, the absence of verifiable evidence is the load-bearing weakness. This is not a critique of the normative goals, which stand on their own; it is a critique of the empirical claim used to justify the specific funding request.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This white paper argues that astronomy has a unique connection to indigenous knowledge (IK) and that current initiatives demonstrate a successful model of \"collaboration with integrity\" between Western and indigenous scholars. It presents six recommendations to funding agencies: (1) support collaborative naming and research on telescope sites; (2) fund collaborative models and roadmaps; (3) support long-term, observation-based astronomy by indigenous knowledge holders on 5–10 year timescales; (4) recognize oral traditions as scientific references; (5) include indigenous perspectives in space policy; and (6) create culturally supported pathways for indigenous youth in science careers. The paper's central empirical premise is that the cited initiatives (IEI, 'Imiloa, I-WISE, and their products) are \"highly successful\" and have already had \"very positive results,\" thereby deserving sustained funding.","tokens_in":8167,"tokens_out":1865,"duration_ms":21309,"significance":"If the central claim is adequately supported, the paper would provide a concrete, actionable agenda for integrating IK into astronomy funding, education, and policy, with the potential to influence the Astro2020 decadal survey and beyond. The paper's strengths are its clear normative stance, the diversity of its authorial voices including indigenous scholars and practitioners, the specificity of the six recommendations, and the concrete examples of ongoing collaborations. These features make it a useful community statement. However, the paper's evidentiary basis for the key empirical claim of program success is thin: it relies on self-authored publications and anecdotal descriptions, without outcome metrics, external evaluations, or independent verification. This gap is load-bearing because the funding recommendation rests on the asserted demonstrated success of these programs.","major_comments":[{"comment":"The central claim that the cited initiatives are \"highly successful\" and have \"already had very positive results\" is asserted without any operational definition of success, outcome metrics, external evaluations, or comparison baselines. This is the load-bearing premise for the sustained-funding recommendation. I request that the authors either provide independent evidence of effectiveness (e.g., evaluation reports, external assessments, or measurable outcomes such as participation numbers, retention, or learning gains) or visibly soften the claim to \"promising\" or \"emerging\" models.","section":"Executive Summary and Recommendation 2"},{"comment":"The factual claim that \"two-thirds of Hawaiians currently support scientific efforts on Mauna Kea\" is presented without citation and is used to bolster the recommendation. This is an empirical assertion that needs an independent, checkable source. If no such source exists, the sentence should be removed or rephrased to avoid making an unsupported quantitative claim.","section":"Recommendation 2, second paragraph"},{"comment":"Much of the positive characterization of the programs is supported by the authors' own prior work (Venkatesan & Burgasser 2017; Maryboy, Begay & Peticolas 2012), which creates a circular evidentiary loop: these works are cited both as the source of the \"collaboration with integrity\" model and as evidence of its success. Independent evaluations or third-party documentation of the programs' outcomes would materially strengthen the paper's recommendation.","section":"References and Introduction"}],"minor_comments":[{"comment":"The spelling of \"Hawai'i\" and \"Hawai'ian\" is inconsistent; please standardize to the Hawaiian orthography used in the title.","section":"Throughout"},{"comment":"The reference to \"Philips 2014\" should read \"Phillips 2014,\" and the URL for the PNAS article is missing a colon (\"www.pnas.orgcgidoi10.1073pnas.0403723101\").","section":"References"},{"comment":"The phrase \"renormalization of IK\" appears to be a typographical or conceptual error; if \"revitalization\" or \"reaffirmation\" is intended, please correct it.","section":"Recommendation 1"},{"comment":"The footnote URLs are not included in the reference list and several are bare links; for reproducibility, they should be formatted as complete citations with access dates.","section":"Footnotes 4–8"},{"comment":"The list of initiatives (Cosmic Serpent, A Hua He Inoa, Envision MaunaKea, Native Universe, MaunaKea Scholars) would benefit from one sentence describing what each initiative actually does, so that a reader unfamiliar with them can assess the relevance of the examples.","section":"Recommendation 2, examples list"}],"recommendation":"major_revision","confidential_remarks":"The paper is a white paper intended for a decadal survey, and the evidentiary norms there are different from those of a technical journal. Still, as submitted to this venue, the lack of independent evidence for the central success claim and the unsourced statistical assertion are substantive issues that the authors can realistically fix by adding citations, metrics, or qualifying language. The self-citation pattern is worth watching, though it is understandable in a community statement authored by practitioners. The paper's normative recommendations stand on their own and do not require the contested empirical premise; I would encourage the authors to decouple the two."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"You should know this is an advocacy white paper written for the Astro2020 decadal survey, not a research preprint. It argues that astronomy should fund and institutionalize partnerships between western science and indigenous knowledge, and it offers six concrete recommendations. If you're looking for a new empirical result or a novel theoretical framework, this isn't that. But if you're looking for a thoughtful, actionable statement about how the field could change its practices, this is a good one.\n\nWhat it does well: it names specific programs (IEI, 'Imiloa, I-WISE), gives examples like the naming of 'Oumuamua and Pōwehi, and grounds the argument in literature on place naming and knowledge systems. The recommendations are specific and actually different from each other: naming opportunities, longer grant timescales, recognition of oral traditions, space policy, and youth pathways. The inclusion of indigenous authors and knowledge holders is real, not just performative. It also acknowledges some of the tensions around the Thirty Meter Telescope, even if briefly.\n\nThe soft spots are real but proportionately sized. The phrase 'highly successful' appears early and is never operationalized. No outcome data, external evaluations, or comparison baselines are provided. The paper leans on self-authored publications (Maryboy, Begay & Peticolas 2012; Venkatesan & Burgasser 2017) as evidence. And the claim that 'two-thirds of Hawaiians currently support scientific efforts on Mauna Kea' has no citation. These are legitimate concerns if you treat the paper as a research contribution. But this is an advocacy document; it is trying to persuade a decadal committee, not demonstrate a causal claim. The recommendation to fund programs would be stronger with metrics, but its absence is not disqualifying.\n\nI think the central argument holds up: there is a history of ignoring indigenous knowledge, and these programs appear to be genuine attempts to do better. The lack of evaluation is a gap, not a fatal flaw. The paper is honest about some challenges (grant timescales, funding competition) and does not overclaim beyond what advocacy requires.\n\nFor whom: the decadal survey committee, funding agency staff, astronomy department leaders, and anyone working on diversity and inclusion in the field. It is not a technical paper, but it is worth a serious read.\n\nMy recommendation: let it go to review. Desk rejection would be wrong for a white paper of this quality. The review should push for one thing: ask the authors to either provide evidence for the 'highly successful' claim or soften the language. That would make it a better document.","headline":"A clear, well-written advocacy white paper whose six recommendations are sensible but whose 'highly successful initiatives' claim is supported by anecdote, not evidence.","tokens_in":8710,"tokens_out":1556,"would_cite":false,"duration_ms":20630,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This white paper argues that astronomy funding agencies should support Indigenous knowledge as a full partner in research, education, and space policy.","keywords":["Indigenous knowledge","astronomy education","collaboration with integrity","science funding policy","oral tradition","space governance","diversity in STEM","dark skies"],"falsifier":"An independent external evaluation comparing participants in two of the cited programs with a matched control group: if it found no difference in Indigenous youth persistence in STEM or no difference in community trust toward observatories, the paper's assertion that these partnerships 'have already had very positive results' would not be established.","tokens_in":7781,"feed_emoji":"🔭","tokens_out":5255,"duration_ms":56476,"temperature":0.7,"pith_summary":"The paper's central claim is that astronomy has a unique connection to Indigenous knowledge (IK), both because sky observation is the oldest science common to all cultures and because modern observatories often sit on sacred Indigenous lands. It asserts that a model called 'collaboration with integrity' has already been demonstrated by several successful initiatives and therefore deserves serious consideration for sustained institutional funding. The paper translates this into six concrete recommendations for funding agencies, from recognizing oral traditions as scientific references to creating culturally supported career pathways for Indigenous youth. A sympathetic reader would care because, if the claim holds, astronomy would model how scientific institutions can partner with Indigenous communities rather than appropriate or assimilate their knowledge.","feed_headline":"Astronomy should fund Indigenous knowledge as a scientific partner","feed_subtitle":"Six recommendations ask agencies to back long-term collaborations, oral traditions, and Indigenous youth.","key_machinery":"The load-bearing object is the named model 'collaboration with integrity,' defined as a co-created relationship between Indigenous knowledge holders and academic astronomers in which Indigenous languages, naming, and worldviews remain central, and outcomes carry Indigenous cultural meaning (for example, the names given to an interstellar object and a black hole). The paper uses successful instances of this model as both evidence and template: the instances demonstrate that the model works, and the recommendations generalize it into funding structures such as longer grant timelines, oral-tradition citation, and culturally supported career pathways.","core_discovery":"Astronomy is inseparable from the people who practice it, and modern astronomy has a particular obligation to Indigenous lands and Indigenous scientific practices. The paper claims that 'collaboration with integrity' is a demonstrated model of partnership in which Indigenous and non-Indigenous scholars co-create research, naming, and education without appropriation or assimilation. Evidence for the model is drawn from a set of current initiatives that the authors describe as highly successful, and on that basis they recommend sustained funding at local and institutional levels. The six recommendations are: fund naming and renaming collaborations on telescope sites; fund partnership models that juxtapose Indigenous and Western science; provide 5–10 year grants for Indigenous-led observation-based research; recognize oral traditions as scientific references; include Indigenous perspectives in space governance; and create culturally supported paths for Indigenous youth in science careers.","pith_inferences":["If the model is adopted widely, peer review itself may need to change: Indigenous knowledge holders would sit on review panels, and proposals citing oral traditions would need protocols for community consent and attribution, a governance question the paper raises only implicitly.","The argument implies a testable longitudinal claim: sustained 'collaboration with integrity' programs should measurably increase Indigenous student retention and persistence in astronomy; the paper does not present such data, so it could be gathered.","The dark-sky framing suggests that satellite constellation regulation could be debated as an environmental and cultural-heritage issue, not merely an astronomical one."],"forward_implications":["Agencies would create dedicated 5–10 year grants for Indigenous-led, observation-based research, because trust and relationship-building cannot happen on a typical three-year cycle.","Oral traditions would be accepted as scientific references in proposals and reviews, on par with peer-reviewed articles.","Observatories on Indigenous lands would fund naming and renaming collaborations with local communities, giving Indigenous languages a living presence in modern science.","Space policy would treat dark skies as a shared resource and include Indigenous perspectives as satellite constellations reshape the night sky.","A culturally supported pathway, including conferences, tribal college partnerships, and place-based education, would become a standard agency expectation for Indigenous youth."],"supporting_citations":[{"why":"Supplies the definition and initial model of 'Collaboration with Integrity' and the Cosmic Serpent project.","marker":"Maryboy, Begay & Peticolas 2012"},{"why":"Provides the argument that Indigenous worldviews can be juxtaposed with Western astronomy to enhance research and education.","marker":"Venkatesan & Burgasser 2017"},{"why":"Provides evidence that diverse groups of problem solvers can outperform homogeneous high-ability groups.","marker":"Hong & Page 2004"},{"why":"Supports the claim that diversity makes teams work harder and produce higher-quality research.","marker":"Phillips 2014"},{"why":"Supports the recommendation on naming by documenting the centrality of place naming in Native American cultures.","marker":"Thornton 1997"},{"why":"Supplies the ethical framework for collaboration without appropriation or assimilation into nonindigenous knowledge systems.","marker":"Kimmerer 2015"},{"why":"Documents the collaborative naming of an interstellar object, an example used in Recommendation 1.","marker":"Witze 2019"}],"fun_headline_variants":["Fund Indigenous knowledge as a true partner in astronomy","Six recommendations for astronomy to honor Indigenous science","Astronomy must co-create with Indigenous knowledge, not appropriate it","Back Indigenous-led astronomy with 5-10 year grants","Collaboration with integrity: astronomy's path with Indigenous science"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that the cited programs are genuinely successful and that their outcomes transfer to other institutions and agencies; the paper asserts this success without presenting outcome metrics, external evaluations, or comparison baselines.","fun_headline_variants_meta":{"raw":{"variants":["Fund Indigenous knowledge as a true partner in astronomy","Six recommendations for astronomy to honor Indigenous science","Astronomy must co-create with Indigenous knowledge, not appropriate it","Back Indigenous-led astronomy with 5-10 year grants","Collaboration with integrity: astronomy's path with Indigenous science"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001058,"raw_usage":{"total_tokens":4412,"prompt_tokens":893,"completion_tokens":3519,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":509,"completion_tokens_details":{"reasoning_tokens":3442}},"tokens_in":509,"tokens_out":3519,"duration_ms":26424,"temperature":1.0,"reasoning_tokens":3442,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T14:32:36.375001+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"An independent external evaluation comparing participants in two of the cited programs with a matched control group: if it found no difference in Indigenous youth persistence in STEM or no difference in community trust toward observatories, the paper's assertion that these partnerships 'have already had very positive results' would not be established.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the definition and initial model of 'Collaboration with Integrity' and the Cosmic Serpent project."}],"review_version":1}