{"id":"e9478fb1-46e8-4b36-8491-b9666492a413","arxiv_id":"1908.07865","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A questionnaire survey of 6 regulators and 13 developers yields geothermal exploration data management recommendations centered on installing a centralized Information System.","lead":"The authors surveyed regulators and developers in mature geothermal markets about how they store and share exploration data. Their report recommends centralized information systems and FAIR data practices to guide World Bank technical assistance.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The paper labels installing an Information System as 'best practice' based solely on commonality among 19 self-selected survey respondents, with no outcome data linking IS adoption to better data management or exploration success.","rationale":"The reader's weakest_assumption correctly identifies the representativeness of the survey sample as a concern. My stress-test focuses on a closely related but more fundamental inferential gap: even if the sample were perfectly representative of mature geothermal markets, the paper's conclusion would still not follow because 'common practice' is not evidence of 'best practice' without outcome validation. This is the load-bearing weakness in the argument. The reader's verdict of CONDITIONAL remains appropriate: the paper is a useful descriptive survey, but the normative recommendations require either a reframing as 'common practices in surveyed markets' or additional outcome-based evidence. No internal mathematical or logical inconsistency is present; the issue is the external validity of the prescriptive leap. I agree with the reader's assessment, so the verdict should remain unchanged. The concrete test proposed would settle whether the concern actually lands by testing the correlation between IS adoption and measurable data-management outcomes.","tokens_in":14062,"tokens_out":1434,"duration_ms":16753,"concrete_test":"Perform a follow-up outcome-focused survey or structured interviews of the same 19 respondent entities plus at least 10 additional geothermal developers/regulators without a formal IS. Collect quantifiable outcome indicators, such as: time from data request to delivery, number of data losses or corruption incidents, fraction of datasets with complete metadata, ability to integrate datasets across disciplines, and user satisfaction scores. Compare these indicators between entities with and without an IS, controlling for market maturity and company size. If entities with an IS do not demonstrably outperform on these outcome metrics, the paper's central claim that an IS is 'best practice' is not supported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim in the Conclusion, 'Setting up of an Information System (IS) is the best practice to systematically and securely manage exploration data,' rests on an inference from descriptive survey responses to normative prescription. In Section 2, the authors analyze responses from six regulators and thirteen developers and then, in Section 3, derive recommendations from observed commonalities. This logic equates 'what mature-market entities currently do' with 'what should be done,' but the survey appears to have collected no outcome metrics—no measures of data quality, completeness, accessibility, cost-effectiveness, or downstream exploration outcomes—that would justify the 'best practice' label. The paper's own results show substantial variation: only 7 of 13 developers collect data systematically, 84% of developers have an IS but many store data on hard disks, and regulators and developers disagree about the mandatory status of data submission. Without evidence that entities with an IS achieve better data management outcomes than those without, or that the recommended practices improve exploration decisions, the prescriptive claim is an overgeneralization. The cost benchmarks are similarly derived from a handful of responses and are not tied to any demonstrated return on investment. A 'best practice' should be validated by outcomes, not by frequency of adoption. The paper provides a useful descriptive baseline, but the normative step is unsupported.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper reports on a questionnaire survey of geothermal exploration data management practices in mature geothermal markets, targeting six regulators and thirteen developers. Based on the responses, the authors derive a set of recommendations for regulators and developers covering regulatory framework, data types, formats, storage, quality control, access, and cost benchmarks. The central claim, stated in the abstract and conclusion, is that installing an Information System (IS) is the best practice for systematically and securely managing geothermal exploration data, and that the survey results support recommendations that will guide World Bank technical assistance programs.","tokens_in":14428,"tokens_out":3299,"duration_ms":34507,"significance":"If the descriptive survey is taken on its own terms, it offers a useful snapshot of current data management practices in several mature geothermal markets, including cost ranges and system architectures. The compilation of regulator and developer perspectives, and the identification of their disagreements on data submission and confidentiality, could be valuable background for practitioners and for technical assistance design. However, the paper's significance as a research contribution is limited by the absence of any outcome validation: the 'best practice' label is asserted from frequency of adoption rather than from measured performance. The value is largely as a descriptive baseline and an expert-consensus recommendation set, not as a validated normative prescription.","major_comments":[{"comment":"The central claim that 'Setting up of an IS is the best practice' (Conclusion) is an is-ought inference. The survey collects only descriptive frequencies of current practices, as summarized in Section 2, and the recommendations in Section 3 are drawn from observed commonalities. No outcome measures are presented—no data on data quality, retrieval times, cost-effectiveness, decision impact, or exploration success—that would substantiate the label 'best practice.' The manuscript should either add validation against outcomes (e.g., comparing organizations with and without an IS) or reframe the results as 'common practices' and 'expert recommendations' rather than 'best practices.'","section":"Conclusion, Section 2, Section 3"},{"comment":"The sample is small and self-selected: six regulators and thirteen developers, with no response rates or non-response analysis. The paper claims to survey mature geothermal markets but responses come from a subset of the twelve markets listed in the Introduction, and no information is given on how the respondents were recruited or whether they are representative. This limits the generalizability of the recommendations, which is a load-bearing issue for a paper that defines 'best practices' for the geothermal sector at large.","section":"Sections 2.1 and 2.2"},{"comment":"The survey reveals substantial disagreements between regulators and developers on mandatory data submission, confidentiality, and public access (e.g., regulators state that geophysical data submission is mandatory, while developers report that it generally is not; developers treat most data as confidential while regulators report public or time-bound access). These conflicts are documented in Section 2 but are not addressed in Section 3, where the recommendations nevertheless prescribe mandatory submission and public release. The paper should explicitly discuss how the recommendations handle conflicting stakeholder views and why the regulators' position is privileged.","section":"Sections 2.1, 2.2, and 3"},{"comment":"The cost benchmarks (e.g., $100,000–$1,000,000 initial investment, $10,000–$100,000/year maintenance, 1–5 years development) are presented as 'best practice' values, but they are derived from an unspecified small number of responses and are not tied to any performance or benefit measure. No return-on-investment or cost-effectiveness comparison with alternatives (e.g., outsourcing, cloud-based storage) is provided. For a paper whose stated purpose is to guide World Bank investments, these benchmarks need to be accompanied by the number of responses per cost item and clear caveats about their uncertainty and basis.","section":"Sections 2.1, 2.2, and 3, Cost of installation and maintenance"}],"minor_comments":[{"comment":"The phrase 'best practice' is used assertively throughout; consider softening to 'recommended practice' or 'prevalent practice' unless outcome validation is added, to avoid overclaiming.","section":"Abstract and Conclusion"},{"comment":"Typographical error: 'New Zeeland' should be 'New Zealand.'","section":"Section 2.1"},{"comment":"Spacing issue: 'geoth ermal' appears in the abstract text.","section":"Abstract"},{"comment":"Several tables are referenced but not properly numbered or appear with placeholder text such as 'Table 1Table 1' and 'Error! Reference source not found.' The manuscript should be carefully proofread for these artifacts.","section":"Tables generally"},{"comment":"The questionnaire with 122 or 149 questions is not included and no reference to a full version is provided; readers cannot assess question wording or response options.","section":"Introduction"},{"comment":"The recommendations for regulators and developers are highly similar; merging or cross-referencing the two subsections would reduce redundancy.","section":"Sections 3.1 and 3.2"},{"comment":"The recommendation to make data 'as FAIR as practically possible' is made without a citation to the FAIR principles; please add the standard reference (Wilkinson et al., 2016).","section":"Accessibility and dissemination"},{"comment":"There is a doubled word: 'for for his support' should read 'for his support.'","section":"Acknowledgements"}],"recommendation":"major_revision","confidential_remarks":"The manuscript reads more like a World Bank project deliverable than a conventional research paper. The descriptive survey results are potentially useful, but the normative 'best practice' framing is not supported by the evidence presented. A major revision that reframes the claims as descriptive or expert-consensus recommendations, adds explicit limitations, and quantifies the response basis for cost figures would make it publishable as a technical case study. The journal's editors may also wish to consider whether the paper's scope and methodology fit the journal's standards for research contributions."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The paper's real value is the survey dataset: systematic summaries of how six regulators and thirteen developers in mature geothermal markets handle exploration data, broken down by data type, storage, standards, access, and cost. That is a genuinely useful descriptive baseline, especially for the World Bank's technical assistance programs, and the cost benchmarks are rare in the literature. The structure is clear and the reporting is honest about variation in responses.\n\nThe soft spot is the normative step. The conclusion that 'installing an Information System is the best practice' is inferred from the fact that most respondents have one. There are no outcome metrics—no measure of data quality, accessibility, cost-effectiveness, or downstream exploration success—linking IS adoption to better performance. The sample is small, self-selected, and the paper does not report response rates or include the questionnaire. The variation the paper itself documents (only 7 of 13 developers collect data systematically; 84% have an IS but many store data on hard disks; regulators and developers disagree on whether submission is mandatory) makes 'best practice' even harder to support. The cost benchmarks are derived from a handful of responses and are not tied to any demonstrated return on investment.\n\nA second, lesser issue is citation: the paper mentions INSPIRE, NGDS, USGIN, and FAIR but does not cite them, even though the recommendations largely restate those standards. That should be fixed.\n\nNone of this makes the survey worthless. The descriptive content is sound and the recommendations, read as 'common practices in surveyed markets with cost ranges,' are reasonable operational guidance. The paper just overclaims by labeling them best practices without validation. The fix is straightforward: reframe the conclusions, add methodological transparency, and cite the existing standards.\n\nWho is this for? Practitioners setting up geothermal data systems and World Bank staff designing technical assistance. It is not a scientific contribution, but it is a legitimate operational one. I would send it to peer review with a request for major revision: the data deserve publication, but not with the current normative framing.","headline":"Useful descriptive survey of geothermal data management practices, but the 'best practice' label is an unsupported is-ought inference from a small self-selected sample.","tokens_in":14815,"tokens_out":1403,"would_cite":false,"duration_ms":14797,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper claims that installing an Information System is the best practice for managing geothermal exploration data, based on a survey of regulators and developers in mature geothermal markets.","keywords":["geothermal energy","exploration data","data management","information system","best practices","survey","regulators","developers"],"falsifier":"If a geothermal project or country without a formal Information System could show equally secure, accessible and complete exploration data over comparable timescales and at lower cost, the claim that an IS is the best practice would be weakened. Concretely, a comparison of data preservation and accessibility between World Bank geothermal projects that adopted the recommended IS and matched projects that did not, measured after five or ten years, would settle the recommendation's value.","tokens_in":13893,"feed_emoji":"♨️","tokens_out":5000,"duration_ms":44602,"temperature":0.7,"pith_summary":"This paper sets out to define what counts as best practice in managing the data produced during geothermal exploration. It surveys public regulators and private developers in mature geothermal markets and draws recommendations from what these experienced players commonly do. The central finding is that installing a dedicated Information System (IS) is the best practice for storing, quality-controlling and disseminating exploration data. Concrete guidance follows on data formats, regulatory frameworks, system architecture, access and costs, which the authors intend to steer World Bank technical assistance for geothermal exploration. If the findings hold, projects receiving public support can plan realistic budgets and designs for data management from the start.","feed_headline":"Information systems are best practice for geothermal exploration data","feed_subtitle":"Survey of mature geothermal markets yields cost and architecture benchmarks for regulators and developers.","key_machinery":"The central object is the Information System (IS): a dedicated hardware and software setup, generally a relational database on servers, that harvests, quality-checks, stores and diffuses exploration data. The paper's argument is carried by the two-part questionnaire sent to mature geothermal markets; the authors infer best practice by identifying commonalities across the responses and translating them into recommendations. Within the recommended IS, the load-bearing design is the split between a harvesting system that ingests and quality-checks data and a diffusion system that serves it out, with 24/7 web access and FAIR data principles.","core_discovery":"The authors' central claim is that setting up an Information System is the best practice to systematically and securely manage geothermal exploration data. The supporting evidence is a questionnaire study with 122 questions for developers and 149 for regulators, answered by six regulatory institutions and thirteen developers in mature geothermal markets; analysis of commonalities yields best-practice recommendations. They further claim that regulators should favor public release of exploration data after an embargo to attract investment, that data should be kept in raw, processed and interpreted forms and structured to international or industry standards when they exist, that quality control should be performed by discipline experts with standardized methods, that systems should be built on relational databases with both harvesting and diffusion subsystems, and that initial investments of $100,000-$1,000,000 plus $10,000-$100,000 per year for maintenance are realistic benchmarks.","pith_inferences":["Because the survey found regulators and developers disagree on whether data submission is mandatory, a likely unsaid implication is that clarifying legal data-reporting obligations would improve compliance without added enforcement.","The cost benchmarks come from mature markets with established institutions; emerging-market geothermal programs may need to adapt them to local salary and infrastructure conditions, and open-source IS options may lower the entry barrier.","The recommendation to make data FAIR suggests that future best practice could include machine-readable metadata standards and automated data-quality checks, a natural next step beyond the paper's survey-based guidance."],"forward_implications":["Regulators should publish exploration data after a time-bound embargo rather than keeping it confidential, on the survey finding that public release attracts investors and developers.","Geothermal projects should budget $100,000-$1,000,000 for initial IS setup and $10,000-$100,000 per year for operation, with systems planned to last more than 20 years.","Exploration data should be collected and stored in raw, processed and interpreted forms, in digital format, using international or industry standards where these exist.","Developers should retain ownership of their data, manage access themselves, and make data as FAIR as practically possible, with 24/7 web access.","Standardized quality control by discipline experts at the data collection stage is a core component of best-practice data management."],"supporting_citations":[],"fun_headline_variants":["Survey crowns info systems as geothermal data best practice","Info systems top geothermal data management best practices","Survey: info systems best for geothermal exploration data","Best practice for geothermal data: adopt an information system","Mature markets survey: info systems are geothermal data best practice"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The survey respondents - six regulators and thirteen developers from mature geothermal markets - are representative of the geothermal sector, and their current practices are a valid benchmark for defining best practice.","fun_headline_variants_meta":{"raw":{"variants":["Survey crowns info systems as geothermal data best practice","Info systems top geothermal data management best practices","Survey: info systems best for geothermal exploration data","Best practice for geothermal data: adopt an information system","Mature markets survey: info systems are geothermal data best practice"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00081,"raw_usage":{"total_tokens":3538,"prompt_tokens":916,"completion_tokens":2622,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":532,"completion_tokens_details":{"reasoning_tokens":2548}},"tokens_in":532,"tokens_out":2622,"duration_ms":17870,"temperature":1.0,"reasoning_tokens":2548,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T11:54:04.192607+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"If a geothermal project or country without a formal Information System could show equally secure, accessible and complete exploration data over comparable timescales and at lower cost, the claim that an IS is the best practice would be weakened. Concretely, a comparison of data preservation and accessibility between World Bank geothermal projects that adopted the recommended IS and matched projects that did not, measured after five or ten years, would settle the recommendation's value.","supporting_citations":[],"review_version":1}