REVIEW 4 major objections 8 minor 5 references
Defining best practices in the management of geothermal exploration data
T0 review · 4 major / 8 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read The paper claims that installing an Information System is the best practice for managing geothermal exploration data, based on a survey of regulators and developers in mature geothermal markets.
desk verdict Useful descriptive survey of geothermal data management practices, but the 'best practice' label is an unsupported is-ought inference from a small self-selected sample. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the Information System (IS): a dedicated hardware and software setup, generally a relational database on servers, that harvests, quality-checks, stores and diffuses exploration data. The paper's argument is carried by the two-part questionnaire sent to mature geothermal markets; the authors infer best practice by identifying commonalities across the responses and translating them into recommendations. Within the recommended IS, the load-bearing design is the split between a harvesting system that ingests and quality-checks data and a diffusion system that serves it out, with 24/7 web access and FAIR data principles.
What would settle it
If a geothermal project or country without a formal Information System could show equally secure, accessible and complete exploration data over comparable timescales and at lower cost, the claim that an IS is the best practice would be weakened. Concretely, a comparison of data preservation and accessibility between World Bank geothermal projects that adopted the recommended IS and matched projects that did not, measured after five or ten years, would settle the recommendation's value.
Extended reading notes
Core claim
The authors' central claim is that setting up an Information System is the best practice to systematically and securely manage geothermal exploration data. The supporting evidence is a questionnaire study with 122 questions for developers and 149 for regulators, answered by six regulatory institutions and thirteen developers in mature geothermal markets; analysis of commonalities yields best-practice recommendations. They further claim that regulators should favor public release of exploration data after an embargo to attract investment, that data should be kept in raw, processed and interpreted forms and structured to international or industry standards when they exist, that quality control should be performed by discipline experts with standardized methods, that systems should be built on relational databases with both harvesting and diffusion subsystems, and that initial investments of $100,000-$1,000,000 plus $10,000-$100,000 per year for maintenance are realistic benchmarks.
Load-bearing premise
The survey respondents - six regulators and thirteen developers from mature geothermal markets - are representative of the geothermal sector, and their current practices are a valid benchmark for defining best practice.
Editorial extensions
If this is right
- Regulators should publish exploration data after a time-bound embargo rather than keeping it confidential, on the survey finding that public release attracts investors and developers.
- Geothermal projects should budget $100,000-$1,000,000 for initial IS setup and $10,000-$100,000 per year for operation, with systems planned to last more than 20 years.
- Exploration data should be collected and stored in raw, processed and interpreted forms, in digital format, using international or industry standards where these exist.
- Developers should retain ownership of their data, manage access themselves, and make data as FAIR as practically possible, with 24/7 web access.
- Standardized quality control by discipline experts at the data collection stage is a core component of best-practice data management.
Reading between the lines
- Because the survey found regulators and developers disagree on whether data submission is mandatory, a likely unsaid implication is that clarifying legal data-reporting obligations would improve compliance without added enforcement.
- The cost benchmarks come from mature markets with established institutions; emerging-market geothermal programs may need to adapt them to local salary and infrastructure conditions, and open-source IS options may lower the entry barrier.
- The recommendation to make data FAIR suggests that future best practice could include machine-readable metadata standards and automated data-quality checks, a natural next step beyond the paper's survey-based guidance.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper reports on a questionnaire survey of geothermal exploration data management practices in mature geothermal markets, targeting six regulators and thirteen developers. Based on the responses, the authors derive a set of recommendations for regulators and developers covering regulatory framework, data types, formats, storage, quality control, access, and cost benchmarks. The central claim, stated in the abstract and conclusion, is that installing an Information System (IS) is the best practice for systematically and securely managing geothermal exploration data, and that the survey results support recommendations that will guide World Bank technical assistance programs.
Significance. If the descriptive survey is taken on its own terms, it offers a useful snapshot of current data management practices in several mature geothermal markets, including cost ranges and system architectures. The compilation of regulator and developer perspectives, and the identification of their disagreements on data submission and confidentiality, could be valuable background for practitioners and for technical assistance design. However, the paper's significance as a research contribution is limited by the absence of any outcome validation: the 'best practice' label is asserted from frequency of adoption rather than from measured performance. The value is largely as a descriptive baseline and an expert-consensus recommendation set, not as a validated normative prescription.
major comments (4)
- [Conclusion, Section 2, Section 3] The central claim that 'Setting up of an IS is the best practice' (Conclusion) is an is-ought inference. The survey collects only descriptive frequencies of current practices, as summarized in Section 2, and the recommendations in Section 3 are drawn from observed commonalities. No outcome measures are presented—no data on data quality, retrieval times, cost-effectiveness, decision impact, or exploration success—that would substantiate the label 'best practice.' The manuscript should either add validation against outcomes (e.g., comparing organizations with and without an IS) or reframe the results as 'common practices' and 'expert recommendations' rather than 'best practices.'
- [Sections 2.1 and 2.2] The sample is small and self-selected: six regulators and thirteen developers, with no response rates or non-response analysis. The paper claims to survey mature geothermal markets but responses come from a subset of the twelve markets listed in the Introduction, and no information is given on how the respondents were recruited or whether they are representative. This limits the generalizability of the recommendations, which is a load-bearing issue for a paper that defines 'best practices' for the geothermal sector at large.
- [Sections 2.1, 2.2, and 3] The survey reveals substantial disagreements between regulators and developers on mandatory data submission, confidentiality, and public access (e.g., regulators state that geophysical data submission is mandatory, while developers report that it generally is not; developers treat most data as confidential while regulators report public or time-bound access). These conflicts are documented in Section 2 but are not addressed in Section 3, where the recommendations nevertheless prescribe mandatory submission and public release. The paper should explicitly discuss how the recommendations handle conflicting stakeholder views and why the regulators' position is privileged.
- [Sections 2.1, 2.2, and 3, Cost of installation and maintenance] The cost benchmarks (e.g., $100,000–$1,000,000 initial investment, $10,000–$100,000/year maintenance, 1–5 years development) are presented as 'best practice' values, but they are derived from an unspecified small number of responses and are not tied to any performance or benefit measure. No return-on-investment or cost-effectiveness comparison with alternatives (e.g., outsourcing, cloud-based storage) is provided. For a paper whose stated purpose is to guide World Bank investments, these benchmarks need to be accompanied by the number of responses per cost item and clear caveats about their uncertainty and basis.
minor comments (8)
- [Abstract and Conclusion] The phrase 'best practice' is used assertively throughout; consider softening to 'recommended practice' or 'prevalent practice' unless outcome validation is added, to avoid overclaiming.
- [Section 2.1] Typographical error: 'New Zeeland' should be 'New Zealand.'
- [Abstract] Spacing issue: 'geoth ermal' appears in the abstract text.
- [Tables generally] Several tables are referenced but not properly numbered or appear with placeholder text such as 'Table 1Table 1' and 'Error! Reference source not found.' The manuscript should be carefully proofread for these artifacts.
- [Introduction] The questionnaire with 122 or 149 questions is not included and no reference to a full version is provided; readers cannot assess question wording or response options.
- [Sections 3.1 and 3.2] The recommendations for regulators and developers are highly similar; merging or cross-referencing the two subsections would reduce redundancy.
- [Accessibility and dissemination] The recommendation to make data 'as FAIR as practically possible' is made without a citation to the FAIR principles; please add the standard reference (Wilkinson et al., 2016).
- [Acknowledgements] There is a doubled word: 'for for his support' should read 'for his support.'
Circularity Check
Central 'best practice' claim reduces to survey commonality; descriptive input is relabelled as normative output.
-
renaming known result
[Abstract; Section 2 opening; Section 3; Conclusion]
"The responses were analyzed to identify commonalities in data management practices. They reveal that installing an Information System (IS) is the best practice to systematically and securely manage exploration data."
The survey collects respondents' current practices, and the paper's stated method is to 'identify commonalities' and then read 'best practice' off those commonalities. The conclusion, 'Setting up of an Information System (IS) is the best practice to systematically and securely manage exploration data,' restates the survey's modal observation (84% of developers have an IS; most regulators have an IS) with the evaluative label attached. No outcome metric (data quality, cost-effectiveness, exploration success) is measured, so the label is not independently derived; it is the input pattern renamed. Section 3 then converts the same responses into 'recommendations for best practices,' so the deliverable is equivalent to the aggregate survey input.
full rationale
The paper is transparent about its method: it surveys current practices in mature geothermal markets, identifies commonalities, and then presents those commonalities as 'best practice.' The central conclusion—'Setting up of an Information System (IS) is the best practice...'—is logically the same observation as 'most surveyed regulators and developers have an IS' (84% of developers; most regulators), with the predicate 'best practice' added. Because the questionnaire collected no outcome data (e.g., data quality, accessibility, cost-effectiveness, exploration success), there is no independent evidence that the recommended practices produce better outcomes; the recommendation is a relabelling of the modal response. This is a partial circularity in the normative claim, not a defect in the descriptive survey. There is no load-bearing self-citation chain and no mathematical derivation that assumes its conclusion, so the score is 6 rather than 8-10. The cost benchmarks and format/QC recommendations similarly reproduce respondent-reported ranges and practices. If read only as a descriptive baseline, the paper is non-circular; circularity enters specifically when 'common practice' is renamed 'best practice' without an external benchmark.
Assumptions & free parameters
assumptions (3)
- domain assumption Survey respondents are representative of mature geothermal markets
- ad hoc to paper Current practices in mature markets define best practice
- domain assumption An Information System improves geothermal data management outcomes
Cite this review
Pith. "Pith review of Defining best practices in the management of geothermal exploration data." pith.science (2026). https://pith.science/paper/NH35G54P
@misc{pith2026190807865,
author = {Pith},
title = {Pith review of: Defining best practices in the management of geothermal exploration data},
year = {2026},
howpublished = {\url{https://pith.science/paper/NH35G54P}},
note = {Machine review of arXiv:1908.07865}
}
read the original abstract
The objective of this work is to define best practices in the management of geothermal exploration data. This study builds on a questionnaire to survey the geothermal data management practices in mature geothermal markets. The inquiry targeted public Regulatory entities with overview of geothermal resources as well as public and private developers. Topics covered in the questionnaire range from the country status to the database set up. The questionnaire focused on the specifications, usage and investments required for installing/maintaining information systems capable of managing exploration data. In addition, information on the different regulatory frameworks and company policies for managing/sharing exploration data has been gathered to identify the requirements imposed on the design of information systems. The responses were analyzed to identify commonalities in data management practices. They reveal that installing an Information System (IS) is the best practice to systematically and securely manage exploration data. They also provide recommendations with respect to the regulatory framework, data types, data collection methodologies, data storage, data quality control, data accessibility and dissemination, IS architecture, financial investments and human resources required to develop a state-of-the art IS. These results will guide the design of future technical assistance programs for beneficiaries of World Bank support to geothermal exploration activities and it is our belief that they will be beneficial for the geothermal sector at large.
Reference graph
Works this paper leans on
-
[1]
INTRODUCTION The World Bank Energy Sector Management Assistance Program’s (ESMAP) Global Geothermal Development Plan (GGDP) aims to scale up geothermal development by mobilizing funding for activities that (i) reduce upstream resource risk, specifically exploration drilling, and (ii) promote dissemination of knowledge and best practices. Proper management...
-
[2]
ANALYSIS OF RESPONSES TO QUESTIONNAIRES ON GEOTHERMAL EXPLORATION DATA MANAGEMENT SYSTEMS In order to define best practices in geothermal data management, the following aspects of the data management practices in mature geothermal markets were studied from both the Developers and Regulators perspectives: The types of data collected by developers during ...
work page 2015
-
[3]
“Light” IS developed in less than a year with limited initial investment (less than $100,000) and staff (less 25person months). Associated operational costs are in the $10,000 - $100,000 per year range and involves less than three person per year
- [4]
-
[5]
“Heavy” IS developed in more five years with initial investments in the $ 100,000 to $1,000,000 range and more than 100 person months. Associated operational costs are in the $10,000 - $100,000 per year range and involves four to nine persons per year. Reasons for the cost differences include types/amount of data dealt with, company policies for data stor...
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.