FAIR+S: A validation study of a framework for sustainable research data and software
Pith reviewed 2026-07-01 07:40 UTC · model grok-4.3
The pith
Expert survey validates that extending FAIR with sustainability metrics is relevant for research data and software but shows low awareness of green practices.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
FAIR+S embeds carbon-footprint and energy-use considerations directly into FAIR-aligned metadata schemas, workflows and development specifications so that research infrastructures can report, compare, and audit environmental implications in a measurable and interoperable manner. Validation through the expert survey confirms the framework's importance and practical relevance across disciplines while revealing current gaps in researchers' awareness of green software practices.
What carries the argument
FAIR+S framework, which extends the FAIR principles by weaving environmental accountability into metadata, workflows, and specifications for digital research artefacts.
If this is right
- Research infrastructures could begin reporting and comparing environmental impacts of data and software using existing FAIR metadata structures.
- Reproducible research workflows could simultaneously support open-science goals and measurable decarbonisation targets.
- Development specifications for research software could include explicit energy and carbon criteria without breaking interoperability.
- The identified awareness gaps indicate a need for targeted education on green software practices within research communities.
Where Pith is reading between the lines
- Institutional policies or grant requirements might eventually reference FAIR+S-style reporting as a condition for funding.
- Concrete tools for calculating and storing carbon metrics within standard metadata formats would be a logical next implementation step.
- The framework could connect to existing life-cycle assessment methods already used in engineering domains.
- Wider adoption would require addressing how smaller research groups without dedicated sustainability expertise can comply.
Load-bearing premise
A cross-disciplinary expert survey provides sufficient validation of the framework's feasibility, relevance, and acceptance across stakeholders and disciplines.
What would settle it
A larger survey of active researchers finding that most view the added sustainability reporting as impractical or irrelevant to their work would undermine the validation results.
Figures
read the original abstract
The FAIR principles (Findable, Accessible, Interoperable, Reusable) have transformed research data management, but they do not address the environmental impact of creating and using research software and data, such as energy consumption, carbon emissions, and life-cycle impacts that become central to computer science and engineering-related domains. To bridge this gap FAIR+Sustainability or FAIR+S, an extension of the FAIR framework that embeds environmental accountability as a core element, was introduced. Because FAIR principles already structure how digital research artefacts are described, shared, and reused, they offer an effective entry point for embedding sustainability considerations at scale. FAIR+S weaves carbon-footprint and energy-use considerations directly into FAIR-aligned metadata schemas, workflows and development specifications. In doing so, it enables research infrastructures to report, compare, and audit the environmental implications of data and software in a measurable, interoperable, and transparent manner. This creates a foundation for reproducible research that simultaneously advances open science goals and decarbonisation objectives. However, integrating environmental accountability into established research workflows raises questions of feasibility, relevance, and acceptance across stakeholders and disciplines. In this work we validated the framework through a cross-disciplinary expert survey. The evaluation confirms its importance and practical relevance, but also reveals current gaps in researchers' awareness of green software practices.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes FAIR+S as an extension of the FAIR principles that incorporates environmental sustainability metrics (energy use, carbon footprint, life-cycle impacts) into metadata schemas, workflows, and development specifications for research data and software. It reports validation of the framework's feasibility, relevance, and acceptance via a cross-disciplinary expert survey, which the authors state confirms the framework's importance while highlighting gaps in researchers' awareness of green software practices.
Significance. If the survey evidence is methodologically sound, the work would be significant for bridging open-science infrastructure with decarbonization goals in computer science and engineering domains; the integration of sustainability into existing FAIR-aligned systems offers a scalable entry point without requiring entirely new standards.
major comments (1)
- [Survey Methodology] Survey Methodology section (or equivalent): the validation claim rests on a cross-disciplinary expert survey, yet the manuscript provides no details on survey design (questions, scales, or instruments), sampling frame, response rate, disciplinary coverage, or analysis methods to rule out selection bias or low statistical power. This directly undermines the central assertion that the survey demonstrates feasibility and acceptance across stakeholders.
minor comments (1)
- [Abstract/Introduction] The abstract and introduction use 'FAIR+S' and 'FAIR+Sustainability' interchangeably without an explicit definition on first use.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback on the survey methodology. We agree that additional details are necessary to support the validation claims and will revise the manuscript accordingly.
read point-by-point responses
-
Referee: [Survey Methodology] Survey Methodology section (or equivalent): the validation claim rests on a cross-disciplinary expert survey, yet the manuscript provides no details on survey design (questions, scales, or instruments), sampling frame, response rate, disciplinary coverage, or analysis methods to rule out selection bias or low statistical power. This directly undermines the central assertion that the survey demonstrates feasibility and acceptance across stakeholders.
Authors: We accept the referee's assessment that the manuscript currently lacks these methodological details, which weakens the presentation of the validation results. In the revised version we will insert a dedicated 'Survey Methodology' subsection that specifies: the survey instrument (full list of questions and response scales), the sampling frame and recruitment approach, the response rate, the disciplinary breakdown of the expert respondents, and the analysis procedures (including any steps taken to assess bias or statistical power). These additions will allow readers to evaluate the robustness of the feasibility and acceptance findings. revision: yes
Circularity Check
No circularity: validation rests on external survey data
full rationale
The paper presents a framework extension (FAIR+S) and validates it via a cross-disciplinary expert survey. No equations, derivations, fitted parameters, or self-citation chains appear in the load-bearing claims. The central assertion—that the survey confirms importance, relevance, and gaps in awareness—depends on external respondent data rather than reducing to internal definitions or prior author work by construction. This is a standard empirical validation structure with no self-referential reduction.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
The FAIR Guiding Principles for scientific data management and stewardship
Mark D. Wilkinson et al. “The FAIR Guiding Principles for scientific data management and stewardship”. In:Scientific Data3.1 (2016), p. 160018.DOI:10.1038/sdata.2016.18
-
[2]
Introducing the FAIR Principles for research software
Michelle Barker et al. “Introducing the FAIR Principles for research software”. In:Scientific Data9.1 (2022), p. 622.DOI:10.1038/s41597-022-01710-x
-
[3]
Towards FAIR Principles for Research Software
Anna-Lena Lamprecht et al. “Towards FAIR Principles for Research Software”. In:Data Science3.1 (2020), pp. 37–59.DOI:10.3233/DS-190026
-
[5]
Leticia Duboc et al. “Requirements engineering for sustainability: an awareness frame- work for designing software systems for a better tomorrow”. In:Requirements Engineering 25.4 (Dec. 2020), pp. 469–492.ISSN: 0947-3602.DOI:10.1007/s00766-020-00336-y
-
[6]
Sustainability design and software: the karlskrona manifesto
Christoph Becker et al. “Sustainability design and software: the karlskrona manifesto”. In: Proceedings of the 37th International Conference on Software Engineering - Volume 2. ICSE ’15. Florence, Italy: IEEE Press, 2015, pp. 467–476
2015
-
[7]
URL: https : / / www
Deutsche Forschungsgemeinschaft (DFG).Nachhaltigkeit im Forschungsprozess. URL: https : / / www . dfg . de / de / grundlagen - themen / entwicklungen - im - wissenschaftssystem/nachhaltigkeit- im- forschungsprozess, [Accessed: 2026-02- 17]. 2025
2026
-
[8]
Green Algorithms: Quantifying the Carbon Footprint of Computation
Lo ¨ıc Lannelongue, Jason Grealey, and Michael Inouye. “Green Algorithms: Quantifying the Carbon Footprint of Computation”. In:Advanced Science8.12 (2021), p. 2100707. DOI:10.1002/advs.202100707
-
[9]
Can Hankendi, Ayse K. Coskun, and Benjamin K. Sovacool. “Why transparency matters for sustainable data centers and carbon-neutral artificial intelligence (AI)”. In:iScience 28.11 (2025), p. 113705.ISSN: 2589-0042.DOI:10.1016/j.isci.2025.113705
-
[10]
Does the transparency of sustainability reports matter? A quantitative assessment
Maria Chiara Demartini, Valentina Beretta, and Anna Larisch. “Does the transparency of sustainability reports matter? A quantitative assessment”. In:Corporate Social Responsi- bility and Environmental Management32.1 (2025), pp. 18–43.DOI:10.1002/csr.2926
-
[11]
Linking Sustainability Reporting and Energy Use through Global Re- porting Initiative Standards and Sustainable Development Goals
P ´eter Moln´ar et al. “Linking Sustainability Reporting and Energy Use through Global Re- porting Initiative Standards and Sustainable Development Goals”. In:Clean Technologies and Environmental Policy27.12 (2025), pp. 8659–8667.ISSN: 1618-9558.DOI:10.1007/ s10098-024-03044-1
2025
-
[12]
Advancing Energy System Research with the FAIR+S Framework
Danila Valko et al. “Advancing Energy System Research with the FAIR+S Framework”. In: Proc. to the 3rd NFDI4Energy Conference: Defining Energy Research Data Management Together. Vol. 9. 2026.DOI:10.52825/ocp.v9i.3278. Valko et al.|PREPRINT
-
[13]
Danila Valko.When FAIR Isn’t Enough: Towards Sustainable Research Data and Soft- ware. SSRN. Sept. 2025.DOI:10.2139/ssrn.5546379
-
[14]
Climate Change: What is Computing’s Responsibility? (Dagstuhl Per- spectives Workshop 25122)
Bran Knowles et al. “Climate Change: What is Computing’s Responsibility? (Dagstuhl Per- spectives Workshop 25122)”. In:Dagstuhl Manifestos11.1 (2025). Ed. by Bran Knowles et al., pp. 1–18.ISSN: 2193-2433.DOI:10.4230/DagMan.11.1.1
-
[15]
PowerAPI: A Software Library to Monitor the Energy Consumed at the Process-Level
Aur ´elien Bourdon et al. “PowerAPI: A Software Library to Monitor the Energy Consumed at the Process-Level”. In:ERCIM News. Special Theme: Smart Energy Systems 92 (Jan. 2013). Ed. by ERCIM, pp. 43–44.URL:https://inria.hal.science/hal-00772454
2013
-
[16]
PowerAPI: A Python framework for building software-defined power meters
Guillaume Fieni et al. “PowerAPI: A Python framework for building software-defined power meters”. In:Journal of Open Source Software9.98 (2024), p. 6670.DOI:10.21105/joss. 06670
-
[17]
Version v3.0.3
Beno ˆıt Courty et al.mlco2/codecarbon: v3.0.3. Version v3.0.3. July 2025.DOI:10.5281/ zenodo.15870443
2025
-
[18]
Lukas Anthony, Benjamin Kanding, and Raghavendra Selvan.CarbonTracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models. 2021. arXiv:2007. 03051 [cs.CY]
2021
-
[19]
Aude Lacoste et al.Quantifying the Carbon Emissions of Machine Learning. 2019. arXiv: 1910.09700 [cs.CY]
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[20]
Roy Schwartz et al. “Green AI”. In:Communications of the ACM63.12 (Nov. 2020), pp. 54–63.ISSN: 0001-0782.DOI:10.1145/3381831
-
[21]
Accessed: 2026-02-18
NFDI4Energy Consortium.NFDI4Energy – National Research Data Infrastructure for In- terdisciplinary Energy System Research.https://www.nfdi4energy.uol.de. Accessed: 2026-02-18. 2025
2026
-
[22]
Balancing simplicity and complexity through corporate emissions benchmarking
Saphira Rekker et al. “Balancing simplicity and complexity through corporate emissions benchmarking”. In:Nature Climate Change(Oct. 2025).ISSN: 1758-6798.DOI:10.1038/ s41558-025-02467-y
2025
- [23]
-
[24]
SPEC: enabling efficiency measure- ment
Karl Huppler, Klaus-Dieter Lange, and John Beckett. “SPEC: enabling efficiency measure- ment”. In:Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering. ICPE ’12. Boston, Massachusetts, USA: Association for Computing Machin- ery, 2012, pp. 257–258.ISBN: 9781450312028.DOI:10.1145/2188286.2188331
-
[25]
URL:https://greensoftware.foundation/articles/decarbonize- software- 2023-redefining-the-future-of-software, [Accessed: 2026-02-17]
Green Software Foundation.Decarbonize Software 2023 – Redefining the Future of Soft- ware. URL:https://greensoftware.foundation/articles/decarbonize- software- 2023-redefining-the-future-of-software, [Accessed: 2026-02-17]. Nov. 2023
2023
-
[26]
World Wide Web Consortium (W3C).Web Sustainability Guidelines (WSG). Ed. by Alexander Dawson and Rose Newell. W3C Group Note Draft. Retrieved March 11, 2026 fromhttps://www.w3.org/TR/web-sustainability-guidelines/. 2026
2026
-
[27]
Janet Ranganathan. “A commentary comparing the GHG Protocol and E-liability ap- proaches to corporate GHG accounting and reporting”. In:Carbon Management15.1 (2024), p. 2397498.DOI:10.1080/17583004.2024.2397498
-
[28]
Greenhouse Gas Protocol
World Resources Institute and World Business Council for Sustainable Development. Greenhouse Gas Protocol. Retrieved March 11, 2026 fromhttps://ghgprotocol.org/. 2024
2026
-
[29]
European standard ; BS EN ISO 14044:2006+A2:2020
Environmental Management Technical Committee ISO/TC 207 and British Standards In- stitution.Environmental management : life cycle assessment : requirements and guide- lines.eng. European standard ; BS EN ISO 14044:2006+A2:2020. London: BSI Standards Limited, 2021.ISBN: 9780539013498. Valko et al.|PREPRINT
2006
-
[30]
URL: https://www.software.ac.uk/GreenDiSC, [Accessed: 2026-02-19]
Software Sustainability Institute.Green DiSC: a Digital Sustainability Certification. URL: https://www.software.ac.uk/GreenDiSC, [Accessed: 2026-02-19]. 2026
2026
-
[31]
Digital Measuring, Reporting, and Verification (dMRV) for De- carbonization
Marc-Fabian K ¨orner et al. “Digital Measuring, Reporting, and Verification (dMRV) for De- carbonization”. In:Business & Information Systems Engineering67.5 (2025), pp. 753– 765.ISSN: 1867-0202.DOI:10.1007/s12599-025-00953-3
- [32]
-
[33]
Rahul Ramesh Nair et al. “A generalized schema to publish and share life cycle inventories (LCI): Exemplary case of an aviation fuel supply chain”. In:Journal of Cleaner Production 520 (2025), p. 146120.ISSN: 0959-6526.DOI:10.1016/j.jclepro.2025.146120
-
[34]
Design Science in Information Systems Research
Alan R. Hevner et al. “Design Science in Information Systems Research”. In:MIS Quar- terly28.1 (2004), pp. 75–105
2004
-
[35]
A Design Science Research Methodology for Information Systems Research
Ken Peffers et al. “A Design Science Research Methodology for Information Systems Research”. In:Journal of Management Information Systems24.3 (2007), pp. 45–77.DOI: 10.2753/MIS0742-1222240302
-
[36]
Scott Armstrong, ed.Expert Opinions in Forecasting: The Role of the Delphi Technique
J. Scott Armstrong, ed.Expert Opinions in Forecasting: The Role of the Delphi Technique. Boston, MA: Springer, 2001, pp. 125–144.ISBN: 978-0-306-47630-3.DOI:10.1007/978- 0-306-47630-3_7
-
[37]
M. A. Burgman et al. “Expert Status and Performance”. In:PLoS ONE6.7 (2011), e22998. DOI:10.1371/journal.pone.0022998
-
[38]
Reviewing the Evidence: Expert Selec- tion, Level of Elicitation, Fitting and Pooling
Laura Bojke, Marta Soares, Karl Claxton, et al. “Reviewing the Evidence: Expert Selec- tion, Level of Elicitation, Fitting and Pooling”. In:Developing a Reference Protocol for Structured Expert Elicitation in Health-Care Decision-Making: A Mixed-Methods Study. Vol. 25. Health Technology Assessment 37. Southampton, UK: NIHR Journals Library,
-
[39]
5.URL:https://www.ncbi.nlm.nih.gov/books/NBK571048/
Chap. 5.URL:https://www.ncbi.nlm.nih.gov/books/NBK571048/
-
[40]
URL:https://www.refworld.org/legal/ resolution/unga/2015/en/111816, [Accessed: 2026-02-17]
United Nations General Assembly.Resolution A/RES/70/1, Transforming our world: the 2030 Agenda for Sustainable Development. URL:https://www.refworld.org/legal/ resolution/unga/2015/en/111816, [Accessed: 2026-02-17]. Sept. 2015
2030
-
[41]
Dillman, Jolene D
Don A. Dillman, Jolene D. Smyth, and Leah Melani Christian.Internet, Phone, Mail, and Mixed Mode Surveys: The Tailored Design Method. 4th ed. Hoboken, NJ, USA: John Wiley & Sons, Inc., 2014.ISBN: 978-1-118-45614-9
2014
-
[42]
Identifying Expertise to Extract the Wisdom of Crowds
David V. Budescu and Eva Chen. “Identifying Expertise to Extract the Wisdom of Crowds”. In:Management Science61.2 (2014), pp. 267–280.DOI:10.1287/mnsc.2014.1909
-
[43]
Harry N. Jr. Boone and Deborah A. Boone. “Analyzing Likert Data”. In:Journal of Exten- sion50.2 (2012), p. 48.DOI:10.34068/joe.50.02.48
-
[44]
Evaluating Survey Questions: A Com- parison of Methods
Ting Y an, Frauke Kreuter, and Roger Tourangeau. “Evaluating Survey Questions: A Com- parison of Methods”. In:Journal of Official Statistics28.4 (2012), pp. 503–529
2012
-
[45]
Marco R. Steenbergen and Gary Marks. “Evaluating Expert Judgments”. In:European Journal of Political Research46.3 (2007), pp. 347–366.DOI:10 . 1111 / j . 1475 - 6765 . 2006.00694.x
-
[46]
Barend Mons et al. “Cloudy, icreasingly FAIR; revisiting the FAIR Data guiding principles for the European Open Science Cloud”. In:Information Services and Use37.1 (2017), pp. 49–56.DOI:10.3233/ISU-170824. [46]Implementation & Adoption Stories. FAIRsFAIR project. URL:https://www.fairsfair. eu/implementation-adoption-stories, [Accessed: 2026-02-17]. 2022
-
[47]
URL:https : / / learn
Microsoft.Measure Azure App Sustainability by Using the SCI Score. URL:https : / / learn . microsoft . com / en - us / azure / architecture / example - scenario / apps / measure-azure-app-sustainability-sci-score, [Accessed: 2026-02-17]. 2026. Valko et al.|PREPRINT
2026
-
[48]
https://soft.greensoftware.foundation/
Green Software Foundation.Transform Y our Organization for Sustainable Software. https://soft.greensoftware.foundation/. Accessed: 2026-02-18. 2026
2026
-
[49]
Astrid Nieße et al.NFDI4Energy – National Research Data Infrastructure for Interdisci- plinary Energy System Research: Progress Report. Mar. 2026.DOI:10.5281/zenodo. 18744051
-
[50]
Philipp Schmurr et al.D4.3.2 List of Metadata Standards and Relevance for NFDI4Energy. Nov. 2025.DOI:10.5281/zenodo.17549282
-
[51]
Ver- sion 2.0.4
Ludwig H ¨ulk et al.Open Energy Family - Open Energy Metadata (OEMetadata). Ver- sion 2.0.4. Jan. 2025.URL:https://github.com/OpenEnergyPlatform/oemetadata
2025
-
[52]
Ramiz Qussous et al.D5.1.1.2 Energy simulation software metadata schema. Jan. 2026. DOI:10.5281/zenodo.18390186
-
[53]
Stephan Ferenz, Oliver Werth, and Astrid Nieße.Towards a Metadata Schema for Energy Research Software. 2026. arXiv:2601.09456 [cs.SE]. [54]Towards a Simulation-as-a-Service Hub for the Energy Domain. Zenodo, Mar. 2025.DOI: 10.5281/zenodo.15065996.URL:https://doi.org/10.5281/zenodo.15065996
work page doi:10.5281/zenodo.15065996.url:https://doi.org/10.5281/zenodo.15065996 2026
-
[54]
Roger L. Burritt, Tobias Hahn, and STefan Schaltegger. “Towards a Comprehensive Framework for Environmental Management Accounting — Links Between Business Ac- tors and Environmental Management Accounting Tools”. In:Australian Accounting Review 12.27 (2002), pp. 39–50.DOI:10.1111/j.1835-2561.2002.tb00202.x
-
[55]
FEDS: a Framework for Eval- uation in Design Science Research
John Venable, Jan Pries-Heje, and Richard Baskerville. “FEDS: a Framework for Eval- uation in Design Science Research”. In:European Journal of Information Systems25.1 (2016), pp. 77–89.ISSN: 1476-9344.DOI:10.1057/ejis.2014.36
-
[56]
Rogers.Diffusion of Innovations
Everett M. Rogers.Diffusion of Innovations. 5th. New Y ork: Free Press, 2003.ISBN: 978- 0743222099
2003
-
[57]
Rod Ward. “The application of technology acceptance and diffusion of innovation models in healthcare informatics”. In:Health Policy and Technology2.4 (2013), pp. 222–228. ISSN: 2211-8837.DOI:10.1016/j.hlpt.2013.07.002
-
[58]
Methods for Testing and Evaluating Survey Questions
Stanley Presser et al. “Methods for Testing and Evaluating Survey Questions”. In:Methods for Testing and Evaluating Survey Questionnaires. John Wiley & Sons, Ltd, 2004. Chap. 1, pp. 1–22.ISBN: 9780471654728.DOI:10.1002/0471654728.ch1
-
[59]
Qualitative Content Analysis: Theoretical Background and Procedures
Philipp Mayring. “Qualitative Content Analysis: Theoretical Background and Procedures”. In:Approaches to Qualitative Research in Mathematics Education: Examples of Method- ology and Methods. Ed. by Angelika Bikner-Ahsbahs, Christine Knipping, and Norma Presmeg. Dordrecht: Springer Netherlands, 2015, pp. 365–380.ISBN: 978-94-017-9181- 6.DOI:10.1007/978-94-...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.