Pith. Sign in

RECORD

Using Large Language Models for a standard assessment mapping for sustainable communities

Computers and Society · Submitted 31 Oct 2024

abstract compiled · 2026-09-23 · no language-model review

The authors' main claim The results show the effectiveness of LLMs in quickly and consistently categorising different urban initiatives according to sustainability criteria.

how it is stated · asserted 1.00 read the record →

Comment (0) Read on arXiv ↗
Cite ▾
arXiv ID2411.00208 (version 2)
Pith IDCI3DC66P, Pith's permanent record of this paper and its review
CitationLuc Jonveaux. "Using Large Language Models for a standard assessment mapping for sustainable communities." arXiv:2411.00208 (2024). https://pith.science/paper/CI3DC66P
Claim paper

The compiled record

The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.

Open the compiled record

Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-23: 1 request, 5,686 input tokens.

What the abstract itself states, as probabilities: claims first 0.12 · states limitation 0.93 · human participants 0.16 · controlled comparison 0.10 · randomized assignment 0.02 · states quantitative result 0.37 · compares with prior results 0.54 · mentions code or data availability 0.03.

The abstract, sentence by sentence

arXiv listing abstract v2. Results and the main claim are underlined; .

This paper presents a new approach to urban sustainability assessment through the use of Large Language Models (LLMs) to streamline the use of the ISO 37101 framework to automate and standardise the assessment of urban initiatives against the six "sustainability purposes" and twelve "issues" outlined in the standard. The methodology includes the development of a custom prompt based on the standard definitions and its application to two different datasets: 527 projects from the Paris Participatory Budget and 398 activities from the PROBONO Horizon 2020 project. The results show the effectiveness of LLMs in quickly and consistently categorising different urban initiatives according to sustainability criteria. The approach is particularly promising when it comes to breaking down silos in urban planning by providing a holistic view of the impact of projects. The paper discusses the advantages of this method over traditional human-led assessments, including significant time savings and improved consistency. However, it also points out the importance of human expertise in interpreting results and ethical considerations. This study hopefully can contribute to the growing body of work on AI applications in urban planning and provides a novel method for operationalising standardised sustainability frameworks in different urban contexts.

background contribution method result interpretation main claim

What the classifier reports for each sentence. The number is the probability it gave the label.
#sentencerolethe authors' own workstates the main conclusionstrength
s0 This paper presents a new approach to urban sustainability assessment through the use of Large Language Models (LLMs) to streamline the use of the ISO 37101 framework to automate and standardise the assessment of urban initiatives against the six "sustainability purposes" and twelve "issues" outlined in the standard. contribution 1.00 0.77 0.14 asserted 0.99
s1 The methodology includes the development of a custom prompt based on the standard definitions and its application to two different datasets: 527 projects from the Paris Participatory Budget and 398 activities from the PROBONO Horizon 2020 project. method 1.00 0.94 0.03 asserted 0.98
s2 The results show the effectiveness of LLMs in quickly and consistently categorising different urban initiatives according to sustainability criteria. result 0.99 0.94 0.68 asserted 1.00
s3 The approach is particularly promising when it comes to breaking down silos in urban planning by providing a holistic view of the impact of projects. interpretation 0.99 0.49 0.12 hedged possibility 0.68
s4 The paper discusses the advantages of this method over traditional human-led assessments, including significant time savings and improved consistency. interpretation 0.50 0.67 0.14 asserted 0.99
s5 However, it also points out the importance of human expertise in interpreting results and ethical considerations. limitation 1.00 0.58 0.07 asserted 0.89
s6 This study hopefully can contribute to the growing body of work on AI applications in urban planning and provides a novel method for operationalising standardised sustainability frameworks in different urban contexts. future work 0.62 0.18 0.11 hedged possibility 0.90

What kind of paper the classifier reports this is: method or tool 0.99 · evidence from analysis of existing data 0.66.

What was examined, and what was not

sources read
  • arXiv listing abstract v2
not examined
  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers
levels run
  • P abstract
not run
  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. Every number in the measurements table is the authors', checked by code. Record as JSON

The paper
Original abstract

This paper presents a new approach to urban sustainability assessment through the use of Large Language Models (LLMs) to streamline the use of the ISO 37101 framework to automate and standardise the assessment of urban initiatives against the six "sustainability purposes" and twelve "issues" outlined in the standard. The methodology includes the development of a custom prompt based on the standard definitions and its application to two different datasets: 527 projects from the Paris Participatory Budget and 398 activities from the PROBONO Horizon 2020 project. The results show the effectiveness of LLMs in quickly and consistently categorising different urban initiatives according to sustainability criteria. The approach is particularly promising when it comes to breaking down silos in urban planning by providing a holistic view of the impact of projects. The paper discusses the advantages of this method over traditional human-led assessments, including significant time savings and improved consistency. However, it also points out the importance of human expertise in interpreting results and ethical considerations. This study hopefully can contribute to the growing body of work on AI applications in urban planning and provides a novel method for operationalising standardised sustainability frameworks in different urban contexts.

Human review

Discussion

Know something about this paper? Leave a comment, or highlight any passage above to comment on it.