REVIEW 4 cited by
How LLMs Aid in UML Modeling: An Exploratory Study with Novice Analysts
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Since the emergence of GPT-3, Large Language Models (LLMs) have caught the eyes of researchers, practitioners, and educators in the field of software engineering. However, there has been relatively little investigation regarding the performance of LLMs in assisting with requirements analysis and UML modeling. This paper explores how LLMs can assist novice analysts in creating three types of typical UML models: use case models, class diagrams, and sequence diagrams. For this purpose, we designed the modeling tasks of these three UML models for 45 undergraduate students who participated in a requirements modeling course, with the help of LLMs. By analyzing their project reports, we found that LLMs can assist undergraduate students as novice analysts in UML modeling tasks, but LLMs also have shortcomings and limitations that should be considered when using them.
Forward citations
Cited by 4 Pith papers
-
MermaidSeqBench: An Evaluation Benchmark for NL-to-Mermaid Sequence Diagram Generation
MermaidSeqBench is a new human-verified benchmark for evaluating LLMs on natural language to Mermaid sequence diagram generation, revealing significant capability gaps across models.
-
Large Language Models for Software Engineering Diagrams: A Systematic Review of UML and ER modelling
A systematic review of 64 papers finds LLM research on software diagrams is concentrated on UML class-diagram generation, dominated by GPT models, and held back by weak evaluation and scarce shared benchmarks.
-
Development of Automated Software Design Document Review Methods Using Large Language Models
Converting tabular design documents into header-aware Markdown or JSON formats lets GPT models catch cross-document inconsistencies with recall up to 0.96 on short documents, but performance collapses beyond 5000 characters.
-
Understanding the Human-LLM Dynamic: A Literature Survey of LLM Use in Programming Tasks
A survey of user studies on LLM use in programming that identifies interaction behaviors, mixed benefits and weaknesses, and factors influencing human and task performance.
Discussion (0). Sign in to comment.