A new dataset and head-to-head comparison of nine process model representations with LLMs finds Mermaid best for general use and BPMN text best for generation.
PET: An Annotated Dataset for Process Extraction from Natural Language Text
1 Pith paper cite this work, alongside 1 external citations. Polarity classification is still indexing.
abstract
Process extraction from text is an important task of process discovery, for which various approaches have been developed in recent years. However, in contrast to other information extraction tasks, there is a lack of gold-standard corpora of business process descriptions that are carefully annotated with all the entities and relationships of interest. Due to this, it is currently hard to compare the results obtained by extraction approaches in an objective manner, whereas the lack of annotated texts also prevents the application of data-driven information extraction methodologies, typical of the natural language processing field. Therefore, to bridge this gap, we present the PET dataset, a first corpus of business process descriptions annotated with activities, gateways, actors, and flow information. We present our new resource, including a variety of baselines to benchmark the difficulty and challenges of business process extraction from text. PET can be accessed via huggingface.co/datasets/patriziobellan/PET
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
What is the Best Process Model Representation? A Comparative Analysis for Process Modeling with Large Language Models
A new dataset and head-to-head comparison of nine process model representations with LLMs finds Mermaid best for general use and BPMN text best for generation.