MAC-Bench is a new adversarial benchmark that converts legal texts into executable scenarios via the SERV pipeline to measure procedural compliance in multi-agent LLM systems using CSR and MG metrics.
A Case Study for Compliance as Code with Graphs and Language Models: Public release of the Regulatory Knowledge Graph
2 Pith papers cite this work. Polarity classification is still indexing.
abstract
The paper presents a study on using language models to automate the construction of executable Knowledge Graph (KG) for compliance. The paper focuses on Abu Dhabi Global Market regulations and taxonomy, involves manual tagging a portion of the regulations, training BERT-based models, which are then applied to the rest of the corpus. Coreference resolution and syntax analysis were used to parse the relationships between the tagged entities and to form KG stored in a Neo4j database. The paper states that the use of machine learning models released by regulators to automate the interpretation of rules is a vital step towards compliance automation, demonstrates the concept querying with Cypher, and states that the produced sub-graphs combined with Graph Neural Networks (GNN) will achieve expandability in judgment automation systems. The graph is open sourced on GitHub to provide structured data for future advancements in the field.
years
2026 2representative citing papers
ASSERT extracts legacy IT security concepts into document graphs, quantifies five classes of node/edge inconsistency against an independent reference graph, and exports schema-valid OSCAL SSP and AR artifacts.
citing papers explorer
-
Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systems
MAC-Bench is a new adversarial benchmark that converts legal texts into executable scenarios via the SERV pipeline to measure procedural compliance in multi-agent LLM systems using CSR and MG metrics.
-
Reverse Engineering Compliance: A Dual-Graph Verification Framework for Auditing Legacy IT Security Concepts
ASSERT extracts legacy IT security concepts into document graphs, quantifies five classes of node/edge inconsistency against an independent reference graph, and exports schema-valid OSCAL SSP and AR artifacts.