Pith. sign in

REVIEW 2 cited by

Autoformalization of Game Descriptions using Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2409.12300 v1 pith:YNINCYTU submitted 2024-09-18 cs.AI cs.GT

classification cs.AIcs.GT
keywords formallanguagecorrectnessdescriptionsframeworknaturalreasoningautoformalization
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Game theory is a powerful framework for reasoning about strategic interactions, with applications in domains ranging from day-to-day life to international politics. However, applying formal reasoning tools in such contexts is challenging, as these scenarios are often expressed in natural language. To address this, we introduce a framework for the autoformalization of game-theoretic scenarios, which translates natural language descriptions into formal logic representations suitable for formal solvers. Our approach utilizes one-shot prompting and a solver that provides feedback on syntactic correctness to allow LLMs to refine the code. We evaluate the framework using GPT-4o and a dataset of natural language problem descriptions, achieving 98% syntactic correctness and 88% semantic correctness. These results show the potential of LLMs to bridge the gap between real-life strategic interactions and formal reasoning.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Generative Agents for Multi-Agent Autoformalization of Interaction Scenarios

    cs.AI 2024-12 conditional novelty 6.0 of 10

    GAMA uses LLM agents to turn natural language game descriptions into validated executable logic programs, reaching about 77% semantic correctness on 110 scenarios from five 2x2 games.

  2. Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontiers

    cs.AI 2025-02 conditional novelty 5.0 of 10

    A taxonomy-based survey of bidirectional game theory and LLM research, spanning evaluation, alignment, economic competition, and LLM-driven game solving.

Pith tools