pith. sign in

arxiv: 1907.00246 · v1 · pith:MNVWSKSYnew · submitted 2019-06-29 · 💻 cs.AI

Ludii as a Competition Platform

Matthew Stephenson , \'Eric Piette , Dennis J. N. J. Soemers , Cameron Browne This is my paper

Pith reviewed 2026-05-25 12:40 UTC · model grok-4.3

classification 💻 cs.AI
keywords Ludiigeneral game playingAI competitionsstrategy gamesgame AIcompetition platformtraditional games
0
0 comments X

The pith

Ludii can host AI competitions on traditional strategy games to improve algorithms beyond current platforms.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper argues that the Ludii general game system, built to model and play traditional strategy games, can also run a variety of AI research competitions and challenges. It outlines planned events that exploit the system's flexibility to test and advance game-playing algorithms. The description compares these plans to existing general game playing competitions, noting where Ludii can fill gaps in coverage and evaluation. A sympathetic reader would see this as opening new ways to study AI methods across a broader set of games than before.

Core claim

Ludii is a general game system that models, plays, and analyzes the full range of traditional strategy games; it therefore has the capacity to support multiple AI research topics and competitions whose design can highlight algorithm strengths and weaknesses while addressing limitations of prior general game playing platforms.

What carries the argument

Ludii, the general game system that represents games in a form allowing flexible play and analysis for competition design.

If this is right

  • Ludii competitions can test AI methods on a wider set of traditional games than current platforms allow.
  • The system can expose specific weaknesses in existing algorithms through targeted challenges.
  • New research avenues open by combining game modeling with competition formats that differ from prior general game playing events.
  • Comparisons show where Ludii reduces certain platform limitations while retaining useful features from earlier systems.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Competitions could later include games whose rules change over time or depend on cultural context.
  • Results from Ludii events might feed back into better automated game rule discovery methods.
  • The platform could support hybrid human-AI play formats not emphasized in earlier competitions.

Load-bearing premise

Ludii will be completed and actually able to run the competitions and challenges described.

What would settle it

No public release of Ludii occurs, or none of the proposed competitions are ever conducted.

Figures

Figures reproduced from arXiv: 1907.00246 by Cameron Browne, Dennis J. N. J. Soemers, \'Eric Piette, Matthew Stephenson.

Figure 1
Figure 1. Figure 1: A completed game of Hex, played out on the Ludii system, along with the its ludeme-based game description. [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
read the original abstract

Ludii is a general game system being developed as part of the ERC-funded Digital Ludeme Project (DLP). While its primary aim is to model, play, and analyse the full range of traditional strategy games, Ludii also has the potential to support a wide range of AI research topics and competitions. This paper describes some of the future competitions and challenges that we intend to run using the Ludii system, highlighting some of its most important aspects that can potentially lead to many algorithm improvements and new avenues of research. We compare and contrast our proposed competition motivations, goals and frameworks against those of existing general game playing competitions, addressing the strengths and weaknesses of each platform.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 1 minor

Summary. The paper describes the Ludii general game system (under development as part of the Digital Ludeme Project) and proposes its future use as a platform for AI competitions and challenges focused on traditional strategy games. It outlines intended competition motivations, goals and frameworks, highlights aspects expected to drive algorithm improvements, and compares these to existing general game playing platforms while addressing their respective strengths and weaknesses.

Significance. If the described competitions are realized, Ludii could broaden AI research in general game playing by encompassing a wider range of games than current platforms and enabling new research directions; the position-paper format means significance rests on the clarity of the proposed framework rather than demonstrated results.

minor comments (1)
  1. [Abstract] The abstract and introduction would benefit from one concrete, brief example of a proposed competition (e.g., a specific game type or evaluation metric) to make the claimed advantages over existing platforms more tangible for readers.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for their positive assessment and recommendation to accept the paper. The report contains no major comments requiring a point-by-point response.

Circularity Check

0 steps flagged

No significant circularity

full rationale

The paper is a forward-looking position/proposal document describing intended future competitions and challenges for the Ludii system (then under development). It contains no equations, derivations, predictions, or first-principles results. All content is descriptive comparison of platforms at a high level, with no load-bearing steps that reduce to fitted parameters, self-citations of theorems, or self-definitional claims. The central claims concern potential capabilities rather than completed technical results, so no circularity is present.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 1 invented entities

The central claims rest on the future successful development of the Ludii system as part of the Digital Ludeme Project, with no mathematical axioms, free parameters, or independently evidenced entities detailed in the abstract.

invented entities (1)
  • Ludii no independent evidence
    purpose: General game system to model, play, analyze traditional strategy games and support AI competitions
    Presented as the core platform being developed, with no independent evidence or validation provided in the abstract.

pith-pipeline@v0.9.0 · 5638 in / 1016 out tokens · 53715 ms · 2026-05-25T12:40:24.491089+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Reference graph

Works this paper leans on

61 extracted references · 61 canonical work pages · 2 internal anchors

  1. [1]

    G. N. Yannakakis and J. Togelius, Artificial Intelligence and Games . Springer, 2018, http://gameaibook.org

    work page 2018

  2. [2]

    Digital computers applied to games,

    A. M. Turing, “Digital computers applied to games,” Faster than thought (ed. B.V . Bowden), pp. 286–297, 1953

    work page 1953

  3. [3]

    Stockfish: Strong open source chess engine,

    T. Romstad, M. Costalba, J. Kiiski, and G. Linscott, “Stockfish: Strong open source chess engine,” https://stockfishchess.org/, 2008

    work page 2008

  4. [4]

    Mastering the game of go with deep neural networks and tree search,

    D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. van den Driessche, J. Schrittwieser, I. Antonoglou, V . Panneershelvam, M. Lanc- tot, S. Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T. P. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, and D. Hassabis, “Mastering the game of go with deep neural networks and tree search,” Nature,...

    work page 2016

  5. [5]

    A general reinforcement learning algorithm that masters chess, shogi, and go through self-play,

    D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, T. Lillicrap, K. Simonyan, and D. Hassabis, “A general reinforcement learning algorithm that masters chess, shogi, and go through self-play,” Science, vol. 362, no. 6419, pp. 1140–1144, 2018

    work page 2018

  6. [6]

    Learning to play draughts using temporal difference learning with neural networks and databases,

    J. P. Patist and M. Wiering, “Learning to play draughts using temporal difference learning with neural networks and databases,” in Proc. 13th Belgian-Dutch Conf. Mach. Learn. , 2004, pp. 87–94

    work page 2004

  7. [7]

    Temporal difference learning and td-gammon,

    G. Tesauro, “Temporal difference learning and td-gammon,” Commun. ACM, vol. 38, no. 3, pp. 58–68, 1995

    work page 1995

  8. [8]

    An intentional AI for hanabi,

    M. Eger, C. Martens, and M. A. Cordoba, “An intentional AI for hanabi,” in 2017 IEEE Conf. Comput. Intell. Games , 2017, pp. 68–75

    work page 2017

  9. [9]

    Computer poker: A review,

    J. Rubin and I. Watson, “Computer poker: A review,” Artif. Intell., vol. 175, no. 5, pp. 958–987, 2011

    work page 2011

  10. [10]

    The mario AI benchmark and compe- titions,

    S. Karakovskiy and J. Togelius, “The mario AI benchmark and compe- titions,” IEEE Trans. Comput. Intell. AI Games, vol. 4, no. 1, pp. 55–67, 2012

    work page 2012

  11. [11]

    A survey of real-time strategy game AI research and competition in starcraft,

    S. Ontan, G. Synnaeve, A. Uriarte, F. Richoux, D. Churchill, and M. Preuss, “A survey of real-time strategy game AI research and competition in starcraft,” IEEE Trans. Comput. Intell. AI Games , vol. 5, no. 4, pp. 293–311, 2013

    work page 2013

  12. [12]

    The 2017 AIBIRDS Competition

    M. Stephenson, J. Renz, X. Ge, and P. Zhang, “The 2017 AIBIRDS competition,” CoRR, vol. abs/1803.05156, 2018

    work page internal anchor Pith review Pith/arXiv arXiv 2017

  13. [13]

    Ms pac-man versus ghost team CEC 2011 competition,

    P. Rohlfshagen and S. Lucas, “Ms pac-man versus ghost team CEC 2011 competition,” in 2011 IEEE Congr. Evol. Computation, 2011, pp. 70–77

    work page 2011

  14. [14]

    ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning

    M. Kempka, M. Wydmuch, G. Runc, J. Toczek, and W. Jaskowski, “Vizdoom: A doom-based AI research platform for visual reinforcement learning,” CoRR, vol. abs/1605.02097, 2016

    work page internal anchor Pith review Pith/arXiv arXiv 2016

  15. [15]

    Controlling unreal tournament 2004 bots with the logic-based action language golog,

    S. Jacobs, A. Ferrein, and G. Lakemeyer, “Controlling unreal tournament 2004 bots with the logic-based action language golog,” in Proc. 1st AAAI Conf. Artif. Intell. Interactive Digital Entertainment , ser. AIIDE’05. AAAI Press, 2010, pp. 151–152

    work page 2004

  16. [16]

    How to run a successful game-based AI competition,

    J. Togelius, “How to run a successful game-based AI competition,” IEEE Trans. Comput. Intell. AI Games , vol. 8, no. 1, pp. 95–100, 2016

    work page 2016

  17. [17]

    Mastering the game of go with deep neural networks and tree search,

    D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. van den Driessche, J. Schrittwieser, I. Antonoglou, V . Panneershelvam, M. Lanc- tot, S. Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, and D. Hassabis, “Mastering the game of go with deep neural networks and tree search,” Nature, vo...

    work page 2016

  18. [18]

    Mastering the game of Go without human knowledge,

    D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, Y . Chen, T. Lillicrap, F. Hui, L. Sifre, G. van den Driessche, T. Graepel, and D. Hassabis, “Mastering the game of Go without human knowledge,” Nature, vol. 550, pp. 354–359, 2017

    work page 2017

  19. [19]

    Heads-up limit hold’em poker is solved,

    M. Bowling, N. Burch, M. Johanson, and O. Tammelin, “Heads-up limit hold’em poker is solved,” Science, vol. 347, no. 6218, pp. 145–149, 2015

    work page 2015

  20. [20]

    Superhuman AI for heads-up no-limit poker: Libratus beats top professionals,

    N. Brown and T. Sandholm, “Superhuman AI for heads-up no-limit poker: Libratus beats top professionals,” Science, vol. 359, no. 6374, pp. 418–424, 2018

    work page 2018

  21. [21]

    Parallelization of alpha-beta pruning algorithm for enhancing the two player games,

    A. Kumari, S. Singh, S. Dalmia, and G. V , “Parallelization of alpha-beta pruning algorithm for enhancing the two player games,” Int. J. Advances Electronics Comput. Sci. , vol. 4, pp. 74–81, 2017

    work page 2017

  22. [22]

    AI researchers, video games are your friends!

    J. Togelius, “AI researchers, video games are your friends!” in 7th Int. Joint Conf. Comput. Intell. (IJCCI) , vol. 2, 2015, pp. 5–5

    work page 2015

  23. [23]

    Prolonets: Neural-encoding human experts’ domain knowledge to warm start reinforcement learning,

    A. Silva and M. C. Gombolay, “Prolonets: Neural-encoding human experts’ domain knowledge to warm start reinforcement learning,” CoRR, vol. abs/1902.06007, 2019

    work page arXiv 1902

  24. [24]

    Symbolic reasoning for hearthstone,

    A. Stiegler, K. P. Dahal, J. Maucher, and D. Livingstone, “Symbolic reasoning for hearthstone,” IEEE Trans. Games, vol. 10, no. 2, pp. 113– 127, 2018

    work page 2018

  25. [25]

    Towards cognitively plausible game playing systems,

    J. Mandziuk, “Towards cognitively plausible game playing systems,” IEEE Comput. Intell. Magazine , vol. 6, no. 2, pp. 38–51, 2011

    work page 2011

  26. [26]

    Towards automatic person- alised content creation for racing games,

    J. Togelius, R. De Nardi, and S. M. Lucas, “Towards automatic person- alised content creation for racing games,” in 2007 IEEE Symp. Comput. Intell. Games, 2007, pp. 252–259

    work page 2007

  27. [27]

    Shaker, J

    N. Shaker, J. Togelius, and M. J. Nelson, Procedural Content Generation in Games: A Textbook and an Overview of Current Research. Springer, 2016

    work page 2016

  28. [28]

    Procedural content generation for games: A survey,

    M. Hendrikx, S. Meijer, J. Van Der Velden, and A. Iosup, “Procedural content generation for games: A survey,” ACM Trans. Multimedia Comput. Commun. Appl. , vol. 9, no. 1, pp. 1:1–1:22, 2013

    work page 2013

  29. [29]

    Search- based procedural content generation: A taxonomy and survey,

    J. Togelius, G. N. Yannakakis, K. O. Stanley, and C. Browne, “Search- based procedural content generation: A taxonomy and survey,” IEEE Trans. Comput. Intell. AI Games , vol. 3, no. 3, pp. 172–186, 2011

    work page 2011

  30. [30]

    Procedural level gen- eration with answer set programming for general video game playing,

    X. Neufeld, S. Mostaghim, and D. Perez-Liebana, “Procedural level gen- eration with answer set programming for general video game playing,” in 7th Comput. Sci. Electronic Eng. Conf. , 2015, pp. 207–212

    work page 2015

  31. [31]

    Towards generating arcade game rules with VGDL,

    T. S. Nielsen, G. A. B. Barros, J. Togelius, and M. J. Nelson, “Towards generating arcade game rules with VGDL,” in 2015 IEEE Conf. Comput. Intell. Games, 2015, pp. 185–192

    work page 2015

  32. [32]

    Recent ad- vances in general game playing,

    M. ´Swiechowski, H. Park, J. Ma ´ndziuk, and K.-J. Kim, “Recent ad- vances in general game playing,” The Scientific World Journal , 2015

    work page 2015

  33. [33]

    General video game AI: a multi-track framework for evaluating agents, games and content generation algorithms,

    D. Perez, J. Liu, A. Abdel Samea Khalifa, R. D. Gaina, J. Togelius, and S. M. Lucas, “General video game AI: a multi-track framework for evaluating agents, games and content generation algorithms,” IEEE Trans. Games, 2019, in press

    work page 2019

  34. [34]

    General game playing: Overview of the AAAI competition,

    M. R. Genesereth, N. Love, and B. Pell, “General game playing: Overview of the AAAI competition,” AI Magazine, vol. 26, no. 2, pp. 62–72, 2005

    work page 2005

  35. [35]

    General video game ai: Competition, challenges, and oppor- tunities,

    D. Perez-Liebana, S. Samothrakis, J. Togelius, S. M. Lucas, and T. Schaul, “General video game ai: Competition, challenges, and oppor- tunities,” in Proc. 30th AAAI Conf. Artif. Intell. , ser. AAAI’16, 2016, pp. 4335–4337

    work page 2016

  36. [36]

    The arcade learning environment: An evaluation platform for general agents,

    M. G. Bellemare, Y . Naddaf, J. Veness, and M. Bowling, “The arcade learning environment: An evaluation platform for general agents,” J. Artif. Intell. Res. , vol. 47, no. 1, pp. 253–279, 2013

    work page 2013

  37. [37]

    Revisiting the arcade learning environment: Evalu- ation protocols and open problems for general agents,

    M. C. Machado, M. G. Bellemare, E. Talvitie, J. Veness, M. Hausknecht, and M. Bowling, “Revisiting the arcade learning environment: Evalu- ation protocols and open problems for general agents,” J. Artif. Intell. Res., vol. 61, pp. 523–562, 2017

    work page 2017

  38. [38]

    Modern techniques for ancient games,

    C. Browne, “Modern techniques for ancient games,” in IEEE Conf. Comput. Intell. Games , 2018, pp. 490–497

    work page 2018

  39. [39]

    The international general game playing competition,

    M. R. Genesereth and Y . Bj ¨ornsson, “The international general game playing competition,” AI Magazine, vol. 34, pp. 107–111, 2013

    work page 2013

  40. [40]

    General game playing: Game description language specification,

    N. Love, T. Hinrichs, D. Haley, E. Schkufza, and M. Genesereth, “General game playing: Game description language specification,” 2008

    work page 2008

  41. [41]

    Representing and reasoning about the rules of general games with imperfect information,

    S. Schiffel and M. Thielscher, “Representing and reasoning about the rules of general games with imperfect information,” J. Artif. Intell. Res., vol. 49, pp. 171–206, 2014

    work page 2014

  42. [42]

    GDL-III: A description language for epistemic general game playing,

    M. Thielscher, “GDL-III: A description language for epistemic general game playing,” in Proc. 26th Int. Joint Conf. Artif. Intell. , 2017, pp. 1276–1282

    work page 2017

  43. [43]

    Arimaa - a new game designed to be difficult for computers,

    O. Syed and A. Syed, “Arimaa - a new game designed to be difficult for computers,” ICGA Journal, vol. 26, pp. 138–139, 2003

    work page 2003

  44. [44]

    The 2014 general video game playing competition,

    D. Perez-Liebana, S. Samothrakis, J. Togelius, T. Schaul, S. M. Lucas, A. Cou¨etoux, J. Lee, C. Lim, and T. Thompson, “The 2014 general video game playing competition,” IEEE Trans. Comput. Intell. AI Games , vol. 8, no. 3, pp. 229–243, 2016

    work page 2014

  45. [45]

    General Video Game Playing,

    J. Levine, C. B. Congdon, M. Ebner, G. Kendall, S. M. Lucas, R. Mi- ikkulainen, T. Schaul, and T. Thompson, “General Video Game Playing,” in Artif. Comput. Intell. Games , ser. Dagstuhl Follow-Ups, 2013, vol. 6, pp. 77–83

    work page 2013

  46. [46]

    Introducing real world physics and macro-actions to general video game AI,

    D. Perez-Liebana, M. Stephenson, R. D. Gaina, J. Renz, and S. M. Lucas, “Introducing real world physics and macro-actions to general video game AI,” in 2017 IEEE Conf. Comput. Intell. Games , 2017, pp. 248–255

    work page 2017

  47. [48]

    A Video Game Description Language for Model-based or Interactive Learning,

    T. Schaul, “A Video Game Description Language for Model-based or Interactive Learning,” in Proc. IEEE Conf. Comput. Intell. Games . IEEE, 2013, pp. 193–200

    work page 2013

  48. [49]

    General video game for 2 players: Framework and competition,

    R. D. Gaina, D. Prez-Libana, and S. M. Lucas, “General video game for 2 players: Framework and competition,” in 2016 8th Comput. Sci. Electronic Eng., 2016, pp. 186–191

    work page 2016

  49. [50]

    The 2016 two-player gvgai competition,

    R. D. Gaina, A. Cou ¨etoux, D. J. N. J. Soemers, M. H. M. Winands, T. V odopivec, F. Kirchgeßner, J. Liu, S. M. Lucas, and D. Perez-Liebana, “The 2016 two-player gvgai competition,” IEEE Trans. Games, vol. 10, no. 2, pp. 209–220, 2018

    work page 2016

  50. [51]

    General video game level generation,

    A. Khalifa, D. Perez-Liebana, S. M. Lucas, and J. Togelius, “General video game level generation,” in Proc. Genetic Evol. Computation Conf., 2016, pp. 253–259

    work page 2016

  51. [52]

    General video game rule generation,

    A. Khalifa, M. C. Green, D. Perez-Liebana, and J. Togelius, “General video game rule generation,” in 2017 IEEE Conf. Comput. Intell. Games, 2017, pp. 170–177

    work page 2017

  52. [53]

    What’s a ludeme?

    D. Parlett, “What’s a ludeme?” in Game Puzzle Design , vol. 2, 2016, pp. 83–86

    work page 2016

  53. [54]

    Guest editorial: General games,

    C. Browne, J. Togelius, and N. Sturtevant, “Guest editorial: General games,” IEEE Trans. Comput. Intell. AI Games , vol. 6, no. 4, pp. 317– 319, 2014

    work page 2014

  54. [55]

    A class grammar for general games,

    C. B. Browne, “A class grammar for general games,” in Advances in Computer Games, 2016, pp. 167–182

    work page 2016

  55. [56]

    Ludii - the ludemic general game sys tem,

    ´E. Piette, D. J. N. J. Soemers, M. Stephenson, C. F. Sironi, M. H. M. Winands, and C. Browne, “Ludii - the ludemic general game system,” CoRR, vol. abs/1905.05013, 2019

    work page arXiv 1905

  56. [57]

    An overview of the ludii general game system,

    M. Stephenson, ´E. Piette, D. J. N. J. Soemers, and C. Browne, “An overview of the ludii general game system,” in IEEE Conference on Games, 2019, p. to appear

    work page 2019

  57. [58]

    An empirical evaluation of two general game systems: Ludii and rbg,

    ´E. Piette, M. Stephenson, D. J. N. J. Soemers, and C. Browne, “An empirical evaluation of two general game systems: Ludii and rbg,” in IEEE Conference on Games , 2019, p. to appear

    work page 2019

  58. [59]

    Atdelfi: Automatically designing legible, full instructions for games,

    M. C. Green, A. Khalifa, G. A. B. Barros, T. Machado, A. Nealen, and J. Togelius, “Atdelfi: Automatically designing legible, full instructions for games,” in Proc. 13th Int. Conf. Foundations Digital Games , 2018, pp. 17:1–17:10

    work page 2018

  59. [60]

    Deceptive games,

    D. Anderson, M. Stephenson, J. Togelius, C. Salge, J. Levine, and J. Renz, “Deceptive games,” in 21st Int. Conf. Applications Evol. Computation, ser. EvoStar’18, 2018, pp. 376–391

    work page 2018

  60. [61]

    Deceptive angry birds: Towards smarter game-playing agents,

    M. Stephenson and J. Renz, “Deceptive angry birds: Towards smarter game-playing agents,” in Proc. 13th Int. Conf. Foundations Digital Games, 2018, pp. 13:1–13:10

    work page 2018

  61. [62]

    General video game playing as a benchmark for human-competitive ai,

    J. Lehman and R. Miikkulainen, “General video game playing as a benchmark for human-competitive ai,” in AAAI-15 Workshop on Beyond the Turing Test, 2015

    work page 2015