Evolutionary Computation and Explainable AI: A Roadmap to Understandable Intelligent Systems
read the original abstract
Artificial intelligence methods are being increasingly applied across various domains, but their often opaque nature has raised concerns about accountability and trust. In response, the field of explainable AI (XAI) has emerged to address the need for human-understandable AI systems. Evolutionary computation (EC), a family of powerful optimization and learning algorithms, offers significant potential to contribute to XAI, and vice versa. This paper provides an introduction to XAI and reviews current techniques for explaining machine learning models. We then explore how EC can be leveraged in XAI and examine existing XAI approaches that incorporate EC techniques. Furthermore, we discuss the application of XAI principles within EC itself, investigating how these principles can illuminate the behavior and outcomes of EC algorithms, their (automatic) configuration, and the underlying problem landscapes they optimize. Finally, we discuss open challenges in XAI and highlight opportunities for future research at the intersection of XAI and EC. Our goal is to demonstrate EC's suitability for addressing current explainability challenges and to encourage further exploration of these methods, ultimately contributing to the development of more understandable and trustworthy ML models and EC algorithms.
This paper has not been read by Pith yet.
Forward citations
Cited by 2 Pith papers
-
Performance and Explainability Requirements of Evolutionary Algorithms in Real-World Physics-Informed Optimization
Domain experts require fast convergence and some explainability from evolutionary algorithms in physics-informed optimization, with other needs varying by problem, revealing an application gap.
-
Explainable Optimization: A Call for Interdisciplinary Action
The paper calls for establishing explainable optimization (XOpt) as an interdisciplinary area to bridge the gap between optimization outputs and stakeholder needs for justification.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.