Monitoring and explainability of models in production
Reviewed by Pithpith:YWOWWG3Zopen to challenge →
read the original abstract
The machine learning lifecycle extends beyond the deployment stage. Monitoring deployed models is crucial for continued provision of high quality machine learning enabled services. Key areas include model performance and data monitoring, detecting outliers and data drift using statistical techniques, and providing explanations of historic predictions. We discuss the challenges to successful implementation of solutions in each of these areas with some recent examples of production ready solutions using open source tools.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
ShapShift: Explaining Model Prediction Shifts with Subgroup Conditional Shapley Values
ShapShift explains prediction shifts by attributing them to changes in conditional probabilities of tree-defined subgroups via conditional Shapley values, with exact computation for single trees and surrogate extensio...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.