Introduces a DevOps framework that covers the full life cycle of LLM-based applications, including agent bootstrapping, test case management, permutation-based model and prompt comparison, CI/CD integration, and trace-based monitoring.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Generative AI Toolkit -- a framework for increasing the quality of LLM-based applications over their whole life cycle
Introduces a DevOps framework that covers the full life cycle of LLM-based applications, including agent bootstrapping, test case management, permutation-based model and prompt comparison, CI/CD integration, and trace-based monitoring.