Play 18
Prompt Management
Medium🔧 Skeleton
Version control, A/B test, and rollback prompts across environments.
Manage prompts like code. Git-backed versioning, A/B testing with traffic splitting, automated quality scoring per version, rollback to any previous version. Cosmos DB stores prompt versions and experiment results. GitHub Actions CI/CD deploys prompt updates across dev/staging/prod.
Architecture Pattern
Prompt versioning, A/B testing, CI/CD, rollback, experimentation
Azure Services
Prompt FlowGit/GitHubGitHub ActionsAzure AI FoundryCosmos DB
DevKit (.github Agentic OS)
- agent.md — prompt engineer persona
- instructions.md — versioning protocol
- .github/workflows — CI/CD pipelines
- plugins/ — version manager, A/B tester, rollback handler
TuneKit (AI Config)
- config/prompts.json — prompt versions, active versions
- config/ab-test.json — A/B weights, experiment tracking
- infra/ — Prompt Flow templates
Tuning Parameters
Prompt versionsA/B traffic weightsRollback rulesVersion scheduling
Estimated Cost
Dev/Test
$50–150/mo
Production
$300–1K/mo