CI/CD Eval Gating
Integrate evaluation runs into your CI/CD pipeline to gate deployments on quality metrics.
What's Planned
- GitHub Action to trigger eval runs on PR and block merge on regression
- Baseline comparison against the main branch's last passing run
- Custom thresholds per metric with configurable pass/fail criteria
- Slack/webhook notifications on eval failures with trace links
- Dashboard integration showing eval history per deployment