I am using the Accuracy Alerts in MLOps to trigger model replacement however, I'm unsure quantitatively at what point this is triggered. The documentation describes the red alert as "Accuracy has severely declined since the model was deployed", what does this mean numerically?
Could I also use the API to set my thresholds to trigger model replacement?
Accuracy monitoring is defined by a single accuracy rule. Every 30 seconds, the rule evaluates a deployment's accuracy. Notifications trigger when this rule is violated. Deployment owners must define the metric, measurement, and threshold components of the accuracy rule.
The full description of how to configure the rules is at: