Define Your Own Custom Metrics for MLOps and LLMOps Monitoring

 

In this lab, you will complete all phases of defining, creating, and assigning custom LLMOps and MLOps monitoring metrics for active deployments.

Your goal is to craft these custom metrics according to your preferences.

These phases include:

  1. Define and create custom LLMOps and MLOps monitoring metrics.
  2. Submit metrics to deployments.
  3. Configure notifications and alerts.

Prerequesites:

  1. Register for DataRobot trial 
  2. Download the following Python notebook AI Accelerator 
  3. Check the product doc for additional information

Questions?

Ask our AI experts in this dedicated thread:

Q&A: Define Your Own Custom Metrics MLOps& LLMOps Monitoring

Version history
Last update:
‎12-21-2023 01:54 PM
Updated by: