Deployments Dashboard

cancel
Showing results for 
Search instead for 
Did you mean: 
Hi Paxata Community members! Welcome to the DataRobot Community! You will find all the Paxata content you know and love— CLICK HERE.

Deployments Dashboard

The Deployments tab provides you with a dashboard list of all the deployments you have; this includes those that you deployed, as well as deployments shared with you by others. By deployment we mean a model that DataRobot is tracking to allow you to effectively monitor and manage the model performance.

Figure 1. DashboardFigure 1. Dashboard

A deployment here in the DataRobot MLOps environment represents one of three different kinds of underlying models:

Figure 2. Three types of models for deploymentsFigure 2. Three types of models for deployments

The first is a model built and deployed from within DataRobot AutoML or AutoTS. Specifically, these are models built after you upload your data and hit the Start button. You request predictions from these models through the DataRobot API.

Figure 3. DataRobot modelFigure 3. DataRobot model

The second is an external model that you build outside, and then upload into DataRobot. Similarly, you also request predictions from these custom models through the DataRobot API.

Figure 4. 4 - Custom model, Add NewFigure 4. 4 - Custom model, Add New

The third is a remote model hosted in your own environment, but remotely communicating with DataRobot servers. In this case, you install the DataRobot MLOps agent software that acts as a bridge between your application and DataRobot. You request predictions from your model as you would normally, but then pass your prediction output to the agent, which then reports your prediction data back to DataRobot so that the deployment can capture that information.

Figure 5. External modelFigure 5. External model

In all three cases, your deployment captures the predictions that the underlying model makes, along with the actual outcomes from those predictions once collected and uploaded. And in all three cases, the Deployment user interface provides you with 1) a view into how the nature of your input data changes, 2) the distribution of the predictions from the model changes, and 3) how the accuracy changes over time.

On the main Deployments page, across the top of the inventory, a summary of the usage and status of all active deployments is displayed, with color-coded health indicators.

Figure 6. Summary of status for active deploymentsFigure 6. Summary of status for active deployments

Beneath the summary is an individual report for each deployment. Next to the name of the deployment are the color-coded icons that represent the level of health; this refers to the number of errors for the Service Health column, and the degree of degradation or shift in incoming data for Data Drift and Accuracy columns.

Figure 7. Deployment health indicatorsFigure 7. Deployment health indicators

Then, there are few metrics on prediction activity traffic displayed, and lastly a menu of options available to manage the model.

To view all of this information in detail, simply click on the deployment you want to view.

More Information

If you’re a licensed DataRobot customer, search the in-app platform documentation for Deployment inventory and Using the Model Registry.

Labels (3)
Version history
Revision #:
4 of 4
Last update:
‎04-28-2020 09:53 AM
Updated by:
 
Contributors