The Deployments tab provides you with a dashboard list of all the deployments you have; this includes those that you deployed, as well as deployments shared with you by others. By deployment we mean a model that DataRobot is tracking to allow you to effectively monitor and manage the model performance.
Figure 1. Dashboard
A deployment here in the DataRobot MLOps environment represents one of three different kinds of underlying models:
Figure 2. Three types of models for deployments
The first is a model built and deployed from within DataRobot AutoML or AutoTS. Specifically, these are models built after you upload your data and hit the Start button. You request predictions from these models through the DataRobot API.
Figure 3. DataRobot model
The second is an external model that you build outside, and then upload into DataRobot. Similarly, you also request predictions from these custom models through the DataRobot API.
Figure 4. 4 - Custom model, Add New
The third is a remote model hosted in your own environment, but remotely communicating with DataRobot servers. In this case, you install the DataRobot MLOps agent software that acts as a bridge between your application and DataRobot. You request predictions from your model as you would normally, but then pass your prediction output to the agent, which then reports your prediction data back to DataRobot so that the deployment can capture that information.
Figure 5. External model
In all three cases, your deployment captures the predictions that the underlying model makes, along with the actual outcomes from those predictions once collected and uploaded. And in all three cases, the Deployment user interface provides you with 1) a view into how the nature of your input data changes, 2) the distribution of the predictions from the model changes, and 3) how the accuracy changes over time.
On the main Deployments page, across the top of the inventory, a summary of the usage and status of all active deployments is displayed, with color-coded health indicators.
Figure 6. Summary of status for active deployments
Beneath the summary is an individual report for each deployment. Next to the name of the deployment are the color-coded icons that represent the level of health; this refers to the number of errors for the Service Health column, and the degree of degradation or shift in incoming data for Data Drift and Accuracy columns.
Figure 7. Deployment health indicators
Then, there are few metrics on prediction activity traffic displayed, and lastly a menu of options available to manage the model.
To view all of this information in detail, simply click on the deployment you want to view.
If you’re a licensed DataRobot customer, search the in-app platform documentation for Deployment inventory and Using the Model Registry.