Testing External Datasets

cancel
Showing results for 
Search instead for 
Did you mean: 

Testing External Datasets

This article showcases how you can upload your own external testing datasets into DataRobot to evaluate the performance of your models.


Overview

DataRobot will handle partitioning automatically, ensuring that models are evaluated on out-of-sample data. However, analysts are still given the option to upload any number of additional test datasets and compare metric scores to ensure consistency prior to deployment.

Note: To ensure that you can access this functionality, contact your DataRobot representative for information on enabling the feature.

Uploading External Dataset

To upload the external dataset, navigate to the Make Predictions page by clicking the Predict tab for your DataRobot model (Figure 1).

Figure 1. Make Predictions pageFigure 1. Make Predictions page

Use one of the Import data from options and upload your dataset. When the dataset finishes uploading, you see the option “Run External Test” (Figure 2). Click that link.

Figure 2. Run External Test functionalityFigure 2. Run External Test functionality

DataRobot takes a few moments to finish calculating the accuracy metrics against this dataset for the related model.

Sorting by external test data accuracy

To see and use the newly calculated accuracy, select Menu > Show External Test Column (Figure 3).

Figure 3. Show External Test Column optionFigure 3. Show External Test Column option

You can now sort models by external test scores and calculate scores for more models.

Figure 4. External test scoresFigure 4. External test scores

Caveats

Currently, external test datasets are supported for:

  • Regression
  • Binary Classification
  • Multiclass Classification
  • OTV projects

More information

If you're a licensed DataRobot customer, search in-app documentation for Testing with external datasets.

How can we help?

If you have any questions, please feel free to post your questions below.

Labels (2)
Version history
Revision #:
3 of 3
Last update:
‎04-17-2020 02:39 PM
Updated by:
 
Contributors