Sometimes you might want to evaluate a model’s performance by using a different metric. DataRobot allows you to access a different metric without re-training the models.
Although it is not yet possible to change the metrics for the whole project through API similar to GUI, you can still retrieve the scores for each model.
Here is the example on how to access AUC score for a particular model using DataRobot Python Client.
You can also request model.metrics['AUC']['crossValidation'] to retrieve the score for Cross Validation only.
For more information, see the in-app API Documentation. Also, you can read the DataRobot Python Client documentation from here.
- Updated December 2020