Question 1

How does DataRobot select the right blueprint for a given problem?

Accepted Answer

DataRobot doesn't "select" blueprints it creates them dynamically based on the dataset that you give it and the target you specify. Data scientists at DataRobot have spent over 7 years embedding their data science knowledge and best practices into this blueprint development process. Roughly hundreds of blueprints are created for each project. For most data science problems, you can come up with multiple viable approaches without knowing which ones will perform the best. DataRobot uses the Leaderboard to compare blueprints and identify the best ones.

Question 2

Can I see the effect of some of the DataRobot-created features?

Accepted Answer

DataRobot shows the effect of some of the engineered variables through the Insights tab. Both the Tree-Based Variable Importance as well as the Variable Effects sections show the engineered variables used by the models.

Question 3

Is it possible for users to change the preprocessing method?

Accepted Answer

Yes, you can change some of the preprocessing methods used within DataRobot on the Advanced Tuning tab of each model. If you have a custom preprocessing step that you want to include, you could do it outside of DataRobot and load in the processed dataset. This becomes seamless when using the DataRobot R/Python clients.

Question 4

What do asterisks on the Leaderboard metrics mean?

Accepted Answer

The asterisks indicate that the scores are computed from in-sample training data.

Question 5

What does a snowflake icon mean near a model in the Leaderboard?

Accepted Answer

This indicates a frozen run. A frozen run of a model is a retrained version of another model, where hyperparameters from the other model are frozen and the model is simply retrained on more observations.

Question 6

What does a snowflake icon mean near a model in the Leaderboard?

Accepted Answer

This indicates a frozen run. A frozen run of a model is a retrained version of another model, where hyperparameters from the other model are frozen and the model is simply retrained on more observations.

Question 7

Why didn't cross-validation automatically run on my dataset?

Accepted Answer

Cross-validation has a hard cutoff at 50,000 rows; if the dataset is greater than or equal to 50,000 rows, DataRobot does not run cross-validation automatically.

If you require automatic cross-validation, use a dataset with fewer than 50,000 rows.
If you need to get cross-validation values for a specific model, on the Leaderboard for that model click Run (under the Cross Validation column).
- If the dataset is larger than 800MB, DataRobot will use TVH. (Cross-validation is generally useful for smaller datasets where you would not otherwise have enough useful data using TVH.)

Who Kudoed this Message

Who Kudoed this Message