Validation score

KatandraBot
DataRobot Employee
DataRobot Employee

Validation score

Why is it when running an AutoML none time series model it doesn’t show the validation score for some models?  Also the blenders use them in their model list so the blender validation score is also N/A.

 

I checked this link: https://app.datarobot.com/docs/modeling/reference/model-detail/leaderboard-ref.html#na-scores

 

Realising then that they are Eureqa models, but weirdly some of the Eureqa models do show the validation.  Anyone any clues?

Labels (1)
0 Kudos
1 Solution

Accepted Solutions
Abdul.J
DataRobot Alumni

Hi,

Is it possible to share a screenshot of the issue for reference?

 

View solution in original post

0 Kudos
2 Replies
Abdul.J
DataRobot Alumni

Hi,

Is it possible to share a screenshot of the issue for reference?

 

0 Kudos
KatandraBot
DataRobot Employee
DataRobot Employee

Thanks Abdul, I now believe it is because those models are trained on 80% of the data, so when the % is lower (ie. 64%) I can see the validation score.  Much appreciated.