I have found with some models an asterisk can appear above the validation/CV score (shown below) with a pop-up box reading "Estimated score based on out-of-sample data from internal CV". What is meant by this, how does this differ from the standard validation or CV method?
All feedback is greatly appreciated
Solved! Go to Solution.
Great thanks I didn't know about this section of the Docs. The asterisk appears if you train on more then 64% of the data. Not sure how the pop-up box indicates that, but all good now I have the docs.
Hi @IraWatt have you see this documentation? https://docs.datarobot.com/en/docs/modeling/reference/model-detail/leaderboard-ref.html#asterisked-s... Does this have what you need?