cancel
Showing results for 
Search instead for 
Did you mean: 

Can't run Prediction Explanation with Recommend model

Can't run Prediction Explanation with Recommend model

Hello,

Thank you for a great product!

 

I have one question about Datarobot platform.

Did Datarobot change how Prediction Explanations work?

Background: Today 2023/01/05, after created a regression model with Date/time partitioning using Autopilot mode, I try to run Prediction Explanation with the recommended model, by using this code:

# Compute predictions
predict_job = model.request_predictions(dataset.id)
predict_job.wait_for_completion()
# Initialize prediction explanations
pei_job = dr.PredictionExplanationsInitialization.create(project.id, model.id)
pei_job.wait_for_completion()
# Compute prediction explanations with default parameters
pe_job = dr.PredictionExplanations.create(project.id, model.id, dataset.id)
pe = pe_job.get_result_when_complete()
# Iterate through predictions with prediction explanations
for row in pe.get_rows():
    print(row.prediction)
    print(row.prediction_explanations)
# download to a CSV file
pe.download_to_csv('prediction_explanations.csv')

but this error occurred:

ClientError: 422 client error: {'message': 'Prediction explanations are not supported for models that use validation data for training.'}

The command cause error is:

pei_job = dr.PredictionExplanationsInitialization.create(project.id, model.id)

From the error message, I think the problem is validation data is included on recommend model, but this error has never happened before, and the last time is used without any problem is 2022/12/26. So I think there must be some change inside Datarobot.

I even worst, when I try to deploy that recommend model and run prediction with this Batch prediction code:

job = dr.BatchPredictionJob.score(
deployment=DEPLOYMENT_ID,
intake_settings={
'type': 'localFile',
'file': input_file,
},
output_settings={
'type': 'localFile',
'path': output_file,
},
max_explanations=3
)

The new error occurred and say that I can't do that because the prediction explanations is not initialized.

Is this intentional or a bug? And how can I fix it?

 

Some more information about my environment:

- Python client version: 2.24.0

- Here is my new model when I check deploy tab in GUI

khoahv_0-1672925867578.png

 

Labels (5)
0 Kudos
12 Replies
jenD
DataRobot Employee
DataRobot Employee

Hello and good news! The fix you are waiting for has been merged, and in a stroke of good luck, the deployment is happening a day early, so will be available on Tuesday. Thanks for bringing it to our attention and for your patience.

Thanks your information.
I want to know accurate time when bug will be fixed.
And more, that time is in USA time?

※I'm a menber of Khoa.hv team

After the fixed deployment, we are able to run everything smoothly. Thank you all for your support!