We have large csv files, in the old batch scoring code there was a "Keep Columns" and in the UI there is a "Specific Features" field but I can't seem to find how to only output specific columns and the prediction.
The code below scores perfectly fine but it outputs a massive file with all the features I fed into it plus a prediction score. I only want 1 column and prediction score in the output file.
The closest thing I've found is columnNamesRemapping but the example isn't clear https://docs.datarobot.com/en/docs/predictions/batch/batch-prediction-api/output-format.html#column-...
Any help would be great.
import datarobot as dr
deployment_id = "deploymentidfkdsjfdksjfsd"
input_file = "input.csv"
output_file = "predicted.csv"
job = dr.BatchPredictionJob.score_to_file(
print("started scoring...", job)