Hi @cookie_yamyam ,
Thanks for your question.
Though ideally, we would want it to be the same across all backtests there are not enough data points in some parts of your training data.(You can see it in the observations histogram). The difference in backtest length I assume is due to that.
DataRobot uses the following criteria to set backtests - For OTV, backtests require at least 20 rows in each validation and holdout fold and at least 100 rows in each training fold. For time series, backtests require at least 4 rows in validation and holdout and at least 20 rows in the training fold.
Do note that this is the best heuristic suggestion based on tests across 1000's of TS datasets but still the user has the flexibility to edit and change each of the backtest.
I am attaching the Backtests doc for more information on this.
Let me know if this solves your query.