cancel
Showing results for 
Search instead for 
Did you mean: 

Does ACE score depend on the order of rows?

AutoDR
DataRobot Employee
DataRobot Employee

Does ACE score depend on the order of rows?

 

Robot 1:

Is there any sampling done in EDA2 when calculating ACE score? The case is two datasets which are only different in the order of rows, are run separately with same OTV setting (same date range for partitions, same number of rows in each partition), and there is a visible difference in the ACE scores. Does the ACE score depend on the order of rows? 


Robot 2:


Robot 1:

There are 8k rows and 70 features, fairly small datasets.


Robot 2:

ACE doesn’t need a large sample: It could be 1k or even 100. If the dataset is less than 500MB, then all rows may be in the sample, but the order may be different.


Robot 1:

Thanks!

0 Kudos
0 Replies