Different Automation Statuses

Different Automation Statuses

Just curious what determines the automation status of a scheduled job in Paxata? My understanding is that the status of “Complete with Error” shows up when there is a refresh done but no change to the dataset. However, I've had a table that has not been updated on the database end, but has been refreshed daily with the automation status of "Success".
Labels (1)
0 Kudos
4 Replies

The success criteria for an automation done on a dataset is that the command must be executed without an error. If the table does not change, but the import command is able to bring in the dataset without an error, the automation is considered to be a success.
0 Kudos
jmayhew
Linear Actuator

Hello. When you load data into Paxata, a version is associated with the data. That version gets updated when your data is updated. The initial version value is always set to 1, and any update incrementally adjusts the version by 1. For example, if you are importing data from a database, the initial version of that data is set for 1. If you run a daily update for 7 days in a row, you will end on version 8 of the data. When you load data into your project, Paxata will track which version of the data is associated with that project. When you use Automation to refresh your project, what Paxata will do is:
  • Look to see which files are being used in the project, and more importantly what version of the file is being used.
  • Paxata checks the library to see if there are any newer versions of the files in the library
The default action Paxata will take is that if a new file exists, then Paxata will update the project with the newer version. If there are no newer versions of the file, and the project is using the latest version, then Paxata will return the "Complete with Error" due to no newer versions of the file exist. You can control these settings if you have a mixture of data that will be not have a newer version vs a file that does have a new version. There are ways of testing this and adjusting this from within the project (Please see the comment field below for links on these actions). It sounds like that you have automated the refresh of your database. Even though the data may not change, you are getting a new version of your data. It sounds like that the other file isn't being updated which is what is causing the error you are encountering. Please check the versions of the files. You can always open a support ticket at servicedesk@paxata.com and we can take a closer look at your issue.
0 Kudos
jmayhew
Linear Actuator

Automation will look at the version of each file that is being used within a Project. The default setting is to look to see if there are new versions of the files. If there are no new versions being detected, then you will receive the error message "Complete with Error". A daily refresh of a data table will generate a new version even if the data is the same. If your other file is not updating on a daily basis, it could be the reason for your error. Here are a few links you can use to help troubleshoot your issue that you can access once logged into Paxata:
  • Click here to learn more about how to check the versions associated with your data files.
  • Click here to learn more about updating vs loading new data in your library.
  • Click here to learn about how to detect if there is a new version of the data from within your project.
  • Click here to learn about options on how to set your Automation - Import Dataset options if you have 1 file that has a newer version, and one file that needs to remain at the current version (or version used when creating the project). Note: Please scroll until you see Steps to set up a Project for automation
If this still doesn't address your issue, please open a ticket to servicedesk@paxata.com
0 Kudos
CSDan
Linear Actuator

@jfung "Complete with Error" is typically a Project Automation error, although it certainly can happen with Library Automation as well. To explain any Complete with Error status, one must look at Job Details and see the exact Error condition. There is a post in our Fundamentals area that talks in detail about some of the known automation errors & how to handle them: https://community.datarobot.com/t5/paxata-fundamentals/handling-common-paxata-automation-errors/m-p/...

0 Kudos