A pipeline execution is called a job, a job tracks the progress of imports, transformations and exports in a pipeline among other stats.

To navigate to the Jobs page, you can click the Jobs tab from the top bar menu.

The Jobs tab shows the list of all the jobs executed across all the workspaces in your organization along with the Job ID, the associated pipeline, start and run time, status, run by, storage used, and rows processed.

The jobs list can help you identify the failed pipeline jobs and give users a way to retry the jobs.




Filter:

You can use the filter dropdown to list the jobs by type: manual run, schedule run, backfill run and reload data.

 You can also filter and search on the jobs using filter attributes such as run by, pipeline, workspace, status, and run time. Learn more.

You can also quickly sort your jobs based on pipelines, run by etc. using the respective sort icon located at the top of the table header.

To learn more about pipelines and other entities in DataPrep, click here. 

Job Summary

Click on a job in the Jobs page to navigate to the Job summary.

Note: You can also choose the Job history option from each pipeline and navigate to the job summary page.

The Job summary shows details of a job in a pipeline flow in three different tabs: Overview, Stages and Output. 

Note: If your job has failed, you can identify if the error is at the import stage, transform stage, or with the destination, and target matching in the Job summary page.

 Overview 

Info: You can also click on a Stage in the pipeline view to see the rules applied on that particular stage.

Stages 

You can view the stages for each job executed in three different sections- Import, Transform, and Export. It includes details on the status, row count, storage used, start time and end time of the import, transforms applied, and export.

Info: You can click the View details link at the bottom of each import and export to view the data source, and destination details.

Output 

Note: To navigate to the Jobs page of the pipeline click the View Jobs link in the destination details.