A pipeline execution is called a job, a job tracks the progress of imports, transformations and exports in a pipeline among other stats.

To navigate to the Jobs page, you can click the Jobs tab from the top bar menu.

The Jobs tab shows the list of all the jobs executed across all the workspaces in your organization along with the Job ID, the associated pipeline, start and run time, status, run by, storage used, and rows processed.

The jobs list can help you identify the failed pipeline jobs and give users a way to retry the jobs.




Filter:

You can use the filter dropdown to list the jobs by type: Manual run, Manual run with data(Manual run with refreshed data), Schedule run, Backfill run, Sectional run, Zoho Flow, Webhooks and Reload data. To view sectional jobs, you can enable the Include Sectional Jobs toggle.

 You can also filter and search on the jobs using filter attributes such as run by, pipeline, workspace, status, and run time. Learn more.

You can also quickly sort your jobs based on pipelines, start time and status using the respective sort icons located at the top of the table header.

Job Summary

Click on a job in the Jobs page to navigate to the Job summary. The Job Summary page displays key execution details of a job, including the Pipeline name, Job status, Run duration, Run by, Storage used, Total rows processed, Data interval, as well as the Start and End time of the job.

Note: You can also choose the Job history option from the Pipeline builder page and navigate to the Job summary page.

This gives detailed insights into a specific job and visibility into how a pipeline performed from start to finish including overall status, individual stage outcomes, and exported results helping you troubleshoot issues, analyze performance, and verify output quality.

You can click Edit pipeline to modify your pipeline if a job fails or if changes are required. To view all the jobs executed in your pipeline, click the Job history option. 

The Job summary shows details of a job in three different tabs: Pipeline flow, Stages and Output. 

Pipeline flow

Stages 

The Stages section in the Job Summary page provides a comprehensive view of how a job was executed across the different stages of the pipeline. It breaks down the execution into Import, Transform, and Export, presenting both a summary and detailed view of each stage. It includes details on the status, rows processed, storage used, start time and end time of the import, transforms applied, and export.

Import

Transform

Export

The Export stage provides details of the final outputs generated by the job. It lists all export destinations along with their execution status, data quality indicators, number of rows exported, storage consumed, and time taken for each export. This stage allows you to verify that the processed data was successfully delivered to the intended destinations.

Click the info icon to view the destination details.  You can also use the Preview icons to quickly view the output at each stage and download the data from any stage if required.

Stage status

Note: The rows from these stages will not be counted for rows processed calculation.

Note: The rows from the cached stages will not be counted for rows processed calculation.

Output 

2. Can we validate if there is no file before running the pipeline to avoid job failure?

In Zoho DataPrep 2.0, during incremental fetch the pipeline job initiates regardless of whether the input file exists or not. If the file is missing, the job fails during the import stage. DataPrep handles such scenarios automatically, so no manual validation is required beforehand. You can view these failures in the job summary.