Pipeline Manual run
By triggering the manual run option in your pipeline, you can export the data you have prepared to your destination. A manual run will run your pipeline on the existing data without refreshing, which means no new data will be imported.
Note: You can also use this option for dry runs and to test if your pipeline can be executed without any failures before automating the pipeline using a schedule or backfill run. However, please make sure you configure the pipeline for your testing environment, especially destinations as the transforms and export will happen for whichever data destinations are configured.
Info: A manual run will run on the latest version of the pipeline. A version is nothing but stages of the actions performed on a pipeline. If you want to do a manual run on any old version, you can restore the required version, and perform a manual run. Click here to know more about versions. To execute manual run in a pipeline
1. Open your pipeline and go to the pipeline builder view. Click here if you want to know how to create a pipeline in the first place.
2. Click on the Add data option to bring your data from the required data source. Learn more on 50+ data sources.
After data is imported, you will be redirected to the pipeline builder where you can see your data source, and a stage linked to it.
Stages are nodes created for processing data while applying data flow transforms. Every dataset imported from your data source will have a stage created by default.
3. You can right-click the stage and apply the data flow transforms.
4. You can also choose to Prepare Data to open the DataPrep Studio page and explore more data transforms. Click here to know the various elements in a pipeline builder.
5. Once you are done creating your data flow and apply necessary transforms in your stages, you can right-click a stage and add a destination to complete your data flow.
6. Data destination is a place where you want to export your data to. It can be your local database, business applications like Zoho CRM, Zoho Analytics, etc. You can choose your preferred destination out of 50+ data destinations in DataPrep to export your prepared data to.
Manual run
7. After adding a destination for your pipeline, click the Run drop down and choose Manual run.
Settings
-
Stop export data quality drops below 100%: You can use this toggle if you would like to stop export if data quality drops below 100 percent.
-
Order export: You can use this option when you have configured multiple destinations and would like to determine in what order the data has to be exported to destinations.
Note: This option will be visible only if you have added more than one destination in your pipeline.8. Click on the Run button to execute the manual run. This will start processing the pipeline and the Job summary page opens. The Job summary shows the progress of a job execution. Click here to know more. You can view the status of the run on the Job summary page. There are three different status for a job in DataPrep - Initiated, Success and Failure.
If the job fails, you can identify if the error is at the import stage, transform stage, or with the destination, and target matching in the Job summary page. You can hover on the failed stage to view the error details and fix them to proceed exporting.
In the Overview tab, you can view the status of the job along with the details such as user who started the job, storage used, total rows processed, start time, end time and duration of the job. Click here to know more.
In the Stages tab, you can view the details of each pipeline stage such as Import, Transform, and Export. Click here to know more.
In the Output tab, you see the list of all exported data. You can also download the output if needed. Click here to know more.
Note: Jobs are listed under each pipeline's menu, the jobs are stored indefinitely and can be referred whenever needed.9. When the manual run is completed, the data prepared in your pipeline will be exported to the configured destinations.
SEE ALSO
Zoho CRM Training Programs
Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.
Zoho DataPrep Personalized Demo
If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.
- Zoho Workerly Home
- Forums
- Connect With Us:
- Zoho Recruit Home
- Forums
- Connect With Us:
New to Zoho CRM Plus?
Deliver unforgettable customer experiences
New to Zoho CRM Plus?
Deliver unforgettable customer experiences
New to Zoho Marketing Plus?
Everything you need to run your marketing
New to Zoho Marketing Plus?
Everything you need to run your marketing
You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.
New to Zoho Survey?
Zoho Sheet Resources
Zoho Forms Resources
New to Zoho Sign?
Zoho Sign Resources
Sign, Paperless!
New to Zoho TeamInbox?
Zoho TeamInbox Resources
New to Zoho ZeptoMail?
Zoho DataPrep Resources
Design. Discuss. Deliver.
New to Zoho Workerly?
New to Zoho Recruit?
New to Zoho CRM?
New to Zoho Projects?
New to Zoho Sprints?
New to Zoho Assist?
New to Bigin?
Related Articles
Create a new pipeline
Pipelines are fundamental entities that allows users to create data flows in DataPrep, with multiple data stages and using various flow level transforms. You can create a new pipeline from scratch from the below places. Home page Pipelines tab ...Create pipeline from template library
Pipelines are fundamental entities that allows users to create data flows in DataPrep, with multiple data stages and various flow level transforms. Template library is a place which contains pre-defined templates and all the saved pipeline templates. ...Pipeline builder page
Pipeline builder is a place that allows the users to create data flows in DataPrep, with multiple data stages and various flow level transforms. Whenever a new pipeline is created, the pipeline builder page opens into view. The pipeline builder page ...Pipeline Backfill run
Backfill run can process data that was missed in previous schedules due to a change in data models or data preparation workflow. This way, you can catch up with missed schedules or if you want to import specific data within a timeframe data, or to ...Pipeline - Schedule run
The Schedule option is used to schedule the import from various sources, apply the transforms, and export to the destinations in your pipeline at regular intervals. You can also import incremental data from various sources like cloud storage, CRM, ...
New to Zoho LandingPage?
Zoho LandingPage Resources