Trigger pipeline using Webhooks
Zoho DataPrep allows you to trigger your pipeline using Webhooks. A webhook is a user-defined HTTP callback that is triggered when a particular event occurs at the source site. When the event occurs, the source site makes an HTTP request to the URL specified.
In simple words, webhook is used to trigger your pipeline in DataPrep using real-time events from an external application.
In simple words, webhook is used to trigger your pipeline in DataPrep using real-time events from an external application.
To trigger a pipeline using webhooks
1. Create a pipeline from the Home Page, Pipelines tab, or Workspaces tab. You can bring your data from 50+sources.
2. On the Pipeline Builder page, once you have completed creating your data flow and applying the necessary transforms in your stages, you can export your data to one or more destinations.
3. Once you have finished creating your entire pipeline,
2. On the Pipeline Builder page, once you have completed creating your data flow and applying the necessary transforms in your stages, you can export your data to one or more destinations.
3. Once you have finished creating your entire pipeline,
Pro Tip: You may want to try dry run your pipeline using the Run button. Each run is saved as a job.
When a pipeline run is executed, the data fetched from your data sources will be prepared using the series of transforms you have applied in each of the stages, and then data will be exported to your destination. This complete process is captured in the job history. Once you ensure manual run works, choose the Draft option and mark your pipeline as ready. You can then set up webhooks to trigger your pipeline.
Note: Only one run type can be setup in a pipeline at a time.
Webhooks configuration
4. Click the Schedule drop-down icon and click the Webhooks option.
Webhook Settings
Stop export if data has invalid values : Enabling this will stop the export when your data still has invalid values.
Order exports
This option determines in what order the data has to be exported to destinations when you have configured multiple destinations.
If not enabled, export will run in the default order.
If not enabled, export will run in the default order.
Note: This option will be visible only if you have added more than one destination in your pipeline.
To rearrange the order of your export destinations
1) Click the Order exports toggle.
2) You can drag and drop to change the order of the destinations and then click Save.
Note: Click the Edit order link if you want to rearrange the order again.Import configuration
5. While configuring the Webhooks, the import configuration needs to be mandatorily setup for all the sources. Without setting up the import configuration, the Webhooks configuration cannot be saved.
Click the Edit here link to set the import configuration.
The import configuration is different for different sources. Click here to know more about how to set up import configuration for various sources.
6. After you configure the webhooks configuration, click Save.
How does Webhook work?
7. When a webhook is enabled in DataPrep, it generates a unique URL that waits for incoming HTTP requests. When a request is received, this webhook is set up to trigger a specified pipeline.
In the external service, configure the event that should trigger the webhook.
7. When a webhook is enabled in DataPrep, it generates a unique URL that waits for incoming HTTP requests. When a request is received, this webhook is set up to trigger a specified pipeline.
In the external service, configure the event that should trigger the webhook.
For example, an event could be creating a new record, modifying an existing record, uploading a file, and so on. Then, using the API request below, set up a webhook run that sends an HTTP request to the webhook URL if a specific event occurs.
Create a Webhooks Run
Use this API to trigger a webhooks run.
POST https://{{api_base_url}}/portals/{{portalname}}/pipelines/{{pipeline_id}}/webook_run
Note: Rest APIs are available only for US and AU DCs.api_base_url for US DC = www.zohoapis.com/dataprep/v1
api_base_url for AU DC = www.zohoapis.com.au/dataprep/v1
Path parameters
Parameters | Type | Description |
{{portalName}} | string | |
{{pipeline_id}} | integer |
Headers
Key | Value |
Accept | V3+json |
Service name : zohodataprep
Scopes : zohodataprep.dataprepapi.CREATE, zohodataprep.dataprepapi.UPDATE, zohodataprep.dataprepapi.DELETE, zohodataprep.dataprepapi.READ
Note: This webhook-based pipeline run can be triggered only three times in an hour. Please find the REST API documentation for more coverage on the APIs in detail.
When an event happens (for example, a new file is added), the external service sends an HTTP request to the webhook URL. This request is received by DataPrep's webhook, which then runs the associated pipeline.
8. The webhook serves just as a signal to initiate the pipeline. Each webhook run is saved as a job. When a pipeline is run, the data will be fetched from your data sources, prepared using the series of transforms you have applied in each of the stages, and then data will be exported to your destination at regular intervals. This complete process is captured in the job history.
9. To go to the jobs list of a particular pipeline, go to the
10. Click the required job ID in the Jobs history page to navigate to the Job summary of a particular job.
The Job summary shows the history of a job executed in a pipeline flow. Click here to know more.
Note: Every job that has been run is saved under the Jobs history, so you can view the status of every pipeline run later under the Jobs page.11. When the Webhook run is completed, the data prepared in your pipeline will be exported to the configured destinations.
Note: If you make any further changes to the pipeline, the changes are saved as a draft version. Choose the Draft option and mark your pipeline as ready for the changes to reflect in the Webhooks run.Once Webhooks is set, you can choose to Edit or Remove using the Webhooks Active option in the pipeline builder.
SEE ALSO
Zoho CRM Training Programs
Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.
Zoho DataPrep Personalized Demo
If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.
- Zoho Workerly Home
- Forums
- Connect With Us:
- Zoho Recruit Home
- Forums
- Connect With Us:
New to Zoho CRM Plus?
Deliver unforgettable customer experiences
New to Zoho CRM Plus?
Deliver unforgettable customer experiences
New to Zoho Marketing Plus?
Everything you need to run your marketing
New to Zoho Marketing Plus?
Everything you need to run your marketing
You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.
New to Zoho Survey?
Zoho Sheet Resources
Zoho Forms Resources
New to Zoho Sign?
Zoho Sign Resources
Sign, Paperless!
New to Zoho TeamInbox?
Zoho TeamInbox Resources
New to Zoho ZeptoMail?
Zoho DataPrep Resources
Design. Discuss. Deliver.
New to Zoho Workerly?
New to Zoho Recruit?
New to Zoho CRM?
New to Zoho Projects?
New to Zoho Sprints?
New to Zoho Assist?
New to Bigin?
Related Articles
Pipeline Manual run
By triggering the manual run option in your pipeline, you can export the data you have prepared to your destination. A manual run will run your pipeline on the existing data without refreshing, which means no new data will be imported. Note: You can ...Create a new pipeline
Pipelines are fundamental entities that allows users to create data flows in DataPrep, with multiple data stages and using various flow level transforms. You can create a new pipeline from scratch from the below places. Home page Pipelines tab ...Create pipeline from template library
Pipelines are fundamental entities that allows users to create data flows in DataPrep, with multiple data stages and various flow level transforms. Template library is a place which contains pre-defined templates and all the saved pipeline templates. ...Trigger Pipelines in Zoho DataPrep using Zoho Flow
Zoho DataPrep allows you to trigger your pipeline using Zoho Flow. Zoho Flow is an integration platform which connects cloud applications. It helps you set up workflows to automate information exchange among the apps you use. For instance, let's use ...Pipeline
Pipelines are fundamental entities that allows users to create data flows in DataPrep, with multiple data stages and various flow level transforms. To view the list of pipelines, you can click the Pipeline tab from the top bar. The Pipelines tab ...
New to Zoho LandingPage?
Zoho LandingPage Resources