Understand Batch Workflows | Zoho Creator Help

Understand Batch Workflows

1. What Does This Page Cover?

Learn how you can efficiently split your larger tasks into smaller batches and process them at off-peak hours using batch workflows.
Idea

2. Availability

Batch workflows feature:
  1. Is available only for paid plans of Creator, with a limited number (refer Things to Know) of batch blocks for each plan
  2. Can only be created, enabled, and managed by the super admin, admins, and developers, while other users can benefit from the automated execution of repetitive tasks.
  3. Is available in all data centers

3. Overview

Batch processing is used to efficiently and periodically complete high-volume and repetitive data jobs by splitting the data at hand into manageable batches. Each batch is then processed separately in an asynchronous flow. This method requires minimal human interaction and can be run sequentially throughout the day or at customized intervals. Some common business processes that can use batch processing include generating reports, printing documents, or updating information at the end of the day.

4. Batch workflows in Creator

In Creator, workflows comprise a set of actions that can be configured to execute at specific instances to automate routines in your application. Batch workflows enable you to efficiently execute customized Deluge scripts on a large volume of data, either after successful import or at scheduled intervals. You can choose to split the bulk records into smaller batches ranging from 10 to 1000 records per batch and configure actions to be run for every record in a batch block (collection of grouped records) in the Execution section. Then, you'll be shown the Before and After section wherein you can specify the actions to be triggered before and after the execution of the above deluge script. For example, instead of processing every order as it occurs, you can configure a batch workflow to collect all orders at the end of each day and share them with the order fulfilment team.  This splitting of data processing helps you overcome Deluge's execution limitations (10-50k statements limit) and ensures smooth processing of large datasets. 
Info
  1. You can select a batch size that optimizes the overall script execution time and resource utilization, thus balancing performance with processing efficiency.
  2. If an error occurs in one of the batches during the batch workflow execution, that particular batch alone will be reverted. This means that an error in one batch doesn't affect the successful execution of other batches in the same batch block.

4.1 Examples of processes that batch workflows can automate

Batch workflows can be configured to process various types of data requests, some of which commonly include:
  1. Periodic billing - Calculate the total amount periodically for individual billing dates.
  2. Invoice generation - Generate sales invoices as per your requirements
  3. Payroll processing - Mail monthly salary slips for each employee in your organization.
  4. Inventory management - Track the product stock periodically to never go out of stock.
  5. Detect fraudulent transactions - Generate monthly statement bills for credit cards to detect frauds.
Thus, batch workflows increase operational efficiency, automate repetitive tasks, and maximize productivity for your business, all while reducing manual supervision of repetitive tasks. 

5. Stages in a Batch Workflow Execution

A batch workflow includes the following three stages, with the ability to configure individual actions for each stage. 
Notes
Note: The Before and After Execution blocks are optional based on your requirements. However, you must configure the script to be executed in the During Execution block.



  1. Before Execution of Batch Workflow:  You can define variables, initialize their usage (applicable to be used in other two blocks as well), and configure the required actions to be carried out before the execution of batch workflow begins. Examples of initialization actions include sending notifications before the process begins, webhook calls to fetch stock from inventory and prepare a list from a response, and so on. Learn how
Info
The Before Execution block will be executed first upon start of the batch workflow execution and will be executed only once.
  1. During Execution of Batch Workflow: Here, you can configure a single action to be executed for every record in a batch block. This action will be performed for every record when the batch workflow execution is in progress. For example, you can configure to calculate every employee's monthly salary that includes taxes, benefits, and much more. Learn how
Info
The During Execution block will be executed in iteration until all batch blocks in that batch workflow are completed.
  1. After Execution of Batch Workflow: You can configure actions to be executed after the execution of all batches to handle both the success and failure scenarios, such as allowing cleanup tasks, displaying respective (success/failure) notifications, and error handling. For example, you can configure to notify an employee through email to  them about their monthly payslip after the successful completion of your batch workflow execution. Learn how

6. Prerequisites

  1. You must have a form in your application based on which you can configure a batch workflow.
  2. You need to decide when to trigger the batch workflow and an idea of the number of records i.e each batch's size.

7. See How it Works

Let’s assume that your organization issues credit cards and has built a Creator application named Credit Card Management. You need to generate and send billing statements on the 1st of every month to your respective customers. To do so, you can schedule batch workflows to be run on the 1st of every month with the action configured to generate relevant statements. You can also utilize variables for dynamic calculations like deriving the total bill amounts for each customer. Upon successful execution, you can configure the monthly credit card billing statements to be sent as attachments via email. 

8. Use Cases

Case 1: After successful import of records
In the sales and marketing ecosystem, managing leads efficiently is paramount for driving conversions and increasing revenue growth. Let's assume you've created a Creator application named Leads Management.  
Your organization receives a huge volume of leads from various sources, including imports from third-party platforms. Each lead requires a lead score calculation based on various attributes like engagement level, demographic data, and past interactions. Additionally, assigning the right lead owner based on territory, expertise, or workload is crucial for timely follow-ups and conversions. However, manually processing these tasks for a significant number of leads is time-consuming and prone to human errors. 
Imagine that you're importing these leads into your application. To streamline this process, you can create a batch workflow to be executed after successfully importing the leads. You can configure actions to calculate the lead scores and assign lead owners to the imported leads. 
Before Execution Block
  1. Perform initialization tasks, including notifications to relevant stakeholders about the commencement of lead processing.
On Execution of Batch Block
  1. Configure the batch size to handle leads in manageable chunks.
  2. Develop scripts to calculate lead scores based on predefined criteria and assign appropriate lead owners using territory mapping or workload distribution algorithms.
After Batch Execution Block
  1. Implement actions based on the success or failure of batch execution.
  2. Notify stakeholders about the completion of lead processing and provide insights into the processed leads, including statistics on lead scores and ownership assignments.
  3. Thus, this feature enables automated processing of lead data in manageable batches, ensuring efficiency and accuracy.


Case 2: Set custom schedule  

Let's assume you manage an e-commerce system that receives orders throughout the day. You've created a Creator application named Order Management. As a marketing manager, you want to run a process every month that aggregates customer feedback from your application reports and generates a report on customer satisfaction. You can create a batch workflow, specify the data source, and process the required scripts to be run at a specified time, and share the collected data easily with stakeholder.

9. Navigation Guide to Create a Batch Workflow

Navigate to the Solutions module and open the required application.Then click the Workflow tab at the top to navigate to the workflow dashboard. Here, you can select the batch workflows section and follow the steps mentioned here.


10. Things to Know

  1. You can configure batch workflows in the following cases — after successful import of your application's records or at a specified time.
  2. You can create multiple batch workflows based on the same form with different or identical conditions. 
  3. All the batches in a batch block will be executed sequentially.
  4. You can track the status of batch workflow executions through the application logs section. It provides visibility into the queue status, in-progress executions, and completion status (success or failure).
  5. You can view error logs for the first 5 batch block failures, providing insight into the reasons for execution failures.
  6. If one or more batches in a block fail, that particular batch alone will be reverted, and the batch workflow will still continue executing other batches. You can view the that block's failure message in logs.
  7. You can execute batch workflows for batches in sizes of 1050100200500, and 1000 records.
  8. You can create up to 100 batch workflows at a time in your account.
  9. You can execute up to a certain number of batch block executions per account in a day based on your pricing plan. 
  10. The execution timeout for each batch is set to 1 minute i.e., if a batch block's size is configured as 1000, then the timeout for the execution of those 1000 records will be 1 minute.
  11. Similarly, the timeout for before and after execution batch blocks is 30 seconds each.

11. Limitations

  1. This workflow is currently not supported for integrations forms.
  2. Users can create up to 5 variables within a batch workflow.
  3. Only one batch workflow can be executed concurrently for an account (based on creation date). This means that additional batch workflows will be queued for execution, thereby ensuring fair resource allocation and preventing overload on system resources.
  4. You cannot trigger batch workflows for records imported by portal users in customer portal.
  5. Each batch workflow is limited to three integration tasks or webhook calls per record execution.
Deluge limitations
  1. The "old" keyword is not supported in batch workflows.
  2. You can configure upto 10 CRUD actions like addupdate, and delete for each records in a batch workflow.
  3. You cannot fetch more than 200 records.
  4. Info message cannot exceed 50KB. Otherwise, the message will be truncated.
  5. You can send up to a maximum of 3 email notifications with attachments.
  6. The maximum size of file attachments allowed is 15 MB. If the attachments exceed this limit, the emails will be delivered without them.
  7. If you want to get the content of the specified file or create a file object using the required content, the respective file size should be less 2 MB.
  8. getUrl() and postUrl() tasks are currently not supported.
  9. You cannot assign values to global variables. You can still access them using info statement.
  10. The following Deluge operations are not supported in batch workflows. 
    1. Fetching all values of a field
    2. Using aggregate functions (except count) on fetched records
    3. 'Call Function' task 
    4. Built-in functions such as:
      1. matches()
      2. ReplaceAll()
      3. ReplaceFirst()
      4. ReplaceAllIgnorecase()
      5. ReplaceFirstIgnoreCase()
      6. Compress()
    5. Client functions
  1. Understand records
  2. Create and manage batch workflows

    Access your files securely from anywhere

      Zoho CRM Training Programs

      Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

      Zoho CRM Training
        Redefine the way you work
        with Zoho Workplace

          Zoho DataPrep Personalized Demo

          If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

          Zoho CRM Training

            Create, share, and deliver

            beautiful slides from anywhere.

            Get Started Now


              Zoho Sign now offers specialized one-on-one training for both administrators and developers.

              BOOK A SESSION






                          Quick Links Workflow Automation Data Collection
                          Web Forms Enterprise Begin Data Collection
                          Interactive Forms Workplace Data Collection App
                          Offline Forms Customer Service Accessible Forms
                          Digital Forms Marketing Forms for Small Business
                          HTML Forms Education Forms for Enterprise
                          Contact Forms E-commerce Forms for any business
                          Lead Generation Forms Healthcare Forms for Startups
                          Wordpress Forms Customer onboarding Order Forms for Small Business
                          No Code Forms Construction RSVP tool for holidays
                          Free Forms Travel
                          Prefill Forms Non-Profit

                          Intake Forms Legal

                          Form Designer HR

                          Card Forms Food
                          Assign Forms Photography

                          Translate Forms Real Estate
                          Electronic Forms

                          Notification Emails for Forms Alternatives
                          Holiday Forms Google Forms alternative 
                          Form to PDF Jotform alternative





                                            You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                                Manage your brands on social media

                                                  Zoho Desk Resources

                                                  • Desk Community Learning Series


                                                  • Digest


                                                  • Functions


                                                  • Meetups


                                                  • Kbase


                                                  • Resources


                                                  • Glossary


                                                  • Desk Marketplace


                                                  • MVP Corner


                                                  • Word of the Day


                                                    Zoho Marketing Automation

                                                      Zoho Sheet Resources

                                                       

                                                          Zoho Forms Resources


                                                            Secure your business
                                                            communication with Zoho Mail


                                                            Mail on the move with
                                                            Zoho Mail mobile application

                                                              Stay on top of your schedule
                                                              at all times


                                                              Carry your calendar with you
                                                              Anytime, anywhere




                                                                    Zoho Sign Resources

                                                                      Sign, Paperless!

                                                                      Sign and send business documents on the go!

                                                                      Get Started Now




                                                                              Zoho TeamInbox Resources



                                                                                      Zoho DataPrep Resources



                                                                                        Zoho DataPrep Demo

                                                                                        Get a personalized demo or POC

                                                                                        REGISTER NOW


                                                                                          Design. Discuss. Deliver.

                                                                                          Create visually engaging stories with Zoho Show.

                                                                                          Get Started Now









                                                                                                              • Related Articles

                                                                                                              • Create and Manage Batch Workflows

                                                                                                                1. What Does This Page Cover? Learn how you can efficiently split your larger tasks into smaller batches and process them at off-peak hours using batch workflows. Before you proceed to create a batch workflow, check this page to understand about ...
                                                                                                              • Understand Form Workflows

                                                                                                                Form workflow refers to the workflow triggered when there is an activity on a form. The activities that you can perform on a form are listed below. Created - Create a new record in the form Created or Edited - Create a new record or edit an existing ...
                                                                                                              • Understand Workflows

                                                                                                                A Workflow comprises of a set of actions executed at specific instances to automate routines in an application. When you trigger the workflow, it executes the set of associated actions. Workflows let you automate and map different activities, data, ...
                                                                                                              • Understand form event in workflows

                                                                                                                To set a workflow to start rolling out, you need to specify on cue of which record event it needs to be triggered. Options are when a record is created, when a record is edited, when a record is created or edited, or when a record in deleted. Then ...
                                                                                                              • Understand report workflows

                                                                                                                Report workflows are associated with action items in Zoho Creator reports. Action item could be defined as an alternative to the existing system actions, which include edit, delete, duplicate, and view record. Zoho Creator enables you to interact ...
                                                                                                                Wherever you are is as good as
                                                                                                                your workplace

                                                                                                                  Resources

                                                                                                                  Videos

                                                                                                                  Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                                  eBooks

                                                                                                                  Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                                  Webinars

                                                                                                                  Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                                  CRM Tips

                                                                                                                  Make the most of Zoho CRM with these useful tips.



                                                                                                                    Zoho Show Resources