Batch size in Zoho DataPrep

Batch Size in Zoho DataPrep



Batch size refers to the maximum number of rows you can process at a time in Zoho DataPrep during every import, data preparation, or export of data.

The default batch size is 1 Million. This means that you can process as many rows at a time as large as your batch size limit. However, you can always scale this by purchasing Batch size Add-Ons from the Zoho Store. 

Let's say, you are trying to import a dataset with more than one million rows from Zoho Analytics. If your current batch size is limited to 1M, the import will fail throwing the below error:



To continue importing, you need to upgrade your batch size limit by purchasing batch size add-ons from Zoho Store. You can either purchase batch size add-ons or upgrade your plan to upgrade your batch size limit. Here's the link to DataPrep's pricing page.

Info
Purchasing batch size add-ons will simply increase your batch size limit, not the no. of rows processed. Click here to see a full comparison of DataPrep's plans and features.

You can view your DataPrep organization's allowed batch size limit in the Manage Subscription tab in Zoho DataPrep. If you would like to purchase Batch Size Add-Ons, click Manage your Plan to access Zoho Store. To know how to purchase Batch Size Add-On, click here.




FAQs

1. What will happen if I try to import datasets that exceed the batch size limit?

If you attempt to import data from cloud databases, Zoho Analytics, or Zoho CRM more than your batch size limit, the import will fail throwing an error. To continue importing, you need to upgrade your batch size limit by purchasing batch size add-ons from Zoho Store. Go to Manage Subscription tab and click Manage your Plan to access Zoho Store and purchase the batch size add-on. 



If you try importing data more than your batch size limit from any other data sources such as, files, cloud storage, FTP, URL, etc. the dataset will be imported as we will only know the row count after initial parsing of the file. But the below error will be thrown when you try to apply any transform. Click here to know the allowed and restricted operations on datasets that exceed the batch size limit.



In order to resume prepping your data, you can choose to purchase batch size add-on.              

You can also purchase add-ons or upgrade your plan from the Manage Subscription page.

2. How do I increase my batch size limit?

You can increase your batch size limit by purchasing Batch size Add-On from the Zoho Store.

a. Click the Settings icon from the top-right corner to open the Settings tab.
b. Click the Manage Your Plan button, and you will be taken to Zoho Store.
c. Click the Upgrade Row/Add-Ons button. 
d. Choose an option from the Batch Size Add-On dropdown.
d. You can review the price and add-on details in the After Addition section.
e. Click to Proceed and make payment. Once you complete your purchase successfully, you can refresh the Manage Subscription page in DataPrep to see your updated subscription details.

3. What will happen to those datasets that already exist in my DataPrep organization which exceed the batch size limit? Will I lose my data?

No, you will not lose datasets with more than the batch size limit applicable for your DataPrep organization. But you can cannot apply transforms or export such datasets. However, you can continue using Zoho DataPrep seamlessly by purchasing Batch Size Add-Ons from the Zoho Store.

4. Which transforms are allowed and restricted on existing datasets that exceed the batch size limit?

1. You can use the Advanced filters option to filter and view data but you cannot choose to Keep or Delete the filtered rows.
2. You can Undo or Redo the rules applied on the existing datasets. However, you cannot apply new transforms and add new rules to your ruleset.
3. You cannot switch sample strategy or generate a new sample. 
4. You cannot edit the Data source details under the Data source configuration settings from the Ruleset pane.




SEE ALSO

    Access your files securely from anywhere

      Zoho CRM Training Programs

      Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

      Zoho CRM Training
        Redefine the way you work
        with Zoho Workplace

          Zoho DataPrep Personalized Demo

          If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

          Zoho CRM Training

            Create, share, and deliver

            beautiful slides from anywhere.

            Get Started Now


              Zoho Sign now offers specialized one-on-one training for both administrators and developers.

              BOOK A SESSION









                                            You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                                Manage your brands on social media

                                                  Zoho Desk Resources

                                                  • Desk Community Learning Series


                                                  • Digest


                                                  • Functions


                                                  • Meetups


                                                  • Kbase


                                                  • Resources


                                                  • Glossary


                                                  • Desk Marketplace


                                                  • MVP Corner


                                                  • Word of the Day


                                                    Zoho Marketing Automation

                                                      Zoho Sheet Resources

                                                       

                                                          Zoho Forms Resources


                                                            Secure your business
                                                            communication with Zoho Mail


                                                            Mail on the move with
                                                            Zoho Mail mobile application

                                                              Stay on top of your schedule
                                                              at all times


                                                              Carry your calendar with you
                                                              Anytime, anywhere




                                                                    Zoho Sign Resources

                                                                      Sign, Paperless!

                                                                      Sign and send business documents on the go!

                                                                      Get Started Now




                                                                              Zoho TeamInbox Resources



                                                                                      Zoho DataPrep Resources



                                                                                        Zoho DataPrep Demo

                                                                                        Get a personalized demo or POC

                                                                                        REGISTER NOW


                                                                                          Design. Discuss. Deliver.

                                                                                          Create visually engaging stories with Zoho Show.

                                                                                          Get Started Now









                                                                                                              • Related Articles

                                                                                                              • Ruleset in Zoho DataPrep

                                                                                                                This page covers the following sections: What is a Ruleset? Data source settings Ruleset operations Options with individual rules Ruleset Templates What is a Ruleset? Each transform applied on the dataset is stored in DataPrep as a rule, in order of ...
                                                                                                              • Zoho DataPrep's Home page

                                                                                                                The home page gives you a brief overview of the workspaces you own, where they are located, and the workspaces that are shared with you. From Zoho DataPrep's home page, you can manage your Zoho DataPrep account, create and manage workspaces. The ...
                                                                                                              • Organization settings

                                                                                                                Select the Organization settings tab from the Settings side pane to view and edit your organization information. Note: This setting is accessible only to the Account admins of the organization. Organization details You can view your organization ...
                                                                                                              • Audit settings

                                                                                                                Zoho DataPrep allows you to manage all user activities and user access in your organization using the Audit tab under Settings. You can also export and download these audit logs. DataPrep provides you with the below audit trials: Access audit - ...
                                                                                                              • Zoho DataPrep Pricing FAQ

                                                                                                                1.1 What are "rows processed"? A row can be defined in the context of a dataset. In simple terms, a dataset consists of rows (records) and columns (fields). Each row in a dataset represents a set of related data and has the same structure. For ...
                                                                                                                Wherever you are is as good as
                                                                                                                your workplace

                                                                                                                  Resources

                                                                                                                  Videos

                                                                                                                  Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                                  eBooks

                                                                                                                  Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                                  Webinars

                                                                                                                  Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                                  CRM Tips

                                                                                                                  Make the most of Zoho CRM with these useful tips.



                                                                                                                    Zoho Show Resources