Announcing DataPrep 2.0 Beta!

Announcing DataPrep 2.0 Beta!



Being data-driven is an important end goal for all organizations, because when businesses can manage, analyze, and make actionable decisions based on data, they have a competitive advantage.
With that said, how confident are you in making business decisions based on your business data? How clean is your CRM data? Or how much time is spent on manual data cleansing and preparation? 

To help you solve these problems, we're pleased to announce the release of the DataPrep 2.0 public beta! With this new version, it's now even easier to build an end-to-end pipeline and have complete control over the quality and movement of your data.

What's new in 2.0?



Visual pipeline builder 

The all-new pipeline canvas lets you design a seamless end-to-end data flow. Earlier, you were limited to working with a single dataset at a time—but now data can be fetched from multiple sources, more than one dataset can be prepared and used simultaneously, and the data can be exported to multiple destinations. This helps businesses visualize data flows better, simplify complex workflows, and work with data with more confidence.

Unified scheduling of end-to-end pipelines

A massive upgrade has been made to our scheduling feature. In DataPrep 1.0, the sources and destinations had separate schedules which had to be manually managed by staggering the schedule timing, which was hard. But with 2.0, the scheduling can now be set up at the pipeline level. A single unified schedule can be used to manage imports, processing, and exports for all sources and destinations within the pipeline.

Monitor jobs with ease

With automated pipelines, data transfer happens around the clock. Sometimes, there can be issues with fetching data, and the data transfer can fail. But with jobs, you can easily monitor failed jobs with granular details and identify the points of failure. This ensures your organization doesn't miss out on any valuable data. 

Comprehensive version history

Maintain a complete audit trail with version history. Working with data can be challenging; but with the help of this feature, you can easily track changes and run experiments to get more out of your data. Not happy with your experimental changes to data? Easily switch back to the previously published version with the click of a button. 

Backfill your data effortlessly

There can be outages in the data pipeline, this can be due to source or destination failure, changes in the data or model requiring changes in the preparation steps, and can take a while to be restored. However there is no easy way to catch up on processing the data during the outage, to solve this we are now introducing the Backfill feature. The backfill feature can be used to fetch data and simulate a scheduled process for a selected period of time. For example, if there was an outage of 2 days on a pipeline that was setup to run every hour. With backfill, you can now create a configuration to process all that data by simulating the schedule process for the missed two days, this will create 48 new jobs that will run in sequence and process the missed data for two days.

Efficient row processing with incremental fetch

In every scheduled run, choosing the incremental fetch option fetches only the new and updated data from the source for processing.  This was available for few sources in 1.0, but we're expanding the support to all data sources in 2.0. Incremental fetch job runs faster, compared to full fetch as only the newly added rows are processed, also making it more cost effective. 



Transforms made simple with OpenAI 

Our new transforms, powered by OpenAI, help generate complex formulas based on logic written in simple English or transform data based on the sample output given. This simplifies the data preparation process and makes Zoho DataPrep more accessible, even for organizations that don't have a dedicated data analyst team. 



Create instant pipelines with templates 

We built DataPrep with a vision of helping businesses, big or small, have better access to all their business data—but we understand that the data game can be tricky when you're starting out.
To keep our vision alive and to help everyone start using their business data better, we've built a template gallery based on various business use cases that can easily be used to create a pipeline architecture. Just click on the template to add the formula instantly and transforms needed for the data workflow.

You can also save your own data pipelines as templates to make recreating pipelines easier or to apply the data pipeline over a different set of data. You can also share the data pipelines with your organisation or export them as files to share across different organisations.




New dashboard showcasing your pipeline status

Our new and improved dashboard shows the status of all your pipelines instantly. Easily monitor your scheduled runs, identify failed jobs, and ensure your data is up-to-date in your system. 



Make data movement easier with other business applications


We are expanding the list of data connectors supported in Zoho DataPrep and as a start we have released the Zoho Creator integration. 




Migrating data into Zoho Creator, as well as seamlessly moving data between various modules within your custom Creator app, has been made easy with DataPrep. 

As more organizations are adopting SaaS products in their tech stack, in order to make data more available, we're opening up integrations with HubSpot, Salesforce, and SurveyMonkey, as well as many more Zoho products, in the next couple of months. Stay tuned for more data connectors in Zoho DataPrep!

Can't wait to try DataPrep 2.0?
All our existing customers can access the Beta version right from within their DataPrep home page. The Beta is not available for Zoho One users yet, but if you want to try out the Beta on a standalone account, contact us at customersuccess@zohodataprep.com 

Zoho DataPrep is designed to make data preparation and movement easy. With DataPrep 2.0, we have completely revamped our product with the new pipeline builder, unified schedules, pipeline templates and universal incremental fetch that lets you easily manage complex data preparation jobs and data movement.  We've also included 50+ other updates to help you clean, prepare, and monitor your business data effortlessly. 

Check out all updates in 2.0

    Access your files securely from anywhere







                          Zoho Developer Community






                                                • Desk Community Learning Series


                                                • Digest


                                                • Functions


                                                • Meetups


                                                • Kbase


                                                • Resources


                                                • Glossary


                                                • Desk Marketplace


                                                • MVP Corner


                                                • Word of the Day


                                                • Ask the Experts





                                                          Manage your brands on social media



                                                                Zoho TeamInbox Resources



                                                                    Zoho CRM Plus Resources

                                                                      Zoho Books Resources


                                                                        Zoho Subscriptions Resources

                                                                          Zoho Projects Resources


                                                                            Zoho Sprints Resources


                                                                              Qntrl Resources


                                                                                Zoho Creator Resources



                                                                                    Zoho CRM Resources

                                                                                    • CRM Community Learning Series

                                                                                      CRM Community Learning Series


                                                                                    • Kaizen

                                                                                      Kaizen

                                                                                    • Functions

                                                                                      Functions

                                                                                    • Meetups

                                                                                      Meetups

                                                                                    • Kbase

                                                                                      Kbase

                                                                                    • Resources

                                                                                      Resources

                                                                                    • Digest

                                                                                      Digest

                                                                                    • CRM Marketplace

                                                                                      CRM Marketplace

                                                                                    • MVP Corner

                                                                                      MVP Corner







                                                                                        Design. Discuss. Deliver.

                                                                                        Create visually engaging stories with Zoho Show.

                                                                                        Get Started Now


                                                                                          Zoho Show Resources


                                                                                            Zoho Writer Writer

                                                                                            Get Started. Write Away!

                                                                                            Writer is a powerful online word processor, designed for collaborative work.

                                                                                              Zoho CRM コンテンツ




                                                                                                Nederlandse Hulpbronnen


                                                                                                    ご検討中の方




                                                                                                          • Recent Topics

                                                                                                          • Cancel and refund

                                                                                                            Hi, Yesterday I paid for the Zoho email subscription. Within a few minutes, I realized that the subscription counts one email ID as one user. To make another email ID for the same domain name, I'd have to pay for another user. I emailed right away to
                                                                                                          • Online Payment Fees

                                                                                                            We don't take many online credit card payments so the merchant service provider (PayPal) charges us the 2.9% fee for processing the amount. I would like the ability for the fee to be automatically added to the total amount for "ease of payment". We'd
                                                                                                          • Error occured. please try again!!!

                                                                                                            I created a new list. Added two new contact's email addresses. I try to EDIT either one of them to add their first name, last name and phone number. Whatever I try to edit and update, I get the error message  Error occured. please try again!!! And it doesn't update any of their info. I tried just editing first and last name. Still get the error. No matter what I try to update, I get the error. I tried creating a new list, and adding just one email address and then edit it and also get the error.
                                                                                                          • "Send email as" not work

                                                                                                            Hi team, I currently use ZOHO MAIL services on the MAKE platform (formerly INTEGROMAT). In MAKE I entered my ZOHO MAIL credentials but the problem is that when the emails are sent from the automation in MAKE, the emails do not come in with the name set
                                                                                                          • *UPDATE: ISSUE RESOLVED, SEE HOW FOR HELP* Issue imbedding Youtube Videos

                                                                                                            **UPDATE: RESOLVED** For anyone that is having a similar issue, try this workaround before attempting to have the Zoho techs fix it. I have been in communication with them for weeks about this and they can't seem to fix the issue. Thinking it may have just been my computer or my browser, I tried two different computers on two different networks, each running different versions of Windows, and tried it on Chrome, Firefox and IE; nothing worked. So, needless to say, it's an issue with Zoho somewhere.
                                                                                                          • Backorder For Composite Items

                                                                                                            Hello If i released SO for composite item and use backorder feature of zoho inventory then it should backorder child item items of composite and not composite item.This is basic of backordering.I conveyed this to zoho call center but no solution yet.
                                                                                                          • Paid Support

                                                                                                            We are in the process of creating tiers for our support offerings. There will be three tiers of support available - 2 paid and 1 free. The paid tiers will be purchased in allotted hours. I need to figure out how to a) work in the out of the box SLA, Contracts
                                                                                                          • Automatically CC supervisor

                                                                                                            Hello,  in our organization agents are replying to tickets and they are required to CC their supervisor on all emails to and from customers.  is there a way to have an email address automatically populate in the CC field when reply to a ticket?  tha
                                                                                                          • Zoho One - White Label

                                                                                                            Releasing a white-label feature for Zoho One, or any software or service, can offer several advantages and benefits for both the company providing the software (Zoho in this case) and its users. Here are some key reasons for releasing a white-label feature
                                                                                                          • Are this Features included in the Road Map

                                                                                                            1. Sync between description/short description in Zoho Books/Inventory and Zoho Commerce: I am unsure how it works now. I belive the description is not pulled. 2. Pick Up: This feature is great. It is added on Zoho Commerce but not on Books/Inventory which
                                                                                                          • Reconciliation - Show Transactions After End Date

                                                                                                            I did a quick search, and I've only seen this brought up indirectly. In the reconciliation interface, transactions dated up to a week after the end date should be available for being reconciled. The use case is pretty simple... many times, transactions
                                                                                                          • Auto populate email field in zoho form

                                                                                                            Hi,  Is there a way the email field in zoho forms can be auto populated based on the name selected from a drop down list?
                                                                                                          • Option to accept and pay for estimate from Public Estimate link?

                                                                                                            Is there any way that our customers can get the Estimate in their email, click on "View Estimate" and from the public link, click Accept and Pay? When they click that, in the background Zoho would create the invoice record in the so that the payment would
                                                                                                          • Kaizen #125 Manipulating Multi-Select Lookup fields (MxN) using Zoho CRM APIs

                                                                                                            Hello everyone! Welcome back to another week of Kaizen. In last week's post in the Kaizen series, we discussed how subforms work in Zoho CRM and how to manipulate subform data using Zoho CRM APIs. In this post, we will discuss how to manipulate a multi-select
                                                                                                          • Easily track referrals with Zoho Forms

                                                                                                            Referral tracking can be a powerful way for businesses to understand where their leads are coming from. With Zoho Forms, tracking the referral sources of your leads is an easy and straightforward process. Here are some tips to help you make the most of
                                                                                                          • Add an email to an existing ticket is not working

                                                                                                            I noticed that in Zoho Desk the funcionality to add an email to an existing ticket is not working using the syntax [##12345##], has the method changed? In red is the syntax we use to add email to an existing ticket As you can see, he did not add the email
                                                                                                          • New CRM to Campaigns Sync Doesn't Continue Making Updates

                                                                                                            Changes made in CRM are not appearing in mapped fields in matching Campaign records after migrating to the new sync process. The only way we've found to get records to update is to call into Support and point out the problem. After convincing Support
                                                                                                          • Zoho Integration with UPS

                                                                                                            I have 2 questions: Firstly, is there a way to notify UPS that we have a package to collect once we have done the shipping label? Secondly, how do I get the tracking number and shipment method onto the Invoice and Package Slip for the customer? Than
                                                                                                          • Cannot log in to IMAP account as of last night

                                                                                                            Hey I've been using MFA with an authenticator for a while and have had to use application passwords for Outlook and Edison Mail on my Android devices. Last night the app passwords started to be rejected on my Android devices so I created new ones for
                                                                                                          • Low Stock View

                                                                                                            We use the Low Stock view frequently as a guide to inform us when to reorder items, but the view is misleading because it does not take into account Purchase Orders that have already been raised. Unless you are aware and check item by item, this can lead
                                                                                                          • Improve History Feature in Zoho Inventory

                                                                                                            At present there is a "history" tab on Zoho Inventory Items, however this only shows a date and time stamp along with the users name. It doesn't say what was changed. What is the value of this if you can't see what was changed? My Ideal is to include
                                                                                                          • Show backordered items on packing slip

                                                                                                            We send out a lot of large orders, and often there are one or two things backordered. How can I fix the packing slips to show quantity ordered  & quantity packed There should also be the ability to "ship" 0 of an item so the receiver knows that things
                                                                                                          • Document | Files

                                                                                                            The vendor "Partial matches" still not fixed here after years of putting up with having to select most vendors manually ! ( again, the banking "Transaction rules" would solve a lot of these issues ) Some unwanted, irrelevant pdf's also arrive. It would
                                                                                                          • books+POS+ tap to pay+ stripe

                                                                                                            So in the UK we now have tap to pay with stripe. So we can use the stripe app as a POS terminal. Brilliant news. Can we hope that the Books App might add this feature ASAP. It would be great to have one system rather than using the not very good Square
                                                                                                          • Canvas Form View - Client Script Page on load - Url params not working

                                                                                                            We have a custom module with a canvas page for form view. We have a button in Customers module to open this canvas page using invokeurl function. We send few parameters as in the URL as query parameters. https://crm.zoho.in/crm/orgxxxxxxxx/tab/CustomModule12/create/canvas/64333200000261xxxx?layoutId=643332000002605001&c=${Customers.Customer
                                                                                                          • Sending Recruit SMS's to Zoho Cliq - Or tracking in the Messages module in Recruit?

                                                                                                            Is there any way to send SMS Gateway messages in Recruit to ZOho Cliq? We use 2-way SMS massages a lot in Zoho Recruit to speed up communication with Candidates. However the only way to keep track of received SMS's is by keeping a look out for the Email
                                                                                                          • This mobile number has been marked spam. Please contact support.

                                                                                                            Hi Support, Can you tell me why number was marked as spam. I have having difficult to add my number as you keep requesting i must use it. My number is +63....163 Or is Zoho company excluding Philippines from their services?
                                                                                                          • Zohomail does not support additional fields in mailto links

                                                                                                            Hello, I set up Zohomail as default composer in Firefox according to manual here: https://www.zoho.com/mail/help/defaultcomposer.html#alink2 Later, I wanted to use this functionality to answer in a Linux mailing list thread using mailto link: mailto:xxxxx@kernel.org?In-Reply-To=%3C727o0521-q24p-s0qq-66n0-sn436rpqqr1p@example.com%3E&Cc=xxxxx%example.org&Subject=Re%3A%20%5BPATCH%20v2%28%29
                                                                                                          • Is it possible to set a customer context variable in Zobot

                                                                                                            Hi, I want to use a context variable to route users down different paths in my Zobot chat flow. I know I can do this when the user enters data. But I want to know if I can use a variable that is 'hard coded' on the card, that the user is unaware of. Use
                                                                                                          • Cannot change Blog Title

                                                                                                            There is nowhere to change the blog title. You can change the blog URL but that is making no difference to the text "Enter Your Post Title" am I missing something?
                                                                                                          • Kaizen #203 - Answering Your Questions | Handling API Limits and Error Responses

                                                                                                            Hi Everyone, Welcome back to yet another post in the Kaizen Series! We appreciate your keen participation in the 200th milestone celebration of the Kaizen series. We will continue to answer the queries we received through the feedback. When working with
                                                                                                          • How to verify website ownership with google search console

                                                                                                            Hi, I am having a free .in domain provided by Zoho I have created a website on it now I want to verify my ownership to google webmaster. Can you please help me how to do that.
                                                                                                          • Kaizen #89 - Color Coding using Client Script

                                                                                                            Hello everyone! Welcome back to another exciting Kaizen post. Today let us see how you can apply color codes to the List and Detail Pages of Zoho CRM using Client Script. Need for color code in Zoho CRM When you mark things with different colors as a
                                                                                                          • "SPF record exceed the allowed limit of 10"

                                                                                                            Hi, I was wondering if there were a "universal Zoho SPF record" that would allow all my configured Zoho services that email things to meet this limitation ? or do I have to have an entry for mail, com, billing, etc?
                                                                                                          • Zoho Mail android app update: Block & reject future emails, Report phishing, Spam alerts, Suspicious URL detection

                                                                                                            Hello everyone! In the most recent Zoho Mail Android app update, we have brought in support for the following features: Block & reject future emails Report Phishing Spam alerts in the mail details screen. Suspicious URL detection. Block & reject future
                                                                                                          • Animated GIF Images in Chat

                                                                                                            I know this seems to be a small feature request but in a recent Cliq update Zoho disabled autoplay for animated GIFs posted in Cliq conversations. We think this was not a good change. In our organization, animated GIFs in a chat play a role in expressing
                                                                                                          • I can't seem to login in to Mail Apps of MacOS /IOS

                                                                                                            Hi, i'm having trouble in signing in to mail apps from IOS. It's always come back to wrong passwords. But i already changed my password like 3 times. But still it says wrong credentials
                                                                                                          • Profile Image Showing Incorrectly in Zoho Mail

                                                                                                            Hi everyone, I’m facing a serious issue with Zoho Mail. The profile image showing for my email address is incorrect — it’s not my image. When I send an email to my Gmail account, it displays someone else’s image. This looks very suspicious and can make
                                                                                                          • I need access to my old email

                                                                                                            I need access to my old email bromzeman@zoho.com to verify it for forwarding. I can’t access the inbox to get the confirmation code. Please assist with recovery or forwarding. as you might already know, they made alot of the email addresses to have that
                                                                                                          • Set Defaults for Email Groups

                                                                                                            Is there a way to set defaults for all of the groups that I establish as a moderator? For example, I want every group I establish to have the following settings: 1. Moderator is <user> 2. User is <user>, <user> 3. Notifications for new group turned
                                                                                                          • Next Page