Announcing DataPrep 2.0 Beta!

Announcing DataPrep 2.0 Beta!



Being data-driven is an important end goal for all organizations, because when businesses can manage, analyze, and make actionable decisions based on data, they have a competitive advantage.
With that said, how confident are you in making business decisions based on your business data? How clean is your CRM data? Or how much time is spent on manual data cleansing and preparation? 

To help you solve these problems, we're pleased to announce the release of the DataPrep 2.0 public beta! With this new version, it's now even easier to build an end-to-end pipeline and have complete control over the quality and movement of your data.

What's new in 2.0?



Visual pipeline builder 

The all-new pipeline canvas lets you design a seamless end-to-end data flow. Earlier, you were limited to working with a single dataset at a time—but now data can be fetched from multiple sources, more than one dataset can be prepared and used simultaneously, and the data can be exported to multiple destinations. This helps businesses visualize data flows better, simplify complex workflows, and work with data with more confidence.

Unified scheduling of end-to-end pipelines

A massive upgrade has been made to our scheduling feature. In DataPrep 1.0, the sources and destinations had separate schedules which had to be manually managed by staggering the schedule timing, which was hard. But with 2.0, the scheduling can now be set up at the pipeline level. A single unified schedule can be used to manage imports, processing, and exports for all sources and destinations within the pipeline.

Monitor jobs with ease

With automated pipelines, data transfer happens around the clock. Sometimes, there can be issues with fetching data, and the data transfer can fail. But with jobs, you can easily monitor failed jobs with granular details and identify the points of failure. This ensures your organization doesn't miss out on any valuable data. 

Comprehensive version history

Maintain a complete audit trail with version history. Working with data can be challenging; but with the help of this feature, you can easily track changes and run experiments to get more out of your data. Not happy with your experimental changes to data? Easily switch back to the previously published version with the click of a button. 

Backfill your data effortlessly

There can be outages in the data pipeline, this can be due to source or destination failure, changes in the data or model requiring changes in the preparation steps, and can take a while to be restored. However there is no easy way to catch up on processing the data during the outage, to solve this we are now introducing the Backfill feature. The backfill feature can be used to fetch data and simulate a scheduled process for a selected period of time. For example, if there was an outage of 2 days on a pipeline that was setup to run every hour. With backfill, you can now create a configuration to process all that data by simulating the schedule process for the missed two days, this will create 48 new jobs that will run in sequence and process the missed data for two days.

Efficient row processing with incremental fetch

In every scheduled run, choosing the incremental fetch option fetches only the new and updated data from the source for processing.  This was available for few sources in 1.0, but we're expanding the support to all data sources in 2.0. Incremental fetch job runs faster, compared to full fetch as only the newly added rows are processed, also making it more cost effective. 



Transforms made simple with OpenAI 

Our new transforms, powered by OpenAI, help generate complex formulas based on logic written in simple English or transform data based on the sample output given. This simplifies the data preparation process and makes Zoho DataPrep more accessible, even for organizations that don't have a dedicated data analyst team. 



Create instant pipelines with templates 

We built DataPrep with a vision of helping businesses, big or small, have better access to all their business data—but we understand that the data game can be tricky when you're starting out.
To keep our vision alive and to help everyone start using their business data better, we've built a template gallery based on various business use cases that can easily be used to create a pipeline architecture. Just click on the template to add the formula instantly and transforms needed for the data workflow.

You can also save your own data pipelines as templates to make recreating pipelines easier or to apply the data pipeline over a different set of data. You can also share the data pipelines with your organisation or export them as files to share across different organisations.




New dashboard showcasing your pipeline status

Our new and improved dashboard shows the status of all your pipelines instantly. Easily monitor your scheduled runs, identify failed jobs, and ensure your data is up-to-date in your system. 

​

Make data movement easier with other business applications


We are expanding the list of data connectors supported in Zoho DataPrep and as a start we have released the Zoho Creator integration. 




Migrating data into Zoho Creator, as well as seamlessly moving data between various modules within your custom Creator app, has been made easy with DataPrep. 

As more organizations are adopting SaaS products in their tech stack, in order to make data more available, we're opening up integrations with HubSpot, Salesforce, and SurveyMonkey, as well as many more Zoho products, in the next couple of months. Stay tuned for more data connectors in Zoho DataPrep!

Can't wait to try DataPrep 2.0?
All our existing customers can access the Beta version right from within their DataPrep home page. The Beta is not available for Zoho One users yet, but if you want to try out the Beta on a standalone account, contact us at customersuccess@zohodataprep.com 

Zoho DataPrep is designed to make data preparation and movement easy. With DataPrep 2.0, we have completely revamped our product with the new pipeline builder, unified schedules, pipeline templates and universal incremental fetch that lets you easily manage complex data preparation jobs and data movement.  We've also included 50+ other updates to help you clean, prepare, and monitor your business data effortlessly. 

Check out all updates in 2.0

      • Recent Topics

      • WorkDrive for Excel Add on

        Dear Sir/Madam Have installed Workdrive for Microsoft add on But unable to view the same added in Excel

      • Zoho Calendar s’enrichit avec une intégration à Zoho People et Zoho Cliq

        Les journées de travail ne se déroulent jamais exactement comme prévu. Une conversation informelle devient une séance d’échange d'idées, une absence modifie un planning, et votre agenda se retrouve vite décalé par rapport à la réalité. Chez Zoho Calendar,

      • Holidays

        Hi; For defining Holidays, you need to add logic to handle the year as well as the month & day. We need to be able to enter Holidays for the next year. I need to add a holiday for January 2, 2017, but I can't until January 1st, which is a Sunday and we

      • Zoho public comments are confusing and unnecessary

        Hi, we use zoho desk and have issues with public comments. We started using them because the "Reply" option just seemed very clumsy because of the following reasons: - the top "Reply" button starts what seems to be a regular email, showing the entire

      • Introducing parent-child ticketing in Zoho Desk [Early access]

        Hello Zoho Desk users! We have introduced the parent-child ticketing system to help customer service teams ensure efficient resolution of issues involving multiple, related tickets. You can now combine repetitive and interconnected tickets into parent-child

      • Zoho API - ticket creation - Validation failed for the condition : Ticket Status Info should not be empty

        Hi ! I'm trying to create ticket through Zoho API, and I'm getting a 422 response : "Validation failed for the condition : Ticket Status Info should not be empty" My request looks like this : curl --location 'https://desk.zoho.eu/api/v1/tickets' \ --header

      • How to create a two way Sync with CRM Contacts Module?

        Newbie creator here (but not to Zoho CRM). I want to create an app that operates on a sub-set of CRM Contacts - only those with a specific tag. I want the app records to mirror the tagged contacts in CRM. I would like it to update when the Creator app

      • 10GB Email Storage Limits in Zoho CRM

        We’ve had Zoho One for almost 5 years and have always synced our emails from Gmail via IMAP… As of late, we’ve run into issues with our emails not syncing, due to being over the 10GB storage cap… What’s very odd is that we haven’t changed a thing? I know

      • Deleting unwanted ticket replies

        Hello, In a Zoho Desk Ticket thread, sometimes one of the recipients has auto-reply activated. This creates a new message in the Ticket thread that not only pollutes the thread, but most importantly cannot be replied properly because usually auto-reply e-mails don't do "reply all", so the other recipients are not included. I want to delete such a message in the Ticket thread. I searched the help of Zoho Desk, but only found a way to mark as Spam (https://help.zoho.com/portal/kb/articles/marking-support-tickets-as-spam)

      • Desk DMARC forwarding failure for some senders

        I am not receiving important emails into Desk, because of DMARC errors. Here's what's happening: 1. email is sent from customer e.g. john@doe.com, to my email address, e.g info@acme.com 2. email is delivered successfully to info@acme.com (a shared inbox

      • System-generated support email added in CC on “Reply All”

        Hi, I recently set up Zoho Desk for a client and we are trying to prevent the Zoho Desk system-generated support email address (not the mailbox used as the department’s "From address") from being automatically added in CC when agents use “Reply All” on

      • Create & Update Zoho Vault Passwords via Zoho Flow

        Hi Zoho Flow / Zoho Vault Team, We’d like to request an enhancement to the Zoho Vault integration in Zoho Flow. Current Limitation: At the moment, Zoho Flow supports only the following selected Zoho Vault actions, such as: Fetch passwords, Share passwords

      • Applying Excess Payments & Conflict Invoices Due to Cancelled Items

        I’m running into several issues that appear to stem from deeper-than-expected overlap between Zoho Finance (Books/Inventory) and Zoho POS. The level of coupling between these systems seems greater than what was originally communicated, and it’s leading

      • Please, make writer into a content creation tool

        I'm tired of relying on Google Docs. I'm actually considering moving to ClickUp, but if Writer were a good content creation tool instead of just a word processor, I would finally be able to move all my development within the Zoho ecosystem, rather than

      • Zoho Sheet - Desktop App or Offline

        Since Zoho Docs is now available as a desktop app and offline, when is a realistic ETA for Sheet to have the same functionality?I am surprised this was not laucned at the same time as Docs.

      • Convenience Fees

        I use Zoho Invoice for invoicing my billboard customers.  I have a few customers that want to pay using credit cards and ACH.  As a result, I have integrated an Online Payment Gateway (Stripe) for these customers.  I currently charge these customers a "Convenience Fee" of 3% for using this service as I typically only take checks as payment (and the gateway charges 2.9% + $0.30 per transaction).  I do this by creating a separate line item on the invoice and adding 3% to it.  I would like to offer

      • HTML Tags added to Reports with Notes

        Recently Zoho added the ability to markup text within notes. That way, users can change font size, colors, etc. It's a great change. However, since the change, reports that include a column for "Note Content" are printing HTML tags within the report.

      • New Feature: Audit Log in Zoho Bookings

        Greetings from the Zoho Bookings team! We’re excited to introduce Audit Log, a new feature designed to help you track all key actions related to your appointments. With Audit Log, you can maintain transparency, strengthen security, and ensure accountability.

      • Bill automation in Zoho Books

        Hi I am looking for 3rd-party options for bill automation in zoho which are economical and preferably have accurate scanning. What options do I have? Zoho's native scanning is a bit pricey

      • Restrict Payment Methods

        Allow us to restrict certain payment methods specific for each customer.

      • Introducing the Zoho Projects Learning Space

        Every product has its learning curve, and sometimes having a guided path makes the learning experience smoother. With that goal, we introduce a dedicated learning space for Zoho Projects, a platform where you can explore lessons, learn at your own pace,

      • Emails Getting Delay Error Messages - Status: 451

        Hi. Hoping someone can help. I've been using Zoho for over a year now with no problems at all. Today, the majority of my emails I send out or reply to are getting this error: This message was created automatically by mail delivery system. THIS IS A WARNING MESSAGE ONLY. YOU DO NOT NEED TO RESEND YOUR MESSAGE. The original message was received at Sun, 22 Dec 2019 18:20:19 -0800 from wazza@amninjas.com [wazza@amninjas.com] ----- The following addresses had fatal errors ----- [Status: ERROR, Address:

      • Add Domain

        Hello Zoho Support, My Zoho Sites project accidentally auto-added domains with http:// prefix and duplicated domain entries. Current domains list shows: http://www.kinhtethethao.com.vn (Primary – cannot be removed) http://www.kinhtethethao.com.vn (verification

      • Kaizen #221: Workflow & Actions Reports APIs

        Over the last few weeks, we have joined Zylker Cloud Services as they restructured their automation ecosystem using Workflow APIs and Actions APIs. Along the way, we discovered how to audit workflows, update old rules, create new ones, and manage associated

      • Having an Issue with the Entity ID

        I'm having an issue when trying to use Zoho Flow and the notes function. I currently have it set up when a new response comes into a particular form, all of their responses will go into the notes section of their contact on the CRM. I'm currently mapping

      • For Each Loop in Zoho Flow

        I am using Zoho flow to create rows in an google sheets for every new order in Shopify but the issue is that it is creating one row per order and all line items are comma separated values but I want separate rows for each line item. Is there a way to

      • Debug and Test not receiving updates

        Hello, I've been trying to debug two of my simple flows between Zoho Projects and Clockify but it seems like the Debug and Test feature is not working for me. When I click the Play button on any of the flows and then perform the trigger actions nothing

      • How do people handle using Outlook and Zoho Project calendar at the same time?

        We have an ongoing problem in our organisation where we use Zoho Projects to plan all of our projects tasks and that also allows us to look forward using the workload report to see which of our consultants are overstretched etc and which are available.

      • Attendance, Reimagined: Smarter Views for Teams and Individuals

        Tracking attendance shouldn’t feel like a chore. With the revamped Attendance module UI, Zoho FSM makes it easier than ever to monitor work hours, check-in activity, and team availability—whether you’re managing an entire workforce or just keeping an

      • Logistics Industry: Learn to create amazing appointment scheduling sites

        In the logistics industry, the quality of service is something that cannot be shown to others unless they experience it.  Sure, there are metrics that show how you fare when compared to your competition, but then, it only communicates little with respect to quality. The usual route which firms in logistics took are advertisements, to which the internet has opened alternatives in today’s digital age like websites and appointment scheduling sites. A great online presence can help you communicate with

      • Customer Management: # 1 Pick a Convenient Way to Onboard Customer

        When Meera opened her bookstore, onboarding customers was effortless. A customer walked in, picked a book and left with a handwritten bill. As the store gained popularity, things changed. " Can I place an order over the phone?" a customer asked one day.

      • Tracking Emails sent through Outlook

        All of our sales team have their Outlook 365 accounts setup with IMAP integration. We're trying to track their email activity that occurs outside the CRM. I can see the email exchanges between the sales people and the clients in the contact module. But

      • Fetch ALL items from Inventory and send to Google Sheet using Flow

        The title says it all -- I want to fetch the Item name, SKU, Purchase rate, and Sales rate for ALL items in Zoho Inventory and have them populate a tab in an existing Google Sheet. I have already successfully made this work for one item, so the flow is

      • Why Document Integrity Matters at Every Stage of the Contract Lifecycle

        Contracts are legal records that must stay authentic and traceable from creation to expiry or termination. In Zoho Contracts, several design decisions focus on protecting the integrity of every document. These measures ensure that no important details

      • affichage pièces jointes impossible

        Bonjour, aujourd'hui je n'arrive pas à afficher ni à télécharger les pièces jointes dans ZOHO CRM. J'utilise Chrome, j'ai vidé les caches et les cookies. Mais cela ne change rien. Merci de votre aide

      • Reminder to renew subscription.

        Whenever I try to add to one of my notes a " renew your subscription" window pops out and won't Close disallowing me to edit. Why should I renew my subscription on an application with at best such bugs and at worse such underhanded ways to force ren

      • Fields not coming through, not pulling data

        Forgive the noviceness of my vocabulary. I am in Zoho flow connecting CRM and Projects. When an opportunity hits a certain stage, it will create the project in Projects, and bring in data from the opportunity. Everything is working, except for two fields

      • Smartsheet Integration

        Has any in the community been able to integrate Zoho Desk with Smartsheets using Zoho Flow? I am trying to get the Smartsheet Row ID based on ticket data and cannot find documentation on the Get Row function for Smartsheet. It is asking for a Query String

      • CRM Campaign - how to mass remove contacts?

        Does anyone have a solution for removing all contacts from a CRM campaign. Seems that one by one is the only option. 

      • Send out follow-up email in the same thread (threaded conversations in individual emails) from Zoho CRM

        Hi, I'm new to Zoho. I'm trying to send individual emails to my leads one by one. And I'll send out follow up email if I don't hear back from them later. However, instead of sending a new email, I want to reply in the same email thread so that the recipients

      • Next Page