Announcing DataPrep 2.0 Beta!

Announcing DataPrep 2.0 Beta!



Being data-driven is an important end goal for all organizations, because when businesses can manage, analyze, and make actionable decisions based on data, they have a competitive advantage.
With that said, how confident are you in making business decisions based on your business data? How clean is your CRM data? Or how much time is spent on manual data cleansing and preparation? 

To help you solve these problems, we're pleased to announce the release of the DataPrep 2.0 public beta! With this new version, it's now even easier to build an end-to-end pipeline and have complete control over the quality and movement of your data.

What's new in 2.0?



Visual pipeline builder 

The all-new pipeline canvas lets you design a seamless end-to-end data flow. Earlier, you were limited to working with a single dataset at a time—but now data can be fetched from multiple sources, more than one dataset can be prepared and used simultaneously, and the data can be exported to multiple destinations. This helps businesses visualize data flows better, simplify complex workflows, and work with data with more confidence.

Unified scheduling of end-to-end pipelines

A massive upgrade has been made to our scheduling feature. In DataPrep 1.0, the sources and destinations had separate schedules which had to be manually managed by staggering the schedule timing, which was hard. But with 2.0, the scheduling can now be set up at the pipeline level. A single unified schedule can be used to manage imports, processing, and exports for all sources and destinations within the pipeline.

Monitor jobs with ease

With automated pipelines, data transfer happens around the clock. Sometimes, there can be issues with fetching data, and the data transfer can fail. But with jobs, you can easily monitor failed jobs with granular details and identify the points of failure. This ensures your organization doesn't miss out on any valuable data. 

Comprehensive version history

Maintain a complete audit trail with version history. Working with data can be challenging; but with the help of this feature, you can easily track changes and run experiments to get more out of your data. Not happy with your experimental changes to data? Easily switch back to the previously published version with the click of a button. 

Backfill your data effortlessly

There can be outages in the data pipeline, this can be due to source or destination failure, changes in the data or model requiring changes in the preparation steps, and can take a while to be restored. However there is no easy way to catch up on processing the data during the outage, to solve this we are now introducing the Backfill feature. The backfill feature can be used to fetch data and simulate a scheduled process for a selected period of time. For example, if there was an outage of 2 days on a pipeline that was setup to run every hour. With backfill, you can now create a configuration to process all that data by simulating the schedule process for the missed two days, this will create 48 new jobs that will run in sequence and process the missed data for two days.

Efficient row processing with incremental fetch

In every scheduled run, choosing the incremental fetch option fetches only the new and updated data from the source for processing.  This was available for few sources in 1.0, but we're expanding the support to all data sources in 2.0. Incremental fetch job runs faster, compared to full fetch as only the newly added rows are processed, also making it more cost effective. 



Transforms made simple with OpenAI 

Our new transforms, powered by OpenAI, help generate complex formulas based on logic written in simple English or transform data based on the sample output given. This simplifies the data preparation process and makes Zoho DataPrep more accessible, even for organizations that don't have a dedicated data analyst team. 



Create instant pipelines with templates 

We built DataPrep with a vision of helping businesses, big or small, have better access to all their business data—but we understand that the data game can be tricky when you're starting out.
To keep our vision alive and to help everyone start using their business data better, we've built a template gallery based on various business use cases that can easily be used to create a pipeline architecture. Just click on the template to add the formula instantly and transforms needed for the data workflow.

You can also save your own data pipelines as templates to make recreating pipelines easier or to apply the data pipeline over a different set of data. You can also share the data pipelines with your organisation or export them as files to share across different organisations.




New dashboard showcasing your pipeline status

Our new and improved dashboard shows the status of all your pipelines instantly. Easily monitor your scheduled runs, identify failed jobs, and ensure your data is up-to-date in your system. 

​

Make data movement easier with other business applications


We are expanding the list of data connectors supported in Zoho DataPrep and as a start we have released the Zoho Creator integration. 




Migrating data into Zoho Creator, as well as seamlessly moving data between various modules within your custom Creator app, has been made easy with DataPrep. 

As more organizations are adopting SaaS products in their tech stack, in order to make data more available, we're opening up integrations with HubSpot, Salesforce, and SurveyMonkey, as well as many more Zoho products, in the next couple of months. Stay tuned for more data connectors in Zoho DataPrep!

Can't wait to try DataPrep 2.0?
All our existing customers can access the Beta version right from within their DataPrep home page. The Beta is not available for Zoho One users yet, but if you want to try out the Beta on a standalone account, contact us at customersuccess@zohodataprep.com 

Zoho DataPrep is designed to make data preparation and movement easy. With DataPrep 2.0, we have completely revamped our product with the new pipeline builder, unified schedules, pipeline templates and universal incremental fetch that lets you easily manage complex data preparation jobs and data movement.  We've also included 50+ other updates to help you clean, prepare, and monitor your business data effortlessly. 

Check out all updates in 2.0

    • Recent Topics

    • Edit item custom fields

      Getting this error : Transactions have been created with the custom field. Hence it cannot be deleted. Not trying to delete it, just trying to change which modules to show in or to not show at all in transactions !

    • Zoho Books - How to Invoke a Custom Function in Schedulers

      We have multiple schedulers that send emails to customers in batches. Currently, we are maintaining the same code across several schedulers. Is it possible to use a custom function inside a scheduler script? If yes, how can we invoke the custom function

    • Use Zoho Books to bill for work done in Zoho Desk??

      I'm trying to see if something is possible (and if yes, how). We use Zoho One to manage our business. We have a lot of clients that will put in a ticket (via portal) to have work done. Out techs will pick up the ticket, do the work, and then log the time

    • Zoho Finance Suite - Customer Custom Tabs - Dynamic Link

      Hi Finance Suite team, When creating a Custom Tab for a Client Portal, there is no option to add dynamic parameters. This would be very helpful for adding Zoho Analytics dashboards which can be dynamically filtered through the URL to only show information

    • Modular Permission Levels

      We need more modular Permissions per module in Books we have 2 use cases that are creating problems We need per module export permission we have a use case where users should be able to view the sales orders but not export it, but they can export other

    • Is it possible to assign Client user to external task ON PROJECTS' TEMPLATES?

      Is it possible to assign Client user to external task ON TEMPLATES PROJECTS?

    • Blueprint or Validation Rules for Invoices in Zoho Books

      Can I implement Blueprint or Validation Rules for Invoices in Zoho Books? Example, use case could be, Agent confirms from client that payment is done, but bank only syncs transactions tomorrow. in this case, Agent can update invoice status to done, and

    • Feature Enhancement Request – Text Formatting Options in Item Description (Zoho Books/Quotes Module)

      Dear Zoho Development Team, Greetings from Radiant360 Integrated Technical Services LLC. We would like to bring to your attention a functional limitation we've encountered within the Item Table / Quote Description section of Zoho Books (and Zoho CRM Quotes).

    • Add Option to Mass Dispatch by User

      Hello! We are using the dispatch console to dispatch service appointments to our service ressources. Right now, the process is our dispatcher verifies each ressource's route for the day and dispatches it after validation. Sadly, there doesn't seem to

    • Bank Receipt Catagorization

      Hi, how can I match a bank deposit to multiple customer's invoices ? For e.g. A single person paid to us on behalf of different five customers. I need to keep the separated invoices for each customer

    • Per Level Approval for admins

      We need Process admins like Zoho CRM in Zoho Books for per stage approval Currently in books, admins only have the option for Final Approval But for example, in cases like when an employee is on leave, we can't just approval one level we only have option

    • Payment on a past due balance

      Scenario: Customer is past due on their account for 4 months. We suspend their billing in Zoho books. Customer finally logs into the portal and enters a new credit card. We associate that cardwith their subscription, which will permit the card to be used

    • How to export all line-item descriptions for a specific item in Zoho Books?

      I am trying to audit a specific item (“Item X”) that has been invoiced multiple times with different line-level descriptions. Here’s the situation: I am using Zoho Books (Professional). Each invoice may contain the same item but with different descriptions

    • List of hidden features

      Hi Friends, I had another support chat today and low and behold the feature that I wanted just simply needed to be "enabled". I thought I'd share, and maybe see if others had some similar experiences. 1. This one is from 5 ish years ago. I asked if there

    • How to change a BAS that has been filed

      I have discovered that a group of expense transactions were accidentally placed in a asset account rather than an expense account. As a result I need to adjust the transaction and consequently most of my BAS to correct the error. Because the BAS have

    • How to Export PDF with a custom Template

      I need to export Sales Order with a Custom Template I have created How can I do it? I see an API to export the PDF but how can I choose which template to choose to generate the PDF

    • Associate email with a potential or project.

      I have a pivotal requirement to associate emails from various suppliers (contacts) with different potentials or projects, on an email by email basis as they come in. This question appears to have been raised before but I cannot find a definitive yes "it can be done". Could anyone please tell me, yes or no.  If the later I can stop wasting time and look at alternative crm systems. I would love not to have to do this. Thanks in advance.

    • MTA - BAD IP reputation by outlook/hotmail

      Messages to Microsoft email servers are bouncing back due to poor reputation. Message: 4.7.650 The mail server [136.143.188.206] has been temporarily rate limited due to IP reputation. For e-mail delivery information see https://postmaster.live.com (S775)

    • Function with Search Records was working until a few weeks ago, around when "Connected Records" was released

      I have a custom function that has been running for nearly a year now, which suddenly stopped working around the time Zoho released the "Connected Records" update. The function is no longer finding the record using the searchRecords function. I've changed

    • Is CRM On Premise available

      Hi Zoho team, Can you please let me know that CRM Zoho is available for On Premise as well? Thanks, Devashish

    • How to sync from Zoho Projects into an existing Sprint in Zoho Sprints?

      Hi I have managed to integrate Zoho Projects with Zoho Sprints and I can see that the integration works as a project was created in Zoho Sprints. But, what I would like to do is to sync into an existing Zoho Sprints project. Is there a way to make that

    • Online Assessment or any aptitude test

      This video is really helpful! I have one question — if I share an assessment form link (through email or with the application form on my career page), how does Zoho Recruit evaluate it? Can a candidate use Google or external help while taking the test,

    • Editing the Ticket Properties column

      This is going to sound like a dumb question, but I cannot figure out how to configure/edit the sections (and their fields) in this column: For example, we have a custom "Resolution" field, which parked itself in the "Ticket Information" section of this

    • Incoming Threads Report

      From data to decisions: A deep dive into ticketing system reports Customers raise questions and issues through multiple channels, such as email, chat, or tickets. To monitor the number of queries received on a specific day from each channel, leads can

    • Conditional layouts - support for multi-select picklists

      Hi, The documentation for conditional layouts says the following: "Layout Rules cannot be used on the following field types: Auto Number Lookup Multi Select Lookup User Lookup Formula File Upload Multi Line" I have a custom module with a multi-pick list

    • Samsung Keyboard Issues with Notebook

      Dear Users, We're sorry to inform you that some of our users are experiencing certain issues like scrolling, delay/lag, cursor placement especially within the text notes. This occurs mainly due to Samsung Keyboard compatibility with Android 13 and some

    • How to apply customized Zoho Crm Home Page to all users?

      I have tried to study manuals and play with Zoho CRM but haven't found a way how to apply customized Zoho CRM Home Page as a (default) home page for other CRM users.. How that can be done, if possible? - kipi Moderation Update: Currently, each user has

    • Cloudflare Turnstile is now available in Zoho Forms!

      Hello form builders! We have added a new layer of protection to help you keep your forms free from bots. Instead of forcing users to prove they are human, Cloudflare Turnstile quietly checks browser signals in the background. Your real users glide through,

    • Power of Automation :: Unique Task & Issue Prefix Format and Sequencing Rule

      Hello Everyone, A custom function is a software code that can be used to automate a process and this allows you to automate a notification, call a webhook, or perform logic immediately after a workflow rule is triggered. This feature helps to automate

    • 【Zoho CRM】キャンバス機能のアップデート

      ユーザーの皆さま、こんにちは。コミュニティチームの藤澤です。 今回は「Zoho CRM アップデート情報」の中から、キャンバス機能のアップデートをご紹介します。 目次 グリッドについて フォーム表示のタブについて 1. グリッドについて ビジュアルデザインは細部の調整に手間がかかりますが、キャンバスのグリッドを使えば要素を整理し、バランスよく配置できます。 画像やデータなどの要素をグループ化せずに簡単に配置できます。 余白を調整することで、要素間の視覚的なバランスを保つのに役立ちます。 「表示切り替え基準の幅」を設定すると、デザインをレスポンシブに調整できます。

    • Deleting unwanted ticket replies

      Hello, In a Zoho Desk Ticket thread, sometimes one of the recipients has auto-reply activated. This creates a new message in the Ticket thread that not only pollutes the thread, but most importantly cannot be replied properly because usually auto-reply e-mails don't do "reply all", so the other recipients are not included. I want to delete such a message in the Ticket thread. I searched the help of Zoho Desk, but only found a way to mark as Spam (https://help.zoho.com/portal/kb/articles/marking-support-tickets-as-spam)

    • Issue: Ticket Export Does Not Include Ticket Threads

      Dear Zoho Desk Support Team, I hope you’re doing well. I wanted to bring to your attention that the current ticket export feature in Zoho Desk does not seem to include the ticket threads or conversation history. When exporting tickets, only the summary

    • Ability to Set Client Name During Portal Invitation

      Hi Zoho Team, We would like to suggest an important enhancement to the Zoho Creator Client Portal functionality. Zoho Creator recently introduced the option to set a client’s display name in the Client Portal settings, which is very helpful for creating

    • スマホでキャンペンメールを見ると正しく表示されない

      キャンペーンのメール（HTML）を作成しましたが、スマホ表示に切り替えると正しく表示されません（添付参照）過去に作成したキャンペーンでは特に意識してませんでしたが、問題なく表示されていたようです。うまく表示される場合とされない場合の違いは何でしょうか？

    • 136.143.188.51 blocked by spamcop

      Zoho mailserver seems to be blocked by spamcop. Cant send mail to my customer. Not sure what to do.

    • Zoho Calendar Integrated Into CRM?

      I've searched around the forums but couldn't find anything addressing this . . .  Is there a plan to integrate Zoho's stand alone calendar solution into Zoho CRM?  The CRM calendar does an OK job but is very basic and the Zoho calendar is great, but I've only figured out to subscribe to my CRM calendar within ZCalendar - there is no 2-way sync. My preferred solution would be for ZCal to become the default calendar/event solution within Z CRM. Is this on the roadmap? Thanks

    • Can I Create Different Page Layouts Based on a Specified Module Pick List Field

      I am trying to work out how to create different page layouts based on a specified module pick list field value, like the Salesforce feature where you can define multiple record types and then create custom page layouts for each record type. This is a super important feature as for almost all the modules we are using (Leads, Potentials, Accounts) we need to be able only show fields relevant to the record type. E.g. We need a very different page layout for a consumer lead Vs a commercial lead, same

    • Scheduling Tasks in Relation to Project End Date

      I use Zoho project  to help manage tasks that relate to a number of specific business events that take place.  I would like to be able to have my project end date be the date of the event and then work "back" from that date to say...   Add a task 2 weeks before the project end date to remind me to XYZ.  Does anyone know if there is a way to base task timings back from a project due date rather than a project start date?

    • Notes of Tasks in Zoho CRM

      Hello, Is there a way to filter the Notes that appear on a Task to only show the notes related to that specific Task and not display all the Notes of the objects related to that Task (Accounts, Contacts, Deal, etc). In essence, our team struggles to understand

    • Passing the CRM

      Hi, I am hoping someone can help. I have a zoho form that has a CRM lookup field. I was hoping to send this to my publicly to clients via a text message and the form then attaches the signed form back to the custom module. This work absolutely fine when

    • Next Page