Announcing DataPrep 2.0 Beta!

Announcing DataPrep 2.0 Beta!



Being data-driven is an important end goal for all organizations, because when businesses can manage, analyze, and make actionable decisions based on data, they have a competitive advantage.
With that said, how confident are you in making business decisions based on your business data? How clean is your CRM data? Or how much time is spent on manual data cleansing and preparation? 

To help you solve these problems, we're pleased to announce the release of the DataPrep 2.0 public beta! With this new version, it's now even easier to build an end-to-end pipeline and have complete control over the quality and movement of your data.

What's new in 2.0?



Visual pipeline builder 

The all-new pipeline canvas lets you design a seamless end-to-end data flow. Earlier, you were limited to working with a single dataset at a time—but now data can be fetched from multiple sources, more than one dataset can be prepared and used simultaneously, and the data can be exported to multiple destinations. This helps businesses visualize data flows better, simplify complex workflows, and work with data with more confidence.

Unified scheduling of end-to-end pipelines

A massive upgrade has been made to our scheduling feature. In DataPrep 1.0, the sources and destinations had separate schedules which had to be manually managed by staggering the schedule timing, which was hard. But with 2.0, the scheduling can now be set up at the pipeline level. A single unified schedule can be used to manage imports, processing, and exports for all sources and destinations within the pipeline.

Monitor jobs with ease

With automated pipelines, data transfer happens around the clock. Sometimes, there can be issues with fetching data, and the data transfer can fail. But with jobs, you can easily monitor failed jobs with granular details and identify the points of failure. This ensures your organization doesn't miss out on any valuable data. 

Comprehensive version history

Maintain a complete audit trail with version history. Working with data can be challenging; but with the help of this feature, you can easily track changes and run experiments to get more out of your data. Not happy with your experimental changes to data? Easily switch back to the previously published version with the click of a button. 

Backfill your data effortlessly

There can be outages in the data pipeline, this can be due to source or destination failure, changes in the data or model requiring changes in the preparation steps, and can take a while to be restored. However there is no easy way to catch up on processing the data during the outage, to solve this we are now introducing the Backfill feature. The backfill feature can be used to fetch data and simulate a scheduled process for a selected period of time. For example, if there was an outage of 2 days on a pipeline that was setup to run every hour. With backfill, you can now create a configuration to process all that data by simulating the schedule process for the missed two days, this will create 48 new jobs that will run in sequence and process the missed data for two days.

Efficient row processing with incremental fetch

In every scheduled run, choosing the incremental fetch option fetches only the new and updated data from the source for processing.  This was available for few sources in 1.0, but we're expanding the support to all data sources in 2.0. Incremental fetch job runs faster, compared to full fetch as only the newly added rows are processed, also making it more cost effective. 



Transforms made simple with OpenAI 

Our new transforms, powered by OpenAI, help generate complex formulas based on logic written in simple English or transform data based on the sample output given. This simplifies the data preparation process and makes Zoho DataPrep more accessible, even for organizations that don't have a dedicated data analyst team. 



Create instant pipelines with templates 

We built DataPrep with a vision of helping businesses, big or small, have better access to all their business data—but we understand that the data game can be tricky when you're starting out.
To keep our vision alive and to help everyone start using their business data better, we've built a template gallery based on various business use cases that can easily be used to create a pipeline architecture. Just click on the template to add the formula instantly and transforms needed for the data workflow.

You can also save your own data pipelines as templates to make recreating pipelines easier or to apply the data pipeline over a different set of data. You can also share the data pipelines with your organisation or export them as files to share across different organisations.




New dashboard showcasing your pipeline status

Our new and improved dashboard shows the status of all your pipelines instantly. Easily monitor your scheduled runs, identify failed jobs, and ensure your data is up-to-date in your system. 

​

Make data movement easier with other business applications


We are expanding the list of data connectors supported in Zoho DataPrep and as a start we have released the Zoho Creator integration. 




Migrating data into Zoho Creator, as well as seamlessly moving data between various modules within your custom Creator app, has been made easy with DataPrep. 

As more organizations are adopting SaaS products in their tech stack, in order to make data more available, we're opening up integrations with HubSpot, Salesforce, and SurveyMonkey, as well as many more Zoho products, in the next couple of months. Stay tuned for more data connectors in Zoho DataPrep!

Can't wait to try DataPrep 2.0?
All our existing customers can access the Beta version right from within their DataPrep home page. The Beta is not available for Zoho One users yet, but if you want to try out the Beta on a standalone account, contact us at customersuccess@zohodataprep.com 

Zoho DataPrep is designed to make data preparation and movement easy. With DataPrep 2.0, we have completely revamped our product with the new pipeline builder, unified schedules, pipeline templates and universal incremental fetch that lets you easily manage complex data preparation jobs and data movement.  We've also included 50+ other updates to help you clean, prepare, and monitor your business data effortlessly. 

Check out all updates in 2.0

    • Recent Topics

    • [ZohoDesk] Improve Status View with a new editeble kanban view

      A kanban view with more information about the ticket and the contact who created the ticket would be valueble. I would like to edit the fields with the ones i like to see at one glance. Like in CRM where you can edit the canvas view, i would like to edit

    • Automated Dismissal of Specific Notifications and Centralized Control of Toast Notification Settings

      Dear Zoho Team, I hope this message finds you well. We would like to request two enhancements related to notification handling within Zoho Desk: Automatic Dismissal of Specific Notifications: Currently, when certain actions are taken in the ticket list

    • Show field in spreadsheet view depending on other field value

      Hello. Not sure if this is possible but let's say i have spreadsheet view in Creator with four different fields Field A, B, C and D Then i have a field named Response which for one record could contain only one of the pre-definde choices below A, B, C

    • Intergrating multi location Square account with Zoho Books

      Hi, I have one Square account but has multiple locations. I would like to integrate that account and show aggregated sales in zoho books. How can I do that? thanks.

    • Zoho Learn Zapier Integration

      Hello all, Is there any plan to integrate Zoho Learn with Zapier? It seems almost all Zoho products are in Zapier, with the exception of Learn and Marketing Automation.

    • Notice: SalesIQ integration paused on Zoho Sites

      I have this notice on my Zoho Sites in the SalesIQ integration setup. Can someone assist? "This integration has been temporarily paused for users. Reconnecting SalesIQ after disconnection will not be possible until we provide further updates." thank

    • Differences between Zoho Books and Zoho Billing

      Without a long drawn out process to compare these. If you were looking at these Books and Billing, what made you opt for one and not the other. Thanks

    • New Feature : Copying tickets with all the contents such as conversations/history/attachments etc

      Sometimes our customers and distributors do create tickets (or send emails) which contain more than one incident in them and then also some of the further conversations which are either created by incorrect new tickets or replies to old tickets are being created as combined tickets. In such cases we require to "COPY" the contents of the tickets into separate tickets and merge them into their corresponding original tickets. The "CLONE" feature doesn't copy the contents (especially the conversations

    • Como se agregan los empleados

      Necesito saber si para agregar empleados los mismos necesitan tener licencias

    • Deluge Error Code 1002 - "Resource does not exist."

      I am using the following script in a Custom Button on a Sales Return. Basically, the function takes the information in the sales return (plus the arguments that are entered by the user when the button is pushed) and creates a return shipping label via

    • Adding multiple Attendee email addresses when adding a Zoho Calendar event in Zoho Flow

      I am trying to integrate Notion and Zoho Calendar via Zoho Flow. However, the Attendee email address supported by Zoho Calendar - Create event only supports one email address, so I am having difficulty implementing automation to automatically register

    • Graceful Handling of Exceeded Option Limits

      Hi Zoho SalesIQ team. I would like to submit a feature request to deal with a bug in salesIQ Current Behavior (Bug): When a dynamic list passed to the Single Select Option Card contains more than 20 options, the Zobot stops responding (freezes/hangs)

    • System default SLA descriptions can't be modified

      The system default SLAs have identical descriptions for all SLA levels, but their settings differ. However, I am facing an issue where I cannot modify these descriptions and save the changes. The content of the description box can be edited but the changes

    • Adding non-Indian billing address for my Zoho subscription

      Hey Need help with adding a non-Indian billing address for my Zoho subscription, trying to edit the address to my Singapore registered company. Won't let me change the country. Would appreciate the help. Regards, Rishabh

    • How to create one ZohoCRM organisation out of a multi-organization?

      Hi, we have a multi-org including two different Zoho CRM organizations for two companies using respectively EUR and USD as default currency. I was wondering if there is any easy way to merge the two organizations into just one, so that users may access

    • Gray screen while signing documents

      We are all getting a "gray" screen when trying to sign documents in Zoho sign. Anyone else having issues?

    • Projects custom colors replaced by default orange

      Since yesterday, projects uploaded to Zoho, to which I had assigned a custom color, have lost the customization and reverted to the default color (orange). Has anyone else had the same problem? If so, how did you resolve it?

    • Interview booked through Invite but no Notifications

      We have a workflow that was developed through a developer/partner that was tested and worked. Today, we pushed a candidate through the process and invited them to an in-office interview. They were sent the booking link (as usual and as tested before successfully)

    • WebDAV support

      I need WebDAV support so that I can upload/download (and modify) documents from my local file system. Is anything planned in his direction?

    • Automatiser la gestion des SLA dans Zoho Desk avec Zoho Contracts

      Les équipes du service client s’efforcent d’assurer un support rapide, régulier et fiable pour garantir la satisfaction de chaque client. Les accords de niveau de service (SLA) permettent de clarifier les engagements en définissant les termes et conditions

    • iOS App doesn't refresh for Document Creation

      Hello Zoho team, I have created a workflow to be used on a mobile iOS device which starts in Zoho Creater and ends with a murge and store function that then opens the newly created document within the Zoho Writer app. This process is working great however

    • Uploading a signed template from Sign to Creator

      Good day, Please help me on how to load a signed document back into Creator after the process has been completed in Sign. Below is the code that I am trying, pdfFile = response.toFile("SignedDocument_4901354000000372029.pdf"); info pdfFile; // Attach

    • Zoho DataPrep and File Pattern configuration

      I'm using Zoho data prep to ingest data from One Drive into Zoho Analytics... The pipeline is super simple but I can't any way to get all the files that I need. Basically I need to bring all the files with a certain pattern and for that I'm using a regex

    • Assistance needed: Activation of a domain

      Hello Zoho Support, I purchased the .com domain "primesolva.com" via Zoho 6 days ago. The domain is still pending, and I cannot access the DNS panel to add the TXT verification for domain ownership. Please confirm the registration status and help me activate

    • Operation not permitted

      I am trying to add an email address to the list of user but I am getting error Operation not permitted

    • Request to Permanently Delete Email User (info@mehbobgulf.com ) from Old Organization

      Please permanently delete the user email info@mehbobgulf.com It is still associated with my old Zoho organization. I cannot delete it because it shows ‘You cannot delete email. Zoho host’. I need to use this email in a new Zoho account.”

    • Client host [89.36.170.5] blocked using Spamhaus

      Hello please make make actions for delist ..... "Client host [89.36.170.5] blocked using Spamhaus"

    • Suggestion: Option to Re-run a migration

      As I'm going through a migration process, I like the IMAP migration tool, but it would be better if there were an option to re-run the same migration as configured. There's not even an option to copy/edit one that's already there. Just run if it hasn't

    • Issue with "Add Your Mobile Number"

      Hello, I am trying to sign up for email service for a domain name, and I cannot finish the authentication. When I enter my mobile number, I receive the message "We’re unable to send OTP to this mobile number. Please contact support-as@zohocorp.com". I

    • zoho mail non vérifié

      Bonjour, Il y'a un jour que j'ai acheté un domaine et toute les tentatives pour l'associé a mon compte shopify son vaine. j'ai essayé TXT sans suite après, j'ai essayer avec CNAME sans suite. j'aurais besoin de votre assistance pour associé mon mail.

    • Unable to send message;Reason:553 Relaying disallowed. Invalid Domain

      i have facing the issue "Unable to send message;Reason:553 Relaying disallowed. Invalid Domain" if i verify domain evertthing i did but still face the same error.

    • ZohoMail is so close to being Perfect BUT

      Why don’t you have HILIGHTING???!! I've been trying to find a substitute for Edison Mail but I want & need hilighting (preferably in more than just yellow)! Is this even on your To Do list? I’m so disappointed. 🙄

    • Override Auto Number field?

      We are preparing to migrate from Salesforce. In Salesforce, we auto-generate a unique number on our Opportunities (Potentials). If the Opportunity results in a contract, we use that unique number as the Contract number. There are some situations where

    • Using a third party service provider want to move directly with Zoho

      Hi good day I’m currently using Zoho but I’m using a third party service provider I want to move directly with you guys I’m using Zoho email and invoices and my domain please let me know if it’s possible to move away from the third party provider my email

    • Request for Assistance Regarding Email Sending Issue (554 5.1.8 - Email Outgoing Blocked)

      Dear Zoho Support Team, I hope this message finds you well. I am writing to request assistance with an issue we are currently facing regarding our Zoho Mail account. Our email account, admin@tuyensinhcanuoc.com, is encountering the following error when

    • Zoho Mail API returns empty inbox (0 messages) but webmail shows 37 unread emails

      Hello, I'm experiencing a discrepancy between Zoho Webmail and the Mail API (EU region). **Setup:** - Account: EU datacenter (mail.zoho.eu) - API: Self Client OAuth2 via api-console.zoho.eu - Scopes: ZohoMail.messages.READ, ZohoMail.messages.UPDATE, ZohoMail.folders.READ,

    • ShipStation and Zoho Inventory

      Hello, I am looking to sync zoho inventory with shipstation ZOHO INVENTORY           SHIP STATION Sales Order  ==>  create ORDERS INVOICE  <==    Shipments What exactly does BETA mean on the Shipstation connector?  This is required for me to sign-on in the next month. Thanks in advance for your efforts

    • E

      We are trying to add our Zoho Form embed in our Elementor Page Builder. After adding Zoho Forms widget in elementor page builder it’s displaying in backend page builder but it’s giving 403 error while trying to save, as it’s not reflecting in front end.

    • Connecting Zoho Inventory to ShipStation

      we are looking for someone to help connect via API shipStation with Zoho inventory. Any ideas? Thanks. Uri

    • custom module import.

      Is there a way to import data into a custom module? Thanks Rudy

    • Next Page