Data types supported in Zoho DataPrep

Data types supported in Zoho DataPrep

Data type is a key attribute associated with a column using which the valid and invalid data are classified and data quality is calculated. In Zoho DataPrep, there are a variety of data types to suit your needs, but they are all built upon a few fundamental data types that we call base data types. All other data types are derived from these base data types. 

The base data types available in Zoho DataPrep are given in the table below:

Base datatype

Max limit/Range

Formats/Units supported

Number

23 digits

All formats

Text

-

(?s).*

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point.

  2. Scale is the number of digits after the decimal point.

All formats

Date

1-1-1000 to 9-9-9999 


dd MMM, yyyy 

Click here to know more. 

Date-time

1-1-1000 00:00:00 to 9-9-9999 23:59:59

dd MMM, yyyy hh:mm:ss Click here to know more.

Duration

Days - 0 to 36500000

Hours - 00 to 24

Seconds - 00 to 59

Milliseconds - 0 to 999

Microseconds 0 to 999999

D.HH:mm:ss.SSSSSS.
Click here to know more.

From the above base data types the following data types are derived.

Derived datatype

Derived from

Max limit

Formats/Units supported

Currency

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point. 

  2. Scale is the number of digits after the decimal point.

 

£,$,₩,₨,﷼. Click here to know more.

Temperature

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point.

  2. Scale is the number of digits after the decimal point.

 

°C, °F, K

Note: A base unit is the fundamental unit in a system of measurement. In DataPrep, conversions between different units and the histogram representation of data distribution is applied on top of the base unit. For example, for the Temperature datatype, the base unit is celcius (°C).

 

List

Text

-

Array

Example: ["North", "South", "East", "West"]

Map

Text

-

Object

Example: {"Region":"North", "Product":"Furniture", "Customer Name":"John Brito", "Sales":"272"}

Boolean

Text

-

Yes, No, True, False

URL

Text

-

protocol://domain/path#locationhash?paramname=paramvalues

 

Example: https://help.zoho.com/portal/en/kb/dataprep-2-0

Email

Text

-

username@domain

A valid email address consists of an email prefix and an email domain.

The prefix appears to the left of the @ symbol and the domain at right.

 

Email prefix:

  1. Allowed characters: letters (a-z), numbers, underscores, periods, and dashes.

  2. An underscore, period, or dash must be followed by one or more letter or number.

             

Email domain:

  1. Allowed characters: letters, numbers, dashes.

  2. The last portion of the domain must be at least two characters. For example: .com, .org, .cc

 

Length

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point. 

  2. Scale is the number of digits after the decimal point.

 

cm, m, km, mm, mi, µm, nm, ft, yd, in, nmi

 

Note: A base unit is the fundamental unit in a system of measurement. In DataPrep, conversions between different units and the histogram representation of data distribution is applied on top of the base unit. For example, for the Length datatype, the base unit is meter (m). 

 

 

Positive Number

Number

23 digits

N>=0

where N is the number.

Percentage 

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point.

  2. Scale is the number of digits after the decimal point.

 

%

Timestamp

Datetime

 

-

millis 

Example: 1635509077

Number of milliseconds calculated since January 1, 1970 , 00:00:00 GMT. A negative number is the number of milliseconds before this date.

Time Datetime -HH:mm:ss
Click here to know more.


Note: You can also create your own datatype to measure the data quality of organization specific data such as, employee ID, asset ID, etc., and validate them. Use the Create custom datatype option available as part of the Change datatype transform to create your own datatype.

Data types and supported transforms 

In Zoho DataPrep, some transforms can only be applied over certain data types. Let us look into the transforms available exclusively for each datatype.


Datatype

Transforms exclusive to the data type

Formats / Units supported

Default format

 

Base data types

 

Number

Change format, Round off, Extract from number

All formats

Comma (,) is used as the default thousand separator.

Text

Cluster and Merge, Change Case, Extract from text, Sentiment analysis, Language detection, Keyword extraction

(?s).*

.*

Decimal

Change format, Round off

All formats

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Date 

Change date format, Extract from date

yy, yyyy, MM, MMM, MMMM, dd, EEE, EEEE. Click here to know more. 

dd MMM, yyyy

Date-time 

Change date format, Extract from date

HH, hh, mm, m, ss, s, SSS, a. Click here to know more.

dd MMM, yyyy hh:mm:ss

DurationChange duration format
 D.HH:mm:ss.SSSSSS
Click here to know more.
D.HH:mm:ss.SSSSSS

 

Derived datatypes

 

Currency

-

£,$,₩,₨,﷼. Click here to know more

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Temperature

Convert units

°C, °F, K

 

Dot (.) is used as the default decimal separator.

List

Extract from List

Array

Example:Region= ["North", "South", "East", "West"]

-

Map

Extract from Map

Object

Example:Sales={"Region":"North", "Product":"Furniture", "Customer Name":"John Brito", "Sales:272"}

-

Boolean

-

^(?i)(true|false)$

-

URL

Extract from URL 

protocol://domain/path

Example: https://help.zoho.com/portal/en/kb/dataprep

protocol://domain/path

Email

Extract from Email

username@domain

A valid email address consists of an email prefix and an email domain.

The prefix appears to the left of the @ symbol and the domain appears to the right. For example, username@example.com

 

Email prefix:

  1. Allowed characters: letters (a-z), numbers, underscores, periods, and dashes.

  2. An underscore, period, or dash must be followed by one or more letter or number.

             

Email domain:

  1. Allowed characters: letters, numbers, dashes.

  2. The last portion of the domain must be at least two characters. For example: .com, .org, .cc

 

username@domain

Length

Convert units

cm, m, km, mm, mi, µm, nm, ft, yd, in, nmi

 

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Positive Number

-

N>=0

where N is the number.

Comma (,) is used as the default thousand separator.

Percentage 

-

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Timestamp 

-

millis

Example: 1635509077

Number of milliseconds calculated since January 1, 1970 , 00:00:00 GMT. A negative number is the number of milliseconds before this date.

TimeChange time format, Extract from timeHH:mm:ss 
Click here to know more
HH:mm:ss


      Create. Review. Publish.

      Write, edit, collaborate on, and publish documents to different content management platforms.

      Get Started Now


        Access your files securely from anywhere

          Zoho CRM Training Programs

          Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

          Zoho CRM Training
            Redefine the way you work
            with Zoho Workplace

              Zoho DataPrep Personalized Demo

              If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

              Zoho CRM Training

                Create, share, and deliver

                beautiful slides from anywhere.

                Get Started Now


                  Zoho Sign now offers specialized one-on-one training for both administrators and developers.

                  BOOK A SESSION





                              Quick Links Workflow Automation Data Collection
                              Web Forms Enterprise Begin Data Collection
                              Interactive Forms Workplace Data Collection App
                              CRM Forms Customer Service Accessible Forms
                              Digital Forms Marketing Forms for Small Business
                              HTML Forms Education Forms for Enterprise
                              Contact Forms E-commerce Forms for any business
                              Lead Generation Forms Healthcare Forms for Startups
                              Wordpress Forms Customer onboarding Order Forms for Small Business
                              No Code Forms Construction RSVP tool for holidays
                              Free Forms Travel
                              Prefill Forms Non-Profit

                              Intake Forms Legal
                              Mobile App
                              Form Designer HR
                              Mobile Forms
                              Card Forms Food Offline Forms
                              Assign Forms Photography
                              Mobile Forms Features
                              Translate Forms Real Estate Kiosk in Mobile Forms
                              Electronic Forms Banking 
                              Notification Emails for Forms Alternatives Security & Compliance
                              Holiday Forms Google Forms alternative  GDPR
                              Form to PDF Jotform alternative HIPAA Forms
                              Email Forms
                              Encrypted Forms
                              Embeddable Forms
                              Secure Forms
                              Drag & drop form builder
                              WCAG

                                      Create. Review. Publish.

                                      Write, edit, collaborate on, and publish documents to different content management platforms.

                                      Get Started Now




                                                        You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                                            Manage your brands on social media


                                                              • Desk Community Learning Series


                                                              • Digest


                                                              • Functions


                                                              • Meetups


                                                              • Kbase


                                                              • Resources


                                                              • Glossary


                                                              • Desk Marketplace


                                                              • MVP Corner


                                                              • Word of the Day


                                                              • Ask the Experts


                                                                Zoho Sheet Resources

                                                                 

                                                                    Zoho Forms Resources


                                                                      Secure your business
                                                                      communication with Zoho Mail


                                                                      Mail on the move with
                                                                      Zoho Mail mobile application

                                                                        Stay on top of your schedule
                                                                        at all times


                                                                        Carry your calendar with you
                                                                        Anytime, anywhere




                                                                              Zoho Sign Resources

                                                                                Sign, Paperless!

                                                                                Sign and send business documents on the go!

                                                                                Get Started Now




                                                                                        Zoho TeamInbox Resources





                                                                                                  Zoho DataPrep Demo

                                                                                                  Get a personalized demo or POC

                                                                                                  REGISTER NOW


                                                                                                    Design. Discuss. Deliver.

                                                                                                    Create visually engaging stories with Zoho Show.

                                                                                                    Get Started Now









                                                                                                                        • Related Articles

                                                                                                                        • Zoho DataPrep - FAQs

                                                                                                                          1. What is Zoho DataPrep? Zoho DataPrep is an advanced self-service data preparation tool that helps organizations model, cleanse, prepare, enrich and organize large volumes of data from multiple data sources to serve data analytics and data ...
                                                                                                                        • Zoho DataPrep - User Guide Overview

                                                                                                                          Zoho DataPrep is an advanced self-service ETL software. You can move large volumes of data from multiple data sources to various destinations to serve data analytics and data warehousing with exceptional data quality. You can also clean, transform ...
                                                                                                                        • Duration formats supported in Zoho DataPrep

                                                                                                                          Duration is the difference between two time values. A duration format can be formed using different format strings such as D, H, SSSSSS, etc. Zoho DataPrep supports the following format strings: Format String Description Range D Indicates the Days 0 ...
                                                                                                                        • Zoho DataPrep's Home page

                                                                                                                          Dashboard Getting started The getting started section in the home page is shown to trial users, this shows you the various aspects to get started with Zoho DataPrep. You can take a Product tour to get a walkthrough and understand the end-to-end ...
                                                                                                                        • Export data to Zoho Analytics

                                                                                                                          You can export the refined data to data analytics tools such as Zoho Analytics. To export data to Zoho Analytics 1. Open an existing pipeline or create a pipeline from the Home Page, Pipelines tab or Workspaces tab. You can bring your data from ...
                                                                                                                          Wherever you are is as good as
                                                                                                                          your workplace

                                                                                                                            Resources

                                                                                                                            Videos

                                                                                                                            Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                                            eBooks

                                                                                                                            Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                                            Webinars

                                                                                                                            Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                                            CRM Tips

                                                                                                                            Make the most of Zoho CRM with these useful tips.



                                                                                                                              Zoho Show Resources