Data types supported in Zoho DataPrep

Data types supported in Zoho DataPrep


Data type is a key attribute associated with a column using which the valid and invalid data are classified and data quality is calculated. In Zoho DataPrep, there are a variety of data types to suit your needs, but they are all built upon a few fundamental data types that we call base data types. All other data types are derived from these base data types. digits

The base data types available in Zoho DataPrep are given in the table below:

Base datatype

Max limit/Range

Formats/Units supported

Number

23 digits

All formats

Text

-

(?s).*

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point.

  2. Scale is the number of digits after the decimal point.

All formats

Date

1-1-1000 to 9-9-9999 


dd MMM, yyyy 

Click here to know more. 

Date-time

1-1-1000 00:00:00 to 9-9-9999 23:59:59

dd MMM, yyyy hh:mm:ss Click here to know more.

Duration

Days - 0 to 36500000

Hours - 00 to 24

Seconds - 00 to 59

Milliseconds - 0 to 999

Microseconds 0 to 999999

D.HH:mm:ss.SSSSSS.
Click here to know more.

From the above base data types the following data types are derived.

Derived datatype

Derived from

Max limit

Formats/Units supported

Currency

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point. 

  2. Scale is the number of digits after the decimal point.

 

£,$,₩,₨,﷼. Click here to know more.

Temperature

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point.

  2. Scale is the number of digits after the decimal point.

 

°C, °F, K

Note: A base unit is the fundamental unit in a system of measurement. In DataPrep, conversions between different units and the histogram representation of data distribution is applied on top of the base unit. For example, for the Temperature datatype, the base unit is celcius (°C).

 

List

Text

-

Array

Example: ["North", "South", "East", "West"]

Map

Text

-

Object

Example: {"Region":"North", "Product":"Furniture", "Customer Name":"John Brito", "Sales":"272"}

Boolean

Text

-

Yes, No, True, False

URL

Text

-

protocol://domain/path#locationhash?paramname=paramvalues

 

Example: https://help.zoho.com/portal/en/kb/dataprep

Email

Text

-

username@domain

A valid email address consists of an email prefix and an email domain.

The prefix appears to the left of the @ symbol and the domain at right.

 

Email prefix:

  1. Allowed characters: letters (a-z), numbers, underscores, periods, and dashes.

  2. An underscore, period, or dash must be followed by one or more letter or number.

             

Email domain:

  1. Allowed characters: letters, numbers, dashes.

  2. The last portion of the domain must be at least two characters. For example: .com, .org, .cc

 

Length

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point. 

  2. Scale is the number of digits after the decimal point.

 

cm, m, km, mm, mi, µm, nm, ft, yd, in, nmi

 

Note: A base unit is the fundamental unit in a system of measurement. In DataPrep, conversions between different units and the histogram representation of data distribution is applied on top of the base unit. For example, for the Length datatype, the base unit is meter (m). 

 

 

Positive Number

Number

23 digits

N>=0

where N is the number.

Percentage 

Decimal

38 precision and 15 scale

where,

  1. Precision is the number of digits in a number. Of the 38, maximum 23 digits can be placed to the left of the decimal point.

  2. Scale is the number of digits after the decimal point.

 

%

Timestamp

Datetime

 

-

millis 

Example: 1635509077

Number of milliseconds calculated since January 1, 1970 , 00:00:00 GMT. A negative number is the number of milliseconds before this date.

Time  Datetime  -
HH:mm:ss
Click here to know more.


Note: You can also create your own datatype to measure the data quality of organization specific data such as, employee ID, asset ID, etc., and validate them. Use the Create custom datatype option available as part of the Change datatype transform to create your own datatype.

Data types and supported transforms 

In Zoho DataPrep, some transforms can only be applied over certain data types. Let us look into the transforms available exclusively for each datatype.


Datatype

Transforms exclusive to the data type

Formats / Units supported

Default format

 

Base data types

 

Number

Change format, Round off, Extract from number

All formats

Comma (,) is used as the default thousand separator.

Text

Cluster and Merge, Change Case, Extract from text, Sentiment analysis, Language detection, Keyword extraction

(?s).*

.*

Decimal

Change format, Round off

All formats

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Date 

Change date format, Extract from date

yy, yyyy, MM, MMM, MMMM, dd, EEE, EEEE. Click here to know more. 

dd MMM, yyyy

Date-time 

Change date format, Extract from date

HH, hh, mm, m, ss, s, SSS, a. Click here to know more.

dd MMM, yyyy hh:mm:ss

Duration Change duration format
 D.HH:mm:ss.SSSSSS
Click here to know more.
D.HH:mm:ss.SSSSSS

 

Derived datatypes

 

Currency

-

£,$,₩,₨,﷼. Click here to know more

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Temperature

Convert units

°C, °F, K

 

Dot (.) is used as the default decimal separator.

List

Extract from List

Array

Example:Region= ["North", "South", "East", "West"]

-

Map

Extract from Map

Object

Example:Sales={"Region":"North", "Product":"Furniture", "Customer Name":"John Brito", "Sales:272"}

-

Boolean

-

^(?i)(true|false)$

-

URL

Extract from URL 

protocol://domain/path

Example: https://help.zoho.com/portal/en/kb/dataprep

protocol://domain/path

Email

Extract from Email

username@domain

A valid email address consists of an email prefix and an email domain.

The prefix appears to the left of the @ symbol and the domain appears to the right. For example, username@example.com

 

Email prefix:

  1. Allowed characters: letters (a-z), numbers, underscores, periods, and dashes.

  2. An underscore, period, or dash must be followed by one or more letter or number.

             

Email domain:

  1. Allowed characters: letters, numbers, dashes.

  2. The last portion of the domain must be at least two characters. For example: .com, .org, .cc

 

username@domain

Length

Convert units

cm, m, km, mm, mi, µm, nm, ft, yd, in, nmi

 

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Positive Number

-

N>=0

where N is the number.

Comma (,) is used as the default thousand separator.

Percentage 

-

Comma (,) is used as the default thousand separator and dot (.) is used as the default decimal separator.

Timestamp 

-

millis

Example: 1635509077

Number of milliseconds calculated since January 1, 1970 , 00:00:00 GMT. A negative number is the number of milliseconds before this date.

Time Change time format, Extract from time
HH:mm:ss 
Click here to know more
HH:mm:ss

DataPrep offers a whole host of transforms that can be applied on any column of any datatype. Some of the common transforms are:
  1. Count
  2. Trim whitespaces
  3. Split
  4. Merge
  5. Replace
  6. Prefix/Suffix
  7. Fill empty cells
  8. Truncate
  9. Change data type
  10. Create buckets 
  11. Duplicate column
  12. Filter
  13. Extract
  14. Smart selection
  15. Select columns
  16. Add formula
  17. Window functions
  18. Mark as personal data

      Create. Review. Publish.

      Write, edit, collaborate on, and publish documents to different content management platforms.

      Get Started Now


        Access your files securely from anywhere

          Zoho CRM Training Programs

          Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

          Zoho CRM Training
            Redefine the way you work
            with Zoho Workplace

              Zoho DataPrep Personalized Demo

              If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

              Zoho CRM Training

                Create, share, and deliver

                beautiful slides from anywhere.

                Get Started Now


                  Zoho Sign now offers specialized one-on-one training for both administrators and developers.

                  BOOK A SESSION





                              Quick Links Workflow Automation Data Collection
                              Web Forms Enterprise Begin Data Collection
                              Interactive Forms Workplace Data Collection App
                              CRM Forms Customer Service Accessible Forms
                              Digital Forms Marketing Forms for Small Business
                              HTML Forms Education Forms for Enterprise
                              Contact Forms E-commerce Forms for any business
                              Lead Generation Forms Healthcare Forms for Startups
                              Wordpress Forms Customer onboarding Order Forms for Small Business
                              No Code Forms Construction RSVP tool for holidays
                              Free Forms Travel
                              Prefill Forms Non-Profit

                              Intake Forms Legal
                              Mobile App
                              Form Designer HR
                              Mobile Forms
                              Card Forms Food Offline Forms
                              Assign Forms Photography
                              Mobile Forms Features
                              Translate Forms Real Estate Kiosk in Mobile Forms
                              Electronic Forms

                              Notification Emails for Forms Alternatives Security & Compliance
                              Holiday Forms Google Forms alternative  GDPR
                              Form to PDF Jotform alternative HIPAA Forms
                              Email Forms
                              Encrypted Forms
                              Embeddable Forms
                              Secure Forms
                              Drag & drop form builder
                              WCAG

                                    Create. Review. Publish.

                                    Write, edit, collaborate on, and publish documents to different content management platforms.

                                    Get Started Now




                                                      You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                                          Manage your brands on social media


                                                            • Desk Community Learning Series


                                                            • Digest


                                                            • Functions


                                                            • Meetups


                                                            • Kbase


                                                            • Resources


                                                            • Glossary


                                                            • Desk Marketplace


                                                            • MVP Corner


                                                            • Word of the Day


                                                            • Ask the Experts


                                                              Zoho Sheet Resources

                                                               

                                                                  Zoho Forms Resources


                                                                    Secure your business
                                                                    communication with Zoho Mail


                                                                    Mail on the move with
                                                                    Zoho Mail mobile application

                                                                      Stay on top of your schedule
                                                                      at all times


                                                                      Carry your calendar with you
                                                                      Anytime, anywhere




                                                                            Zoho Sign Resources

                                                                              Sign, Paperless!

                                                                              Sign and send business documents on the go!

                                                                              Get Started Now




                                                                                      Zoho TeamInbox Resources





                                                                                                Zoho DataPrep Demo

                                                                                                Get a personalized demo or POC

                                                                                                REGISTER NOW


                                                                                                  Design. Discuss. Deliver.

                                                                                                  Create visually engaging stories with Zoho Show.

                                                                                                  Get Started Now









                                                                                                                      • Related Articles

                                                                                                                      • Duration formats supported in Zoho DataPrep

                                                                                                                        Duration is the difference between two time values. A duration format can be formed using different format strings such as D, H, SSSSSS, etc. Zoho DataPrep supports the following format strings: Format String Description Range D Indicates the Days 0 ...
                                                                                                                      • Export data to Zoho Creator

                                                                                                                        Zoho DataPrep supports exporting data to Zoho Creator using the Zoho Creator connector. Zoho Creator is a powerful low-code application development platform that helps businesses build custom web and mobile apps faster. To export data to Zoho Creator ...
                                                                                                                      • Units supported for currency datatype

                                                                                                                        Currency is a data type that is derived from the decimal data type. For example, India uses the currency, Indian Rupee. In Zoho DataPrep, there are a variety of data types to suit your needs. Click here to know more about the data types supported in ...
                                                                                                                      • Reload data

                                                                                                                        You can manually refresh your dataset with the latest data by reloading data from your data source. You can find the option to reload data at two places in Zoho DataPrep. 1. The Reload data from source option from the Import menu. 2. The Reload data ...
                                                                                                                      • Ruleset in Zoho DataPrep

                                                                                                                        This page covers the following sections: What is a Ruleset? Data source settings Ruleset operations Options with individual rules Ruleset Templates What is a Ruleset? Each transform applied on the dataset is stored in DataPrep as a rule, in order of ...
                                                                                                                        Wherever you are is as good as
                                                                                                                        your workplace

                                                                                                                          Resources

                                                                                                                          Videos

                                                                                                                          Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                                          eBooks

                                                                                                                          Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                                          Webinars

                                                                                                                          Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                                          CRM Tips

                                                                                                                          Make the most of Zoho CRM with these useful tips.



                                                                                                                            Zoho Show Resources