You can create new columns and customize them using the Formula column transform. Zoho DataPrep offers a variety of functions to suit your needs. Click here to know more about the functions.

To create a formula column

1. Click on the Transform menu and select the Formula column option.

2. Provide a name for new column name in the New column name field.

3. You can insert the functions in the Formula field by typing the function names, or use the intelliSense to complete the functions. You can also apply filters and search functions in the Click to insert functions section.

4. You can also click the Formula builder powered by GenAI tile to generate formula by sending prompts to the AI vendor. Click here to know more.

5. You can add parameters to the formula, or use intelliSense to choose columns. You can also search for column names in the Click to insert columns section.

6. DataPrep shows a live preview of the changes made to the formula when you click on the Preview button. 

7. Click Apply to apply the changes.

Formula Generator built with GenAI

The prompt and required contextual data will be shared with the selected AI vendor. Personally identifiable information (PII) is never shared with the selected AI Vendor.

The GenAI features, when enabled, can be used by the Account admin and Organization admins in your DataPrep organization.

The API key is specific to the DataPrep organization it is configured in and will not be shared across organizations or with any other Zoho service.

To configure and enable OpenAI's ChatGPT integration

OpenAI in Zoho DataPrep works in a BYOK (Bring Your Own Key) model, in which users bring their own ChatGPT API Key and OpenAI Organization ID. If you are already an OpenAI user, you can use your API key and organization ID to unlock AI features in DataPrep. 

Data Privacy Notice: Zoho DataPrep utilizes OpenAI's ChatGPT API, an external service based in the USA, subject to OpenAI's Terms of Use. Please be aware that the information sent to OpenAI depends on the access provided by you, the user. The data shared with ChatGPT is based on the features you enable. Details such as column names and/or selected cell data will be shared based on each feature. You can choose to enable or disable each feature based on the level of data you want to share. Therefore, exercise caution while using this service and ensure that the data you provide does not contain confidential or personal information. 

Notes: 

1. The generative responses are coming in from ChatGPT's training data. Accuracy, consistency, and relevance of the response are subjective to the type of prompts and the data available in its training set. 
2. ChatGPT doesn't respond to prompts about personal information.
   

1. Click on the Transform menu and select the Formula column option in the Studio page. The GenAI Configuration tab will open. Click Authenticate Now to authenticate with the selected AI vendor.

The GenAI Configuration tab opens when you use Ask Zia for the first time. From then on, you can edit the configuration from the GenAI Configuration tab on the Settings page.

Note: The GenAI configuration on DataPrep's Settings page will be visible only to the Account admin.

Only the Account admin can enable features for your DataPrep organization.

2. Click Authenticate now next to OpenAI. 

3. A consent pop-up will be shown. Please read the data privacy notice carefully before you proceed. By proceeding, you acknowledge and accept the risks and OpenAI's terms of use policy. 

4. Provide the API Key and Organization ID of your OpenAI organization to configure OpenAI integration in your DataPrep organization. 

Note: The key will be encrypted and securely stored in Zoho DataPrep. Learn how to get the Organization ID and the API key from OpenAI

5. Once saved, go to the GenAI Skills tab. Toggle on Formula Generator, and select OpenAI from the vendor dropdown to generate formulas using OpenAI.

Organization ID and API key in OpenAI

1. Go to your settings page in OpenAI to get the Organization name and ID. Here's a snapshot for reference. Read more from OpenAI

2. Go to the API keys tab under the Organization section to get your API Key. Here's a snapshot for reference. Read more from OpenAI

To configure and enable Zoho LLM

Zoho LLM is Zoho's own large language model. You can enable it directly from the GenAI configuration settings without needing an external API key. Once enabled, it powers AI features in Zoho DataPrep.

Note: This setting is visible and accessible only to the Account admin.

1. Click on the Transform menu and select the Formula column option in the Studio page. The GenAI Configuration tab will open. Click Authenticate Now to authenticate with the selected AI vendor.

The GenAI Configuration tab opens when you use Ask Zia for the first time. From then on, you can edit the configuration from the GenAI Configuration tab on the Settings page.

2. Locate Zoho LLM in the AI Vendor list and click Enable configuration.

3. A consent pop-up will be shown. Please read the data privacy notice carefully before you proceed.

4. In the Authentication panel, confirm that the Zoho LLM toggle is enabled and click Save.

5. Once saved, go to the GenAI Skills tab. Toggle on Formula generator, and select Zoho LLM from the vendor dropdown to generate formulas using Zoho LLM.

To generate a formula built with GenAI

1. Click on the Transform menu and select the Formula column option.

a) I want to know if the ordered date is a weekday or if it was on the weekend to assess when I get maximum orders. Here's a snapshot of the natural language prompt and the auto-generated formula.

b) I wish to get the average cost based on each month the order was received. Here's the snapshot of the natural language prompt and the auto-generated formula.

c) I want to mask credit card information and view only the last 4 digits of it. Here's the snapshot of the natural language prompt and the auto-generated formula. 

d) I want to update the Mobile number of a lead in my CRM sales data. Here's the snapshot of the natural language prompt and the auto-generated formula.

e) I want to find if a year is a leap year or not in my Sales dataset. Here's the snapshot of the natural language prompt and the auto-generated formula.

To apply filters

If you want to apply some filters along with this transform, you can use the filters functionality.

1. Click the Filters tab.

2. Click the   icon and add the required columns in the  Filters  section. You can also reorder the filters using the drag and drop method.

3. For every column added, you can select one of the following options from the drop-down:

1. Actual: This option lets you filter rows based on the actual values in the column. Click here to learn more.
2. Data quality: This option lets you filter rows based on the quality of data in the column. Click here to know more.
   
3. Patterns: This option helps you filter rows based on the data patterns in the selected column. Click here to know more.
4. Seasonal: This option helps you filter rows based on the seasonal parameters such as quarter, month, week, etc. Click here to know more.
   
5. Outliers: This option allows you to filter rows based on the outliers present in the data of the selected column. Click here to know more. 

Note: The filter options are displayed based on the datatype of the column added for the filter.

4. When you add more than one filter to the  Filters  section, the logical operators, AND or OR appear next to the filters. You can click to toggle the logical operator between AND and OR.

1. Using the logical operators, you can combine the conditions and apply logic to determine the rule of precedence. The final expression is displayed in the  Criteria expression  box. You can click  Edit  to alter the default expression using logical operators and parenthesis to specify the precedence or the sequential order as to which condition should be evaluated first. Click  Save  after making the required changes. 
   

1. For example, In the expression, ((1 OR 2) AND (3 OR 4)) , at first the condition ( 1 OR 2 ) will be executed and the condition ( 3 OR 4 ) will be executed next. Thirdly, since, the AND operator is used, the filter will be applied when both the conditions are true.

5. You can further drill down to choose specific values based on the filter option selected for each filter, in the next section.

     

For example, in the above screenshot, the Data quality option is selected for the All columns filter in the Filters section. Based on the selection, further options to filter specific values are displayed in the  All columns (Data quality) section.

6. You can choose to include or exclude the selected items in the last section.

7. If you want to remove all the filters for some reason, you can use the Clear button.

8. A live preview of the filter transform is shown as you make changes. 

9. Click the Apply button to apply the transform along with the filters.

Usecase

mul(`Sales`,`Conversion rate`)