To import data from Zoho WorkDrive

Info: You can also click the Import data  icon at the top of the pipeline builder and bring data from multiple sources into the pipeline.

3. All the folders and files in your WorkDrive will be directly fetched from your Zoho WorkDrive account using which you have logged into Zoho DataPrep. Select the files you want to import and click the Import button. You can also use the Advanced selection option to import files that match a specific pattern. Click here to know more.

You can also import files from shared folders in Zoho WorkDrive.

Files in root folders must not have spaces in their names. If there is a space, the file will not be imported in advanced selection.

4. If it is an HTML, XLS, or XLSX file, you can click the Preview option to view a sample of the data.

5. If the file is password protected, enter the password, and click the   right arrow.

6. Click Import button.

7. Once you have completed importing data, Pipeline builder page opens and you can start applying transforms. You can also right-click the stage and choose the Prepare data option and prepare your data in the DataPrep Studio page. Click here to know more about the transforms.

8. Once you are done creating your data flow and applying necessary transforms in your stages, you can right-click a stage and add a destination to complete your data flow.

Note:  After adding a destination to the pipeline, you can try executing your pipeline using a manual run at first. Once you make sure manual run works, you can then set up schedule to automate the pipeline. Learn about the different types of runs here.

Advanced selection

To import files using Advanced selection,

1. Click the advanced selection link.

Important: Advanced selection is used not only for incremental fetch. You can also use this option for bulk import of files based on the file pattern. 

2. Provide the following details:

• Choose folder : Choose the folder you want to import data from.
  
  
  a) My drive
  
  b) Shared with me
  
  c) Team folders
  
  
  
  
  
  
  
  

  Note: If you choose Team folders then choose the team and team folder you want to import from.
  
  
  
  
  

• Folder path : The folder path where you want to search for files. Eg. datasheetlist/ 
  
  
• If the files are stored in the WorkDrive without any folder, you can leave this field empty.

  

  The "Folder Path" is a directory path field and does not support regex patterns.
  Info: Folder path is case-sensitive.

• File pattern : The pattern used to match the file names in the WorkDrive. This supports regex type matching. You can also use the pattern, ".*" to match any file in the path specified.
  

Info: File pattern is case-sensitive.

Note: The file pattern match is a simple regex type match. For example, to fetch files with file names such as Sales_2022.csv , Sales_2023.csv , Sales_2024.csv , you can input the pattern Sales_.* 

Similarly to fetch files such as PublicData1.csv , PublicData2.csv , PublicData3.csv , use Public.*

If you want to import a single file, then specify the pattern using the exact file name.
Eg: leads_jan_2022.*

• Include subfolders : You can also select the Include subfolders checkbox if you want to include subfolders while searching for a file.
  

• Parse file as : Choose the required extension to parse the file. If your file format is not a commonly used one, you can use this option to parse the file into one of the following formats before importing the data into a readable format. The available formats are CSV, TSV, JSON, XML, and TXT.
  
  

• Merge files and import - This will merge all the files that match the pattern specified and import them as a single dataset.

  

  You can use this option to merge files together during the import itself, without having to perform unions post import.

  Info: This option can merge a maximum of only 5 files at a time.
  Note: If this checkbox is unchecked then, only 1 file will be fetched at a time.
  

  
  
  Eg. If your Zoho Workdrive account has 10 files, the first 5 will be merged into one dataset and imported. During the next reload, the remaining 5 files will be merged and imported.
  
  
  
  Similarly, if your Zoho Workdrive account has 8 files, the first 5 will be merged and fetched first, followed by the next 3. 
  
  
  

Note: We support only CSV, TSV, JSON, XML, and TXT file formats for incremental fetch from cloud storage.

SEE ALSO
           

How to add a new pipeline?

How to import data from cloud databases?

What are the other cloud storage options available in Zoho DataPrep?

How to schedule a pipeline?

How to export data to WorkDrive?