Import data from local files

Import data from a local filesystem




In DataPrep, you can import various file types, including CSV, TSV, JSON, HTML, XLS, XLSX and XML.

Note :
1. DataPrep also supports files without any extension or files in plain text format. However, binary files cannot be parsed during import; users will have to manually parse the file into one of the supported formats listed above. 
2. Maximum local file size supported during import is 100MB. You can find the details on other technical limitations here.

To import a local file

1. Create a pipeline or open an existing pipeline from the Home Page, Pipelines tab or Workspaces tab and click the Add data option. You can also click the Import data option under the Workspaces tab to import data.  
Info: You can also click the Import data  icon at the top of the pipeline builder and bring data from multiple sources into the pipeline.



2. Choose the Files option from the Choose your data source. You can also click the Files category from the left pane and upload files you select one of the below options:
  • Files
  • URL
  • FTP  


3. Drag and drop your files into the upload box or click on it to browse for your files. You can also enable the Import from local network toggle if you want to import local files incrementally based on a specific file pattern. Click here to know more.
Note : In the case of Zip files, only one file is supported. Make sure you have only one file compressed or zipped within the .Zip file.





You can also click the  Try sample  link to import the sample dataset and see how it works.

4. The files added will be shown along with their file size. You have the option to add more files or remove the existing ones. 
Note : In the case of HTML files, data selection for import depends on the order in which the tables exist within the HTML page. 



5. Click Import once you have all your files. The upload progress will be shown. 

6. If the files are HTML, XLS, XLSX or password protected files the user can enter the password and preview the files before clicking the Import button to complete the import.



7. Once all files are successfully imported, it will take you to the Pipeline builder page where you can start applying transforms. You can also right-click the stage and choose the Prepare data option to prepare your data in the DataPrep Studio page. Click here to know about transforms.



8. Once you are done creating your data flow and applying necessary transforms in your stages, you can right-click a stage and add a destination to complete your data flow.

Note:  After adding a destination to the pipeline, you can try executing your pipeline using a manual run at first. Once you make sure manual run works, you can then set up schedule to automate the pipeline. Learn about the different types of runs here.

Note
1. Each file is created as a separate dataset inside your workspace. 
2. If the file is password-protected, DataPrep will prompt you to enter the password to open the file. This password will not be saved and is only used for opening the password-protected file. 
3. If you upload excel files, DataPrep offers an option to select individual sheets in the file for import. You can also preview the sheets before choosing to import them. 


To import files from local network 

Using the Import from local network toggle, you can perform dynamic file selection based on the regex. This can be used for getting new or incremental data from your local file system. Incremental fetch is a method used to import new files from a source after the previous sync. Zoho DataPrep helps you import incremental data from your local files using Zoho Databridge.

Important: This option is used not only for incremental fetch. You can also use this option for bulk import of files based on the file pattern.

In DataPrep, you can incrementally import various file types, including CSV, TSV, JSON, XML, and TXT.

1. Enable the Import from local network toggle if you want to import local files incrementally based on a specific file pattern.

Info: Please ensure that you have installed Zoho Databridge in your machine to import local files. Click here to know how to download and install Zoho Databridge.


2. Choose an active Databridge and provide the following details:

Folder path : The folder path where you want to search for files. Eg. D:\DataPrep\Datasets

Info: Folder path is case-sensitive.

Include subfolders : You can select this checkbox if you want to include subfolders while searching for a file.

File pattern : The pattern used to match the file names in the specified location. This supports regex type matching. You can also use the pattern, ".*" to match any file in the path specified.

Info: File pattern is case-sensitive.

Note: The file pattern match is a simple regex type match. For example, to fetch files with names such as Sales_2022.csv,Sales_2023.csv, Sales_2024.csv , you can input the pattern Sales_.* 

Similarly to fetch files such as PublicData1.csv , PublicData2.csv , PublicData3.csv , use Public.*

If you want to import a single file, then specify the pattern using the exact file name.
Eg: leads_jan_2022.*

Parse file as : Choose the required extension to parse the file. If your file format is not a commonly used one, you can use this option to parse the file into one of the following formats before importing the data into a readable format. The available formats are CSV, TSV, JSON, XML, and TXT.

Merge files and import - This will merge all the files that match the pattern specified and import them as a single dataset.

You can use this option to merge files together during the import itself, without having to perform unions post import.
Info: This option can merge a maximum of only 5 files at a time.
Note: If this checkbox is unchecked then, only 1 file will be fetched at a time.

Eg. If your local path has 10 files, the first 5 will be merged into one dataset and imported. During the next reload, the remaining 5 files will be merged and imported.

Similarly, if your local path has 8 files, the first 5 will be merged and fetched first, followed by the next 3.

3. Click the Import button. 


SEE ALSO 


    Zoho CRM Training Programs

    Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

    Zoho CRM Training
      Redefine the way you work
      with Zoho Workplace

        Zoho DataPrep Personalized Demo

        If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

        Zoho CRM Training

          Create, share, and deliver

          beautiful slides from anywhere.

          Get Started Now


            Zoho Sign now offers specialized one-on-one training for both administrators and developers.

            BOOK A SESSION











                                        You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                            Manage your brands on social media

                                              Zoho Desk Resources

                                              • Desk Community Learning Series


                                              • Digest


                                              • Functions


                                              • Meetups


                                              • Kbase


                                              • Resources


                                              • Glossary


                                              • Desk Marketplace


                                              • MVP Corner


                                              • Word of the Day


                                                Zoho Marketing Automation

                                                  Zoho Sheet Resources

                                                   

                                                      Zoho Forms Resources


                                                        Secure your business
                                                        communication with Zoho Mail


                                                        Mail on the move with
                                                        Zoho Mail mobile application

                                                          Stay on top of your schedule
                                                          at all times


                                                          Carry your calendar with you
                                                          Anytime, anywhere




                                                                Zoho Sign Resources

                                                                  Sign, Paperless!

                                                                  Sign and send business documents on the go!

                                                                  Get Started Now




                                                                          Zoho TeamInbox Resources



                                                                                  Zoho DataPrep Resources



                                                                                    Zoho DataPrep Demo

                                                                                    Get a personalized demo or POC

                                                                                    REGISTER NOW


                                                                                      Design. Discuss. Deliver.

                                                                                      Create visually engaging stories with Zoho Show.

                                                                                      Get Started Now









                                                                                                          • Related Articles

                                                                                                          • Import data from URLs

                                                                                                            You can enter the URL to a CSV, TSV, JSON, HTML, XLS, XLSX or XML file. DataPrep also supports URL imports that require authentication. To import files from URLs 1. Create a pipeline or open an existing pipeline from the Home Page, Pipelines tab or ...
                                                                                                          • Import data from FTP servers

                                                                                                            You can import files from FTP servers using the following steps. To import data using an FTP connection 1. Create a pipeline or open an existing pipeline from the Home Page, Pipelines tab or Workspaces tab and click the Add data option. You can also ...
                                                                                                          • Import data from local databases

                                                                                                            You can import data from the following local databases into DataPrep using Zoho Databridge: MySQL MS SQL Server Oracle PostgreSQL Maria DB Pervasive SQL Sybase DB2 Exasol Sqlite Actian Vector Greenplum Denodo Progress OpenEdge YugabyteDB Microsoft ...
                                                                                                          • Import options

                                                                                                            DataPrep offers a wide range of import options. Your data can be imported from BI tools, cloud storage services, cloud databases. To import your data, 1. Create a pipeline or open an existing pipeline from the Home Page, Pipelines tab or Workspaces ...
                                                                                                          • Import data from Snowflake

                                                                                                            Zoho DataPrep supports importing data from Snowflake, a cloud database. Snowflake is a cloud data warehouse that can store, process and analyze data. To import data from Snowflake 1. Create a pipeline or open an existing pipeline from the Home Page, ...
                                                                                                            Wherever you are is as good as
                                                                                                            your workplace

                                                                                                              Resources

                                                                                                              Videos

                                                                                                              Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                              eBooks

                                                                                                              Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                              Webinars

                                                                                                              Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                              CRM Tips

                                                                                                              Make the most of Zoho CRM with these useful tips.



                                                                                                                Zoho Show Resources