How to import data from URL?

Import data from URLs

You can enter the URL to a CSV, TSV, JSON, HTML, XLS, XLSX or XML file. DataPrep also supports URL imports that require authentication. 

To import files from URLs

1. Click URL  from the Choose a data source box while creating a new dataset. 



2. Enter the Dataset name and the request URL to fetch your data. 

You can also click the Try sample link to import the sample dataset and see how it works.

3. Enter the necessary parameters and headers. 
For example, you can declare parameters and headers with data types, content format and the language used. 
      


4. Select one of the pagination options if you want to import your data page-wise.       

Note: The None option is selected by default.

Pagination

 i) Page Number - Select this option if your data is stored on multiple pages and you want to import them in the same order. You need to provide the following details when using this option:
  1. Page number parameter : This is the page parameter name provided by your API/URL provider.
  1. Initial value : The initial page number from which you want to start importing.
  1. Number of requests : The number of requests to execute in sequence.
      

         In the above screenshot, we are fetching 10 pages. The URL will be executed 10 times as follows:


         Here, the Parameter name is Page and the Number of requests is 10.

 ii)  Offset and limit - Select this option if you have a large dataset and want to import the data in batches by providing the start position and batch size of each batch. You need to provide the following details when using this option:

  1. Offset parameter : This is the offset parameter name given by your API provider.
  1. Initial value : Provide the initial value of offset.
  1. Number of requests : Number of requests to execute in the sequence.
  1. Limit parameter : This is the limit parameter name given by your API provider.
  1. Limit value : Number of records to be fetched from the offset.


To fetch 1000 records from the URL http://dataprepubuntu2.csez.zylker.com/Pagination_Data/JSONData which supports Offset and Limit parameters (100 records per API call), we have to invoke it 10 times as follows:


From the second request, the Offset Parameter value is the previous offset value + limit.

Here the Offset Parameter name is Offset , Limit Parameter name is Limit . The Limit Value is 100 and the Number of requests is 10.

iii) Next page URL - Select this option if you have your data in pages where each page has the URL for the next page. You need to provide the following details when using this option:

    URL Property Path : The property name that can fetch the URL of the next page.



In the above screenshot, the next page URL Property is /next_page_URL. The next page will be fetched from the JSON property /next_page_URL. This execution will continue until the /next_page_URL property is empty or null.

Note:
1. The Next Page URL pagination is applicable only for JSON and XML files.
2. These pagination options can be used in Zoho DataPrep only if your API provider permits you to do so.

5. Select one of the authorization types and give a name to this connection.
  • No Auth - The URL you provide doesn't require any authorization. 
  • Basic Auth - The URL requires the 'Username' and 'Password' to authorize the URL and import data.
  • OAuth2.0 - The URL is secured using OAuth2.0 authentication technique. It requires 'Client ID', 'Client Secret', 'Access Token', and 'Refresh token' to authorize the URL and allow import.
Note: The Auth configuration is saved for importing from the URL in the future. Credentials are securely encrypted and stored. 



6. Give a name to your connection in the Connection name text box.



7. Click Authenticate  to fetch the data from the URL.

8. Once you have completed importing data, you can choose to schedule this import or start preparing your data right away.



To Edit the URL connection

DataPrep saves your data connections to avoid the hassle of keying in the credentials every time you need to connect to a data source or destination. You can always edit the saved data connection and update them with new parameters or credentials using the Edit connection option. 

1. Click Saved data connections from the Choose a data source box while creating a new dataset. 



2. You can manage your saved data connections right from the data import screen. Click the ellipsis (3 dots) icon to share, edit, view the connection overview, or remove the connection. 



3. Click the Edit connection option to update the saved connection with new parameters or credentials. 

4. You can also edit the pagination options under the Pagination tab if you want to import your data page-wise:
  1.  Page number
  2.  Offset and limit
  3.   Next page URL
Click here to know more about Pagination.



5. Click the Update button to update the connection.

SEE ALSO  

    Zoho CRM Training Programs

    Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

    Zoho CRM Training
      Redefine the way you work
      with Zoho Workplace

        Zoho DataPrep Personalized Demo

        If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

        Zoho CRM Training

          Create, share, and deliver

          beautiful slides from anywhere.

          Get Started Now


            Get started with Zoho Sign

            in a few quick steps!

            Download Help Guide





                      Still can't find what you're looking for?

                      Write to us:  support@zohoforms.com


                            




                          

                        Zoho Marketing Automation

                          Zoho Sheet Resources

                           




                              Zoho Forms Resources


                                Secure your business
                                communication with Zoho Mail


                                Mail on the move with
                                Zoho Mail mobile application

                                  Stay on top of your schedule
                                  at all times


                                  Carry your calendar with you
                                  Anytime, anywhere




                                        Zoho Sign Resources

                                          Sign, Paperless!

                                          Sign and send business documents on the go!

                                          Get Started Now


                                              Zoho SalesIQ Resources



                                                  Zoho TeamInbox Resources



                                                          Zoho DataPrep Resources



                                                            Zoho DataPrep Demo

                                                            Get a personalized demo or POC

                                                            REGISTER NOW


                                                              Design. Discuss. Deliver.

                                                              Create visually engaging stories with Zoho Show.

                                                              Get Started Now











                                                                                    • Related Articles

                                                                                    • Import data from FTP servers

                                                                                      You can import files from FTP servers using the following steps.  To import data using an FTP connection 1. Select the FTP option from Choose a data source box. 2. Configure FTP connection to connect to the server and fetch the file. Enter the file ...
                                                                                    • Import data from a local filesystem

                                                                                      In DataPrep, you can import various file types, including CSV, TSV, JSON, HTML, XLS, XLSX and XML.   Note: DataPrep also supports files without any extension or files in plain text format. However, binary files cannot be parsed during import; users ...
                                                                                    • Scheduling data import

                                                                                      You can schedule data import using the Schedule import option available for datasets in your workspace. You can choose to Schedule import for data sources: URLs, FTPs, Cloud storage, and databases. To schedule a data import Click the Schedule import ...
                                                                                    • Import data using saved data connections

                                                                                      DataPrep saves your data connections to avoid hassles in keying them often. To access your saved data connections  1. Click Saved data connections from the Choose a data source box while creating a new dataset.  2. Manage your saved data connections ...
                                                                                    • Import data from local databases

                                                                                      You can import data from the following local databases into DataPrep using Zoho Databridge: MySQL MS SQL Server Oracle PostgreSQL Maria DB Pervasive SQL Sybase DB2 Exasol Sqlite Actian Vector Greenplum Denodo Progress OpenEdge YugabyteDB Microsoft ...
                                                                                    Wherever you are is as good as
                                                                                    your workplace

                                                                                      Resources

                                                                                      Videos

                                                                                      Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                      eBooks

                                                                                      Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                      Webinars

                                                                                      Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                      CRM Tips

                                                                                      Make the most of Zoho CRM with these useful tips.



                                                                                        Zoho Show Resources