Export data to cloud storage services

Export data to cloud storage services




You can export data to the following cloud storage services.
  1. Google Drive 
  2. OneDrive
  3. Box Storage
  4. Dropbox
  5. Zoho WorkDrive
  6. Amazon S3

To export data to cloud storage services

1. Open an existing pipeline or create a pipeline from the Home Page, Pipelines tab or Workspaces tab. You can bring your data from 50+sources.

2. On the Pipeline Builder page, once you have completed creating your data flow and applying the necessary transforms in your stages, you can right-click a stage and select the Add Destination option.



3. You can type in the destination name in the search box or choose the Cloud storage category and the required export option. For instance, click  Google Drive.



4. If your data contains columns with personal data or ePHI data, you can choose to include or exclude them in the Columns section. You can also apply the required security methods to protect your data as follows.

A.  Data masking    
Data masking hides original data with 'x' to protect personal information.

B. Data Tokenization  
Data tokenization replaces each distinct value in your data with a random value. Hence the output is statistically identical to the original data. 

C. None
You can select none if you do not want to use any security method. You can choose whether to export these column using the corresponding check boxes.  




Notes
Note: 
  1. Exporting datasets without securing personal data will be restricted if Secure data exports option is enabled in your organization's privacy settings. Click here to know more.
  2. Based on the Compliance settings of your organization, exporting datasets with ePHI data may be restricted or restricted without securing ePHI data with security measures or password protection.

5.  Select an account from the saved connections or connect a new account using the Add new option. Authenticate your Google account.
Notes
Authentication is required only the first time the service is used with DataPrep. 


Info
In the case of Zoho WorkDrive, all folders available to export to will be directly fetched from your account using which you have logged into Zoho DataPrep. Here's a snapshot above.



6. You can choose to export the file in any of the supported file formats:
CSV, TSV, JSON, XLS, XLSX, and XML formats.

7. You can also click the Advanced options link for the following options.
  • You can encode the file using character encoding methods like UTF-8 using the File encoding option.
  • Use the Compress file option to save your export as a .zip file.
  • You can use a Row Separator such as UNIX (Line Feed) or MAC (Carriage Return) to ensure the line endings are translated properly.
  • You can distinguish the point at which the content of a text field begins and ends using Text qualifiers such as Single Quote(') or Double Quote(") .
  • You can separate out the data or split using a Delimiter such as a Comma(,) , Semicolon(;) , or a Space .
  • You can also encrypt the file and protect it with a password.


8. Select the required option from the File export option drop down. You can choose to update the file with a new version at the destination, or add a new file during export. 
Notes
Note: The File export option is supported for OneDrive, Box, Dropbox, Zoho WorkDrive, SharePoint and Amazon S3.
     


9. Navigate to the folder you want to place the file in and click Save.

Notes
Note: You can also export files to your shared folders in Google Drive, DropBox, Box, OneDrive, and Zoho WorkDrive.

10. Now that you have added a destination, you may want to try executing your pipeline using a manual run at first. Once you make sure manual run works, you can then set up schedule to automate the pipeline. Learn about the different types of runs here.

Info: Each run is saved as a job. When a pipeline run is executed, the data fetched from your data sources will be prepared using the series of transforms you have applied in each of the stages, and then data will be exported to your destination. This complete process is captured in the Jobs page.


File encoding for cloud storage services

The table below covers the file export options for cloud storage services.

File formatFieldField options
CSV, TSVRow separatorUNIX (Line Feed)
MAC (Carriage Return)
Windows (Carriage return + Line feed)
Text QualifierSingle Quote (')
Double Quote (")
DelimiterComma (,)
Semicolon (;)
Space
Tab
Custom
File encodingUTF-8
IBM00858
IBM437
IBM775
IBM850
IBM852
IBM855
IBM857
IBM862
IBM866
ISO-8859-1
ISO-8859-2
ISO-8859-3
ISO-8859-4
ISO-8859-5
ISO-8859-6
ISO-8859-7
ISO-8859-8
ISO-8859-9
ISO-8859-13
ISO-8859-15
KOI8-R
KOI8-U
US-ASCII
UTF-16
UTF-16BE
UTF-16LE
UTF-32
UTF-32BE
UTF-32LE
windows-1250
windows-1251
windows-1252
windows-1253
windows-1254
windows-1255
windows-1256
windows-1257
x-IBM737
x-IBM874
x-UTF-16LE-BOM
JSONExport JSON formatEach row as valid JSON
Entire data as valid JSON
XLS, XLSX, XMLNANA

SEE ALSO
How to mark personal data column in Zoho DataPrep?