Export data to cloud storage services
You can export data to the following cloud storage services.
- Google Drive
- OneDrive
- Box Storage
- Dropbox
- Zoho WorkDrive
- Amazon S3
To export data to cloud storage services
1.
Open an existing pipeline or create a pipeline from the Home Page, Pipelines tab or Workspaces tab. You can bring your data from 50+sources.
2. On the
Pipeline Builder page, once you have completed creating your data flow and applying the necessary
transforms in your stages, you can right-click a stage and select the
Add Destination option.
3. You can type in the destination name in the search box or choose the Cloud storage category and the required export option. For instance, click Google Drive.
4. If your data contains columns with personal data or ePHI data, you can choose to include or exclude them in the Columns section. You can also apply the required security methods to protect your data as follows.
A. Data masking
Data masking hides original data with 'x' to protect personal information.
B. Data Tokenization
Data tokenization replaces each distinct value in your data with a random value. Hence the output is statistically identical to the original data.
C. None
You can select none if you do not want to use any security method. You can choose whether to export these column using the corresponding check boxes.
Note:
- Exporting datasets without securing personal data will be restricted if Secure data exports option is enabled in your organization's privacy settings. Click here to know more.
- Based on the Compliance settings of your organization, exporting datasets with ePHI data may be restricted or restricted without securing ePHI data with security measures or password protection.
5. Select an account from the saved connections or connect a new account using the Add new option. Authenticate your Google account.
Authentication is required only the first time the service is used with DataPrep.
In the case of Zoho WorkDrive, all folders available to export to will be directly fetched from your account using which you have logged into Zoho DataPrep. Here's a snapshot above.
6. You can choose to export the file in any of the supported file formats:
CSV, TSV, JSON, XLS, XLSX, and XML formats.
7. You can also click the Advanced options link for the following options.
-
You can encode the file using character encoding methods like UTF-8 using the File encoding option.
-
Use the Compress file option to save your export as a .zip file.
-
You can use a Row Separator such as UNIX (Line Feed) or MAC (Carriage Return) to ensure the line endings are translated properly.
-
You can distinguish the point at which the content of a text field begins and ends using Text qualifiers such as Single Quote(') or Double Quote(") .
-
You can separate out the data or split using a Delimiter such as a Comma(,) , Semicolon(;) , or a Space .
-
You can also encrypt the file and protect it with a password.
8. Select the required option from the File export option drop down. You can choose to update the file with a new version at the destination, or add a new file during export.
Note: The File export option is supported for OneDrive, Box, Dropbox, Zoho WorkDrive, SharePoint and Amazon S3.
9. Navigate to the folder you want to place the file in and click Save.
Note: You can also export files to your shared folders in Google Drive, DropBox, Box, OneDrive, and Zoho WorkDrive.
10. Now that you have added a destination, you may want to try executing your pipeline using a manual run at first. Once you make sure manual run works, you can then set up schedule to automate the pipeline. Learn about the different types of runs
here.
Info: Each run is saved as a job. When a pipeline run is executed, the data fetched from your data sources will be prepared using the series of transforms you have applied in each of the stages, and then data will be exported to your destination. This complete process is captured in the
Jobs page.
File encoding for cloud storage services
The table below covers the file export options for cloud storage services.
| File format | Field | Field options |
| CSV, TSV | Row separator | UNIX (Line Feed) |
| MAC (Carriage Return) |
| Windows (Carriage return + Line feed) |
| Text Qualifier | Single Quote (') |
| Double Quote (") |
| Delimiter | Comma (,) |
| Semicolon (;) |
| Space |
| Tab |
| Custom |
| File encoding | UTF-8 |
| IBM00858 |
| IBM437 |
| IBM775 |
| IBM850 |
| IBM852 |
| IBM855 |
| IBM857 |
| IBM862 |
| IBM866 |
| ISO-8859-1 |
| ISO-8859-2 |
| ISO-8859-3 |
| ISO-8859-4 |
| ISO-8859-5 |
| ISO-8859-6 |
| ISO-8859-7 |
| ISO-8859-8 |
| ISO-8859-9 |
| ISO-8859-13 |
| ISO-8859-15 |
| KOI8-R |
| KOI8-U |
| US-ASCII |
| UTF-16 |
| UTF-16BE |
| UTF-16LE |
| UTF-32 |
| UTF-32BE |
| UTF-32LE |
| windows-1250 |
| windows-1251 |
| windows-1252 |
| windows-1253 |
| windows-1254 |
| windows-1255 |
| windows-1256 |
| windows-1257 |
| x-IBM737 |
| x-IBM874 |
| x-UTF-16LE-BOM |
| JSON | Export JSON format | Each row as valid JSON |
| Entire data as valid JSON |
| XLS, XLSX, XML | NA | NA |
SEE ALSO