Export data as files
You can export your data in various file formats which includes CSV, TSV, JSON, XLS, XLSX and XML formats.
To export data as files
1. Open an existing pipeline or create a pipeline from the Home Page, Pipelines tab or Workspaces tab. You can bring your data from 50+sources.
2. On the Pipeline Builder page, once you have completed creating your data flow and applying the necessary transforms in your stages, you can right-click a stage and select the Add Destination option.
2. Select the Files category and the required destination in the side pane.
3. If your data contain columns with personal data or ePHI data, you can choose to include or exclude them in the Columns section.
You can also apply the necessary security methods to protect your personal data or ePHI data column:
A. Data masking
Data masking hides original data with 'x' to protect personal information.
B. Data Tokenization
Data tokenization replaces each distinct value in your data with a random value. Hence the output is statistically identical to the original data.
C. None
You can select none if you do not want to use any security method. You can choose whether to export these column using the corresponding check boxes.
Note:
- Exporting datasets without securing personal data will be restricted if Secure data exports option is enabled in your organization's privacy settings. Click here to know more.
- Based on the Compliance settings of your organization, exporting datasets with ePHI data may be restricted or restricted without securing ePHI data with security measures or password protection.
4. Click Next and do the following as required.
- You can choose to save the exported data as a local file in any of the supported file formats: CSV, TSV, JSON, XLS, XLSX and XML formats.
- Use the Compress file option to save your export as a .zip file.
- You can encode the file using character encoding methods like UTF-8.
- You can also encrypt the file and protect it with a password.
5. Once you input the required values, click Save.
6. Now that you have added a destination, you may want to try executing your pipeline using a manual run at first. Once you make sure manual run works, you can then set up schedule to automate the pipeline. Learn about the different types of runs here
Info: Each run is saved as a job. When a pipeline run is executed, the data fetched from your data sources will be prepared using the series of transforms you have applied in each of the stages, and then data will be exported to your destination. This complete process is captured in the Jobs page.
File export options
The table below covers the different options available while exporting your prepared data as a file.
SEE ALSO