To import data using Advanced selection,

1. Click the Advanced selection link.

Advanced selection helps you perform dynamic file selection based on regex. This can be used for getting new or incremental data from your SharePoint site. The newly added or modified file that matches the file pattern during a specific data interval will be taken from your SharePoint site. Click here to know more about incremental fetch.

Important: Advanced selection is used not only for incremental fetch. You can also use this option for bulk import of files based on the file pattern. 

Note : Supported formats are CSV, TSV, JSON, XML, TXT , XLS, and XLSX. You can also import files in zipped format.

2. Provide the below details:

• Choose site : Choose the site you want to import data from.

• Choose drive : Choose the drive in your site from where you want to import data.

• Folder path : The folder path where you want to search for files. Eg. 2023/
  
  
  If the files are stored in the site without any folder, you can leave this field empty.
  
  
  

  The "Folder Path" is a directory path field and does not support regex patterns.

• Include subfolders : You can also select the Include subfolders checkbox if you want to include subfolders while searching for a file.
  

• File pattern : The pattern used to match the file names in the site. This supports regex type matching. You can also use the pattern, ".*" to match any file in the path specified.
  Info: File pattern is case-sensitive.

• File password : Enter the password if the file is password protected.

• Merge files and import - This will merge all the files that match the pattern specified and import them as a single dataset.
  Important: You can use this option to merge files together during the import itself, without having to perform unions post import.
  

  Info: This option can merge a maximum of only 5 files at a time.

  Note: If this checkbox is unchecked then, only 1 file will be fetched at a time.

  
  Eg. If your SharePoint account has 10 files, the first 5 will be merged into one dataset and imported. During the next reload, the remaining 5 files will be merged and imported.
  
  Similarly, if your SharePoint account has 8 files, the first 5 will be merged and fetched first, followed by the next 3.

• File type : Choose the required file format. The available formats are CSV, TSV, JSON, XLS, XLSX, XML, and TXT.
• Sheet pattern : This option is available for the XLS and XLSX formats only. The pattern used to match the sheet names in the file. This supports regex type matching. You can also use the pattern ".*" to match any sheet in the file.

  
  

  

  The sheet pattern match is also a simple regex-based match. For example, to fetch sheets with names such as Sales_2022, Sales_2023, Sales_2024, you can input the pattern Sales_.*
  

  
  

  Similarly, to fetch sheets such as PublicData1, PublicData2, PublicData3, use Public.*

  
  

  If you want to import a single sheet, then specify the pattern using the exact sheet name.

  Eg: Leads_Jan_2022.*
  

  
  
• 
  Info: Sheet pattern is case-sensitive.
  
  
• Sheet password : This option is available for XLS and XLSX formats only. Enter the password if the sheet is password protected.
  
• Merge sheets and import : This will merge all the sheets that match the pattern specified and import them as a single dataset.

You can use this option to merge sheets together during the import itself, without having to perform unions post import.

Note: If this checkbox is unchecked then, only 1 sheet will be fetched at a time.