Azure Blob Storage
Connection
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
account_name | string | true | false | |
access_key | string | true | false | |
container_name | string | true | false | |
is_single_table | boolean | Treat the files as a single table. (required if “ is “true”) | false | false |
single_table_name | string | (required if is_single_table is “true”) | false | false |
single_table_file_format | string | (required if is_single_table is “true”). Accepted Values: csv, json | false | false |
skip_lines | integer | Skip first N lines of each CSV file. | false | false |
Example
1 { 2 "name": "azureblob connection", 3 "type": "azureblob", 4 "configuration": { 5 "access_key": "abcdefghijklmnopqrstuvwxyz0123456789/+ABCDEabcdefghijklmnopqrstuvwxyz0123456789/+ABCDE==", 6 "account_name": "account", 7 "container_name": "container", 8 "is_single_table": false, 9 "single_table_file_format": "csv", 10 "single_table_name": "collection", 11 "skip_lines": 0 12 } 13 }
Model Sync
Source
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
model_from | string | The model is generated from a single file or a multi-file archive. Accepted Values: single_file, multi_file_archive | true | false |
file_format | string | File format Accepted Values: csv, json | false | false |
skip_lines | integer | Skip first N lines of each CSV file. | false | false |
key | string | The key of the object in the bucket to read from. | false | false |
subfolder | string | Subfolder to read files from from (optional) | false | false |
Example
1 { 2 ... 3 "configuration": { 4 "file_format": "", 5 "key": "", 6 "model_from": "", 7 "skip_lines": 0, 8 "subfolder": "" 9 } 10 }
Target
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
format | string | Output file encoding | false | false |
Example
1 { 2 ... 3 "target": { 4 "configuration": { 5 "format": "csv" 6 } 7 } 8 }
Bulk Sync
Destination
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
format | string | Output file encoding | false | false |
subfolder | string | Subfolder to write to (optional) | false | false |
Example
1 { 2 ... 3 "destination_configuration": { 4 "format": "csv", 5 "subfolder": "reports" 6 } 7 }