Connection

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
project_idstringfalsefalse
client_emailstringfalsefalse
service_accountstringtruefalse
bucketstringtruefalse
is_single_tablebooleanTreat the files as a single table. (required if “ is “true”)falsefalse
single_table_namestring(required if is_single_table is “true”)falsefalse
single_table_file_formatstring(required if is_single_table is “true”). Accepted Values: csv, jsonfalsefalse
skip_linesintegerSkip first N lines of each CSV file.falsefalse

Example

1{
2 "name": "gcs connection",
3 "type": "gcs",
4 "configuration": {
5 "bucket": "my-bucket",
6 "client_email": "",
7 "is_single_table": false,
8 "project_id": "",
9 "service_account": "",
10 "single_table_file_format": "",
11 "single_table_name": "collection",
12 "skip_lines": 0
13 }
14}

Model Sync

Source

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
model_fromstringThe model is generated from a single file or a multi-file archive. Accepted Values: single_file, multi_file_archivetruefalse
file_formatstringFile format Accepted Values: csv, jsonfalsefalse
skip_linesintegerSkip first N lines of each CSV file.falsefalse
keystringThe key of the object in the bucket to read from.falsefalse
subfolderstringSubfolder to read files from from (optional)falsefalse

Example

1{
2 ...
3 "configuration": {
4 "file_format": "",
5 "key": "",
6 "model_from": "",
7 "skip_lines": 0,
8 "subfolder": ""
9 }
10}

Target

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
formatstringOutput file encodingfalsefalse

Example

1{
2 ...
3 "target": {
4 "configuration": {
5 "format": "csv"
6 }
7 }
8}

Bulk Sync

Destination

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
subfolderstringSubfolder to write to (optional)falsefalse
formatstringOutput file encodingfalsefalse

Example

1{
2 ...
3 "destination_configuration": {
4 "format": "csv",
5 "subfolder": "reports"
6 }
7}