Connection

Description

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
project_id	string		false	false
client_email	string		false	false
service_account	string		true	false
bucket	string		true	false
is_single_table	boolean	Treat the files as a single table. (required if `is_single_table` is “true”)	false	false
single_table_name	string	(required if `IsSingleTable` is “true”)	false	false
single_table_file_format	string	(required if `IsSingleTable` is “true”)	false	false
skip_lines	integer	Skip first N lines of each CSV file.	false	false

Example

1 {
2   "name": "gcs connection",
3   "type": "gcs",
4   "configuration": {
5     "bucket": "my-bucket",
6     "client_email": "",
7     "is_single_table": false,
8     "project_id": "",
9     "service_account": "",
10     "single_table_file_format": "",
11     "single_table_name": "collection",
12     "skip_lines": 0
13   }
14 }

Model Sync

Source

N/A

Target

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
format	string	Output file encoding	false	false

Example

1 {
2   ...
3   "target": {
4       "configuration": {
5         "format": "csv"
6     }
7   }
8 }

Bulk Sync

Source

N/A

Destination

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
format	string	Output file encoding	false	false
subfolder	string	Subfolder to write to (optional)	false	false

Example

1 {
2   ...
3   "destination_configuration": {
4     "format": "csv",
5     "subfolder": "reports"
6   }
7 }

Getting started

Configuring your connections

Code examples

Google Cloud Storage

Connection

Description

Configuration

Example

Model Sync

Source

Target

Configuration

Example

Bulk Sync

Source

Destination

Configuration

Example

1	{
2	"name": "gcs connection",
3	"type": "gcs",
4	"configuration": {
5	"bucket": "my-bucket",
6	"client_email": "",
7	"is_single_table": false,
8	"project_id": "",
9	"service_account": "",
10	"single_table_file_format": "",
11	"single_table_name": "collection",
12	"skip_lines": 0
13	}
14	}

1	{
2	...
3	"destination_configuration": {
4	"format": "csv",
5	"subfolder": "reports"
6	}
7	}