Configuring your connectionsConnection configurations

Google BigQuery

Connection

Description

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
project_idstringfalsetrue
client_emailstringfalsetrue
service_accountstringtruefalse
locationstringRegion or multi-region for query operationsfalsefalse
override_project_idstringOverride service key’s project ID for cross-account accessfalsefalse
structured_values_as_jsonbooleanfalsefalse

Example

1{
2 "name": "bigquery connection",
3 "type": "bigquery",
4 "configuration": {
5 "location": "us-east1",
6 "override_project_id": "",
7 "service_account": "",
8 "structured_values_as_json": false
9 }
10}

Model Sync

Source

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
querystringfalsefalse
datasetstringDatasetfalsefalse
tablestringTablefalsefalse

Example

1{
2 ...
3 "configuration": {
4 "dataset": "nyctaxi",
5 "query": "SELECT * from sampledata.nyctaxi.taxis",
6 "table": "taxis"
7 }
8}

Target

N/A

Bulk Sync

Source

N/A

Destination

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
advancedobjectfalsefalse
mirror_schemasbooleanMirror schemasfalsefalse
datasetstringOutput datasetfalsefalse

Example

1{
2 ...
3 "destination_configuration": {
4 "advanced": {
5 "hard_deletes": false,
6 "table_prefix": "",
7 "truncate_existing": false
8 },
9 "dataset": "dataset",
10 "mirror_schemas": false
11 }
12}