Google BigQuery

Supports:

• ✅ Models
• ✅ Model sync destination
• ✅ Bulk sync source
• ✅ Bulk sync destination

Connection

Configuration

use_extract

When use_extract is true

auth_method

When auth_method is workload_identity_federation

When auth_method is service_account_key|application_default_credentials

When auth_method is service_account_key

Example

1
{
2
  "name": "Google BigQuery connection",
3
  "type": "bigquery",
4
  "configuration": {
5
    "auth_method": "",
6
    "location": "us-east1",
7
    "structured_values_as_json": false,
8
    "use_extract": false
9
  }
10
}

Read-only properties

auth_method

When auth_method is service_account_key

Model Sync

Source

Configuration

Example

1
{
2
  ...
3
  "configuration": {
4
    "dataset": "nyctaxi",
5
    "query": "SELECT * from sampledata.nyctaxi.taxis",
6
    "table": "taxis"
7
  }
8
}

Target

Google BigQuery connections may be used as the destination in a model sync.

Target creation

Google BigQuery connections may be used to create a new target for a model sync. The following parameters are required to create a new target:

Bulk Sync

Source

Google BigQuery connections may be used as a bulk sync source. No additional configuration options are required.

Destination

Configuration

Example

1
{
2
  ...
3
  "destination_configuration": {
4
    "advanced": {
5
        "empty_strings_null": false,
6
        "expire_tables_after_inactivity": false,
7
        "hard_deletes": false,
8
        "table_expiry_days": 0,
9
        "table_prefix": "",
10
        "truncate_existing": false
11
    },
12
    "dataset": "dataset",
13
    "mirror_schemas": false
14
  }
15
}

Type handling

Destination types

Source types