Connection
Description
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
server_hostname | string | true | false | |
port | integer | true | false | |
access_token | string | true | false | |
http_path | string | true | false | |
cloud_provider | string | false | false | |
auth_mode | string | How to authenticate with AWS. Defaults to Access Key and Secret | true | false |
iam_role_arn | string | (required if AuthMode is “iam_role”) | false | false |
storage_credential_name | string | false | false | |
external_id | string | External ID for the IAM role | false | false |
aws_access_key_id | string | See https://docs.polytomic.com/docs/databricks-connections#writing-to-databricks (required if AuthMode is “aws_access_key_id”) | false | false |
aws_secret_access_key | string | (required if AuthMode is “aws_access_key_id”) | false | false |
aws_user | string | false | false | |
s3_bucket_name | string | Name of bucket used for staging data load files (required if CloudProvider is “aws”) | false | false |
s3_bucket_region | string | (required if CloudProvider is “aws”) | false | false |
azure_account_name | string | The account name of the storage account (required if CloudProvider is “azure”) | false | false |
azure_access_key | string | The access key associated with this storage account (required if CloudProvider is “azure”) | false | false |
container_name | string | The container which we will stage files in (required if CloudProvider is “azure”) | false | false |
enable_delta_uniform | boolean | false | false | |
enforce_query_limit | boolean | false | false | |
concurrent_queries | integer | false | false |
Example
Model Sync
Source
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
catalog | string | false | false | |
schema | string | false | false | |
table | string | false | false | |
query | string | false | false |
Example
Target
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
preserve_table_on_resync | boolean | Preserve destination table when resyncing | false | false |
Example
Bulk Sync
Source
N/A
Destination
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
advanced | object | false | false | |
catalog | string | false | false | |
schema | string | false | false | |
mirror_schemas | boolean | false | false | |
external_location_name | string | false | false |