Configuring your connectionsConnection configurations
AWS Athena
Connection
Description
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
access_id | string | true | false | |
secret_access_key | string | true | false | |
aws_user | string | false | true | |
region | string | true | false | |
outputbucket | string | A pre-existing bucket (folder optional) that AWS can use to store query results. ex: s3://polytomic-athena-results/customer-dataset | true | false |
Example
1 { 2 "name": "awsathena connection", 3 "type": "awsathena", 4 "configuration": { 5 "access_id": "AKIAIOSFODNN7EXAMPLE", 6 "outputbucket": "s3://polytomic-athena-results/customer-dataset", 7 "region": "us-east-1", 8 "secret_access_key": "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" 9 } 10 }
Model Sync
Source
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
query | string | false | false | |
catalog | string | Catalog | false | false |
database | string | Database | false | false |
table | string | Table | false | false |
Example
1 { 2 ... 3 "configuration": { 4 "catalog": "awsdatacatalog", 5 "database": "default", 6 "query": "SELECT * FROM \"webdata\".\"impressions\"", 7 "table": "users" 8 } 9 }
Target
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
preserve_table_on_resync | boolean | Preserve destination table when resyncing | false | false |
Example
1 { 2 ... 3 "target": { 4 "configuration": { 5 "preserve_table_on_resync": false 6 } 7 } 8 }
Bulk Sync
Destination
Configuration
NAME | TYPE | DESCRIPTION | REQUIRED | READONLY |
---|---|---|---|---|
advanced | object | false | false | |
schema | string | Output schema to write to | false | false |
mirror_schemas | boolean | Indicates whether schemas should be mirrored | false | false |
Example
1 { 2 ... 3 "destination_configuration": { 4 "advanced": { 5 "table_prefix": "", 6 "truncate_existing": false 7 }, 8 "mirror_schemas": false, 9 "schema": "public" 10 } 11 }