Connection

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
hostnamestringtruefalse
usernamestringtruefalse
passwordstringtruefalse
databasestringtruefalse
portintegertruefalse
sshbooleanfalsefalse
ssh_userstringfalsefalse
ssh_hoststringfalsefalse
ssh_portintegerfalsefalse
ssh_private_keystringfalsefalse
aws_access_key_idstringAccess Key ID with read/write access to a bucket. More info: https://docs.polytomic.com/docs/redshiftfalsefalse
aws_secret_access_keystringfalsefalse
aws_userstringfalsetrue
s3_bucket_namestringName of bucket used for staging data load filesfalsefalse
s3_bucket_regionstringRegion of bucket. Note: must match region of redshift serverfalsefalse

Example

1{
2 "name": "redshift connection",
3 "type": "redshift",
4 "configuration": {
5 "aws_access_key_id": "AKIAIOSFODNN7EXAMPLE",
6 "aws_secret_access_key": "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY",
7 "database": "mydb",
8 "hostname": "mycluster.us-west-2.redshift.amazonaws.com",
9 "password": "password",
10 "port": 5439,
11 "s3_bucket_name": "my-bucket",
12 "s3_bucket_region": "us-west-2",
13 "ssh": false,
14 "ssh_host": "bastion.example.com",
15 "ssh_port": 22,
16 "ssh_private_key": "",
17 "ssh_user": "",
18 "username": "redshift_user"
19 }
20}

Model Sync

Source

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
querystringfalsefalse
schemastringSchemafalsefalse
tablestringTablefalsefalse
viewstringViewfalsefalse

Example

1{
2 ...
3 "configuration": {
4 "query": "SELECT * FROM sampledata.users",
5 "schema": "sampledata",
6 "table": "users",
7 "view": "active_users"
8 }
9}

Target

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
preserve_table_on_resyncbooleanPreserve destination table when resyncingfalsefalse
write_record_timestampsbooleanWrite row timestamp metadatafalsefalse
created_columnstring’Created at’ timestamp columnfalsefalse
updated_columnstring’Updated at’ timestamp columnfalsefalse

Example

1{
2 ...
3 "target": {
4 "configuration": {
5 "created_column": "",
6 "preserve_table_on_resync": false,
7 "updated_column": "",
8 "write_record_timestamps": false
9 }
10 }
11}

Bulk Sync

Destination

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
advancedobjectfalsefalse
schemastringOutput schemafalsefalse
mirror_schemasbooleanMirror schemasfalsefalse

Example

1{
2 ...
3 "destination_configuration": {
4 "advanced": {
5 "hard_deletes": false,
6 "table_prefix": "",
7 "truncate_existing": false
8 },
9 "mirror_schemas": false,
10 "schema": "schema"
11 }
12}

Type handling

Destination types

POLYTOMIC TYPEREDSHIFT TYPE
array<>SUPER
bigintBIGINT
booleanBOOL
dateDATE
datetimeTIMESTAMP
decimal(precision, scale)NUMERIC(precision,scale)
doubleFLOAT8
intINTEGER
jsonSUPER
jsonarraySUPER
numberNUMERIC(38,18)
object{}SUPER
singleFLOAT4
smallintSMALLINT
stringVARCHAR(MAX)
timeTIME

Source types

REDSHIFT TYPEPOLYTOMIC TYPE
4000json
BIGINTbigint
BOOLboolean
BOOLEANboolean
BPCHARstring
CHARstring
CHARACTERstring
CHARACTER VARYINGstring
DATEdate
DECIMALnumber
DECIMAL(precision, scale)decimal(precision, scale)
DOUBLE PRECISIONdouble
FLOATdouble
FLOAT4single
FLOAT8double
INTint
INT2smallint
INT4int
INT8bigint
INTEGERint
NCHARstring
NUMERICnumber
NUMERIC(precision, scale)decimal(precision, scale)
NVARCHARstring
REALsingle
SMALLINTsmallint
TEXTstring
TIMEtime
TIME WITH TIME ZONEtime
TIME WITHOUT TIME ZONEtime
TIMESTAMPdatetime
TIMESTAMP WITH TIME ZONEdatetime
TIMESTAMP WITHOUT TIME ZONEdatetime
TIMESTAMPTZdatetime
TIMETZtime
VARCHARstring