Connection

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
accountstringe.g. uc193736182, ja8382948.us-central-1.gcptruefalse
usernamestringtruefalse
passwordstringfalsefalse
dbnamestringtruefalse
warehousestringfalsefalse
paramsstringAdditional connection parameters, formatted as a query stringfalsefalse
key_pair_authbooleanfalsefalse
private_keystringfalsefalse
private_key_passphrasestringfalsefalse

Example

1{
2 "name": "snowflake connection",
3 "type": "snowflake",
4 "configuration": {
5 "account": "uc193736182",
6 "dbname": "database_name",
7 "key_pair_auth": false,
8 "params": "",
9 "password": "password",
10 "private_key": "",
11 "private_key_passphrase": "",
12 "username": "user",
13 "warehouse": "warehouse"
14 }
15}

Model Sync

Source

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
querystringfalsefalse
schemastringSchemafalsefalse
tablestringTablefalsefalse
viewstringViewfalsefalse

Example

1{
2 ...
3 "configuration": {
4 "query": "SELECT * FROM sampledata.users",
5 "schema": "sampledata",
6 "table": "users",
7 "view": "active_users"
8 }
9}

Target

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
write_null_valuesbooleanCopy null valuesfalsefalse
preserve_table_on_resyncbooleanPreserve destination table when resyncingfalsefalse
write_record_timestampsbooleanWrite row timestamp metadatafalsefalse
created_columnstring’Created at’ timestamp columnfalsefalse
updated_columnstring’Updated at’ timestamp columnfalsefalse

Example

1{
2 ...
3 "target": {
4 "configuration": {
5 "created_column": "",
6 "preserve_table_on_resync": false,
7 "updated_column": "",
8 "write_null_values": false,
9 "write_record_timestamps": false
10 }
11 }
12}

Bulk Sync

Destination

Configuration

NAMETYPEDESCRIPTIONREQUIREDREADONLY
advancedobjectfalsefalse
schemastringOutput schemafalsefalse
mirror_schemasbooleanMirror schemasfalsefalse

Example

1{
2 ...
3 "destination_configuration": {
4 "advanced": {
5 "hard_deletes": false,
6 "table_prefix": "",
7 "truncate_existing": false
8 },
9 "mirror_schemas": false,
10 "schema": "schema"
11 }
12}

Type handling

Destination types

POLYTOMIC TYPESNOWFLAKE TYPE
array<>ARRAY
bigintNUMBER(38,0)
booleanBOOLEAN
dateDATE
datetimeTIMESTAMP_NTZ(9)
decimal(precision, scale)NUMBER(precision,scale)
doubleFLOAT
intNUMBER(38,0)
jsonVARIANT
jsonarrayARRAY
numberNUMBER(38,18)
object{}VARIANT
singleFLOAT
smallintNUMBER(38,0)
stringVARCHAR(16777216)
timeTIME

Source types

SNOWFLAKE TYPEPOLYTOMIC TYPE
BIGINTbigint
BYTEINTsmallint
DATEdate
DECnumber
DECIMALnumber
DOUBLEdouble
DOUBLE PRECISIONdouble
FIXEDnumber
FLOATdouble
FLOAT4double
FLOAT8double
INTint
INTEGERint
NUMBERnumber
NUMBER(precision, scale)decimal(precision, scale)
NUMERICnumber
OBJECTjson
REALdouble
SMALLINTsmallint
STRINGstring
TEXTstring
TIMEtime
TIMESTAMP_LTZdatetime
TIMESTAMP_NTZdatetime
TIMESTAMP_TZdatetime
TINYINTsmallint
VARCHARstring