Snowflake | Polytomic Docs

Supports:

✅ Models
✅ Model sync destination
✅ Bulk sync source
✅ Bulk sync destination

Connection

Configuration

Name	Type	Description	Required
`account`	`string`	Account identifier e.g. FRXJLEC-UJA94780	`required`
`dbname`	`string`	Database	`required`
`key_pair_auth`	`boolean`	Use key pair authentication ↓	`optional`
`params`	`string`	Additional parameters (optional) Additional connection parameters, formatted as a query string	`optional`
`password`	`string`	Password	`optional`
`use_bulk_sync_staging_schema`	`boolean`	Use custom bulk sync staging schema ↓	`optional`
`username`	`string`	Username	`required`
`warehouse`	`string`	Compute warehouse (optional)	`optional`

`key_pair_auth`

When key_pair_auth is true:

Name	Type	Description	Required
`private_key`	`string`	Private key	`required`
`private_key_passphrase`	`string`	Private key passphrase (optional)	`optional`

{
  "name": "Snowflake connection",
  "type": "snowflake",
  "configuration": {
    "account": "FRXJLEC-UJA94780",
    "dbname": "database_name",
    "key_pair_auth": true,
    "params": "",
    "password": "password",
    "private_key": "",
    "private_key_passphrase": "",
    "use_bulk_sync_staging_schema": false,
    "username": "user",
    "warehouse": "warehouse"
  }
}

`use_bulk_sync_staging_schema`

When use_bulk_sync_staging_schema is true:

Name	Type	Description	Required
`bulk_sync_staging_schema`	`string`	Staging schema name	`required`

{
  "name": "Snowflake connection",
  "type": "snowflake",
  "configuration": {
    "account": "FRXJLEC-UJA94780",
    "bulk_sync_staging_schema": "",
    "dbname": "database_name",
    "key_pair_auth": false,
    "params": "",
    "password": "password",
    "use_bulk_sync_staging_schema": true,
    "username": "user",
    "warehouse": "warehouse"
  }
}

Example

{
  "name": "Snowflake connection",
  "type": "snowflake",
  "configuration": {
    "account": "FRXJLEC-UJA94780",
    "dbname": "database_name",
    "key_pair_auth": false,
    "params": "",
    "password": "password",
    "use_bulk_sync_staging_schema": false,
    "username": "user",
    "warehouse": "warehouse"
  }
}

Model Sync

Source

Configuration

Name	Type	Description	Required
`query`	`string`		`optional`
`schema`	`string`	Schema	`optional`
`table`	`string`	Table	`optional`
`view`	`string`	View	`optional`

Example

{
  ...
  "configuration": {
    "query": "SELECT * FROM sampledata.users",
    "schema": "sampledata",
    "table": "users",
    "view": "active_users"
  }
}

Target

Snowflake connections may be used as the destination in a model sync.

All targets

Configuration

Name	Type	Description	Required
`created_column`	`string`	’Created at’ timestamp column	`optional`
`preserve_table_on_resync`	`boolean`	Preserve destination table when resyncing	`optional`
`updated_column`	`string`	’Updated at’ timestamp column	`optional`
`write_null_values`	`boolean`	Copy null values When enabled updates will set fields to NULL when the source value is null	`optional`
`write_record_timestamps`	`boolean`	Write row timestamp metadata	`optional`

Example

{
  ...
  "target": {
      "configuration": {
        "created_column": "",
        "preserve_table_on_resync": false,
        "updated_column": "",
        "write_null_values": false,
        "write_record_timestamps": false
    }
  }
}

Target creation

Snowflake connections may be used to create a new target for a model sync. The following parameters are required to create a new target:

NAME	DESCRIPTION	ENUM
name	Table name	false

Bulk Sync

Source

Snowflake connections may be used as a bulk sync source. No additional configuration options are required.

Destination

Configuration

Name	Type	Description	Required
`advanced`	`object`		`optional`
`mirror_schemas`	`boolean`	Mirror schemas	`optional`
`schema`	`string`	Output schema	`optional`

Example

{
  ...
  "destination_configuration": {
    "advanced": {
        "empty_strings_null": true,
        "hard_deletes": false,
        "initial_execution": "rebuild",
        "set_output_table_as_transient": false,
        "table_prefix": "",
        "truncate_existing": false
    },
    "mirror_schemas": false,
    "schema": "schema"
  }
}

Type handling

Destination types

POLYTOMIC TYPE	SNOWFLAKE TYPE
`array<>`	`ARRAY`
`bigint`	`NUMBER(38,0)`
`boolean`	`BOOLEAN`
`date`	`DATE`
`datetime`	`TIMESTAMP_NTZ(9)`
`decimal(precision, scale)`	`NUMBER(precision,scale)`
`double`	`FLOAT`
`int`	`NUMBER(38,0)`
`json`	`VARIANT`
`jsonarray`	`ARRAY`
`number`	`NUMBER(38,18)`
`object{}`	`VARIANT`
`single`	`FLOAT`
`smallint`	`NUMBER(38,0)`
`string`	`VARCHAR(134217728)`
`time`	`TIME`

Source types

SNOWFLAKE TYPE	POLYTOMIC TYPE
`BIGINT`	`bigint`
`BYTEINT`	`smallint`
`DATE`	`date`
`DEC`	`number`
`DECIMAL`	`number`
`DOUBLE`	`double`
`DOUBLE PRECISION`	`double`
`FIXED`	`number`
`FLOAT`	`double`
`FLOAT4`	`double`
`FLOAT8`	`double`
`INT`	`int`
`INTEGER`	`int`
`NUMBER`	`number`
`NUMBER(precision, scale)`	`decimal(precision, scale)`
`NUMERIC`	`number`
`OBJECT`	`json`
`REAL`	`double`
`SMALLINT`	`smallint`
`TIME`	`time`
`TIMESTAMP_LTZ`	`datetime_tz`
`TIMESTAMP_NTZ`	`datetime`
`TIMESTAMP_TZ`	`datetime_tz`
`TINYINT`	`smallint`