Redshift Serverless

Supports:

  • ✅ Models
  • ✅ Model sync destination
  • ✅ Bulk sync source
  • ✅ Bulk sync destination

Connection

Configuration

NameTypeDescriptionRequired
connection_methodstringConnection method

Accepted values: data_api , endpoint
true
databasestringDatabasetrue
iam_role_arnstringIAM Role ARNtrue
regionstringRegionfalse
s3_bucket_namestringS3 bucket name (destination/unload support only)

(required if use_unload is “true”)
false
s3_bucket_regionstringS3 bucket region (destination/unload support only)

(required if use_unload is “true”)
false
use_bulk_sync_staging_schemabooleanUse custom bulk sync staging schema false
use_unloadbooleanRead data using Unloadfalse
workgroupstringWorkgrouptrue

use_bulk_sync_staging_schema

When use_bulk_sync_staging_schema is true
NameTypeDescriptionRequired
bulk_sync_staging_schemastringStaging schema namefalse

connection_method

When connection_method is endpoint
NameTypeDescriptionRequired
endpointstringRedshift Serverless endpointfalse
When connection_method is data_api
NameTypeDescriptionRequired
override_endpointbooleanOverride Redshift Data API endpointfalse

override_endpoint

When override_endpoint is true
NameTypeDescriptionRequired
data_api_endpointstringRedshift Data API endpoint

Example: https://redshift-data.us-west-2.amazonaws.com
false

Example

1{
2 "name": "Redshift Serverless connection",
3 "type": "redshiftserverless",
4 "configuration": {
5 "connection_method": "data_api",
6 "database": "users",
7 "iam_role_arn": "arn:aws:iam::012345678910:role/role",
8 "override_endpoint": false,
9 "region": "us-west-2",
10 "s3_bucket_name": "my-bucket",
11 "s3_bucket_region": "us-west-2",
12 "use_bulk_sync_staging_schema": false,
13 "use_unload": false,
14 "workgroup": "default"
15 }
16}

Read-only properties

NameTypeDescriptionRequired
external_idstringExternal IDfalse

Model Sync

Source

Configuration

NameTypeDescriptionRequired
querystringfalse
schemastringSchemafalse
tablestringTablefalse
viewstringViewfalse

Example

1{
2 ...
3 "configuration": {
4 "query": "SELECT * FROM sampledata.users",
5 "schema": "sampledata",
6 "table": "users",
7 "view": "active_users"
8 }
9}

Target

Redshift Serverless connections may be used as the destination in a model sync.

All targets

Configuration
NameTypeDescriptionRequired
created_columnstring’Created at’ timestamp columnfalse
preserve_table_on_resyncbooleanPreserve destination table when resyncingfalse
updated_columnstring’Updated at’ timestamp columnfalse
write_record_timestampsbooleanWrite row timestamp metadatafalse
Example
1{
2 ...
3 "target": {
4 "configuration": {
5 "created_column": "",
6 "preserve_table_on_resync": false,
7 "updated_column": "",
8 "write_record_timestamps": false
9 }
10 }
11}

Bulk Sync

Destination

Configuration

NameTypeDescriptionRequired
advancedobjectfalse
mirror_schemasbooleanMirror schemasfalse
schemastringOutput schemafalse

Example

1{
2 ...
3 "destination_configuration": {
4 "advanced": {
5 "empty_strings_null": false,
6 "hard_deletes": false,
7 "table_prefix": "",
8 "truncate_existing": false
9 },
10 "mirror_schemas": false,
11 "schema": "schema"
12 }
13}

Type handling

Destination types

POLYTOMIC TYPEREDSHIFT SERVERLESS TYPE
array<>SUPER
bigintBIGINT
booleanBOOL
dateDATE
datetimeTIMESTAMP
decimal(precision, scale)NUMERIC(precision,scale)
doubleFLOAT8
intINTEGER
jsonSUPER
jsonarraySUPER
numberNUMERIC(38,18)
object{}SUPER
singleFLOAT4
smallintSMALLINT
stringVARCHAR(MAX)
timeVARCHAR(255)

Source types

REDSHIFT SERVERLESS TYPEPOLYTOMIC TYPE
4000json
BIGINTbigint
BOOLboolean
BOOLEANboolean
BPCHARstring
CHARstring
CHARACTERstring
CHARACTER VARYINGstring
DATEdate
DECIMALnumber
DECIMAL(precision, scale)decimal(precision, scale)
DOUBLE PRECISIONdouble
FLOATdouble
FLOAT4single
FLOAT8double
INTint
INT2smallint
INT4int
INT8bigint
INTEGERint
NCHARstring
NUMERICnumber
NUMERIC(precision, scale)decimal(precision, scale)
NVARCHARstring
REALsingle
SMALLINTsmallint
STRINGstring
TEXTstring
TIMEtime
TIME WITH TIME ZONEtime
TIME WITHOUT TIME ZONEtime
TIMESTAMPdatetime
TIMESTAMP WITH TIME ZONEdatetime_tz
TIMESTAMP WITHOUT TIME ZONEdatetime
TIMESTAMPTZdatetime_tz
TIMETZtime
VARCHARstring