Redshift Serverless

Supports:

  • ✅ Models
  • ✅ Model sync destination
  • ✅ Bulk sync source
  • ✅ Bulk sync destination

Connection

Configuration

NameTypeDescriptionRequired
bulk_sync_staging_schemastringStaging schema namefalse
connection_methodstringConnection method

Accepted values: data_api, endpoint
true
data_api_endpointstringRedshift Data API endpoint

Example: https://redshift-data.us-west-2.amazonaws.com (required if “ is “true”)
false
databasestringDatabasetrue
endpointstringRedshift Serverless endpoint

(required if “ is “endpoint”)
false
iam_role_arnstringIAM Role ARNtrue
override_endpointbooleanOverride Redshift Data API endpointfalse
regionstringRegionfalse
s3_bucket_namestringS3 bucket name (destination/unload support only)

(required if use_unload is “true”)
false
s3_bucket_regionstringS3 bucket region (destination/unload support only)

(required if use_unload is “true”)
false
use_bulk_sync_staging_schemabooleanUse custom bulk sync staging schemafalse
use_unloadbooleanRead data using Unloadfalse
workgroupstringWorkgrouptrue

Example

1{
2 "name": "Redshift Serverless connection",
3 "type": "redshiftserverless",
4 "configuration": {
5 "bulk_sync_staging_schema": "",
6 "connection_method": "data_api",
7 "data_api_endpoint": "",
8 "database": "users",
9 "endpoint": "acme.12345.us-west-2.redshift-serverless.amazonaws.com:5439",
10 "iam_role_arn": "arn:aws:iam::012345678910:role/role",
11 "override_endpoint": false,
12 "region": "us-west-2",
13 "s3_bucket_name": "my-bucket",
14 "s3_bucket_region": "us-west-2",
15 "use_bulk_sync_staging_schema": false,
16 "use_unload": false,
17 "workgroup": "default"
18 }
19}

Read-only properties

NameTypeDescriptionRequired
external_idstringExternal IDfalse

Model Sync

Source

Configuration

NameTypeDescriptionRequired
querystringfalse
schemastringSchemafalse
tablestringTablefalse
viewstringViewfalse

Example

1{
2 ...
3 "configuration": {
4 "query": "SELECT * FROM sampledata.users",
5 "schema": "sampledata",
6 "table": "users",
7 "view": "active_users"
8 }
9}

Target

Redshift Serverless connections may be used as the destination in a model sync.

All targets

Configuration
NameTypeDescriptionRequired
created_columnstring’Created at’ timestamp columnfalse
preserve_table_on_resyncbooleanPreserve destination table when resyncingfalse
updated_columnstring’Updated at’ timestamp columnfalse
write_record_timestampsbooleanWrite row timestamp metadatafalse
Example
1{
2 ...
3 "target": {
4 "configuration": {
5 "created_column": "",
6 "preserve_table_on_resync": false,
7 "updated_column": "",
8 "write_record_timestamps": false
9 }
10 }
11}

Bulk Sync

Destination

Configuration

NameTypeDescriptionRequired
advancedobjectfalse
mirror_schemasbooleanMirror schemasfalse
schemastringOutput schemafalse

Example

1{
2 ...
3 "destination_configuration": {
4 "advanced": {
5 "empty_strings_null": false,
6 "hard_deletes": false,
7 "table_prefix": "",
8 "truncate_existing": false
9 },
10 "mirror_schemas": false,
11 "schema": "schema"
12 }
13}

Type handling

Destination types

POLYTOMIC TYPEREDSHIFT SERVERLESS TYPE
array<>SUPER
bigintBIGINT
booleanBOOL
dateDATE
datetimeTIMESTAMP
decimal(precision, scale)NUMERIC(precision,scale)
doubleFLOAT8
intINTEGER
jsonSUPER
jsonarraySUPER
numberNUMERIC(38,18)
object{}SUPER
singleFLOAT4
smallintSMALLINT
stringVARCHAR(MAX)
timeVARCHAR(255)

Source types

REDSHIFT SERVERLESS TYPEPOLYTOMIC TYPE
4000json
BIGINTbigint
BOOLboolean
BOOLEANboolean
BPCHARstring
CHARstring
CHARACTERstring
CHARACTER VARYINGstring
DATEdate
DECIMALnumber
DECIMAL(precision, scale)decimal(precision, scale)
DOUBLE PRECISIONdouble
FLOATdouble
FLOAT4single
FLOAT8double
INTint
INT2smallint
INT4int
INT8bigint
INTEGERint
NCHARstring
NUMERICnumber
NUMERIC(precision, scale)decimal(precision, scale)
NVARCHARstring
REALsingle
SMALLINTsmallint
STRINGstring
TEXTstring
TIMEtime
TIME WITH TIME ZONEtime
TIME WITHOUT TIME ZONEtime
TIMESTAMPdatetime
TIMESTAMP WITH TIME ZONEdatetime_tz
TIMESTAMP WITHOUT TIME ZONEdatetime
TIMESTAMPTZdatetime_tz
TIMETZtime
VARCHARstring