Skip to navigation
Configuring your connectionsConnection configurations

Dropbox

Supports:

  • ✅ Models
  • ✅ Model sync destination
  • ✅ Bulk sync source
  • ✅ Bulk sync destination

Connection

Configuration

NameTypeDescriptionRequired
app_keystringoptional
app_secretstringoptional
bucketstringFolderrequired
csv_has_headersbooleanCSV files have headers

Whether CSV files have a header row with field names.		optional
is_single_tablebooleanFiles are time-based snapshots

Treat the files as a single table. ↓		optional
oauth_refresh_tokenstringoptional

is_single_table = true

NameTypeDescriptionRequired
is_directory_snapshotbooleanMulti-directory multi-table ↓optional
{
  "name": "Dropbox connection",
  "type": "dropbox",
  "configuration": {
    "app_key": "a45gadsfdsaf47byor2ugfbhsgllpf12gf56gfds",
    "app_secret": "ay8d5hdepz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq",
    "bucket": "my-folder",
    "csv_has_headers": true,
    "is_directory_snapshot": false,
    "is_single_table": true,
    "oauth_refresh_token": "dasfdasz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq",
    "single_table_file_format": "csv",
    "single_table_name": "collection",
    "skip_lines": 0
  }
}
is_directory_snapshot

When is_directory_snapshot is true:

NameTypeDescriptionRequired
directory_glob_patternstringTables glob pathrequired
{
  "name": "Dropbox connection",
  "type": "dropbox",
  "configuration": {
    "app_key": "a45gadsfdsaf47byor2ugfbhsgllpf12gf56gfds",
    "app_secret": "ay8d5hdepz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq",
    "bucket": "my-folder",
    "csv_has_headers": true,
    "directory_glob_pattern": "",
    "is_directory_snapshot": true,
    "is_single_table": true,
    "oauth_refresh_token": "dasfdasz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq",
    "single_table_file_formats": []
  }
}

is_single_table = true and is_directory_snapshot = false

NameTypeDescriptionRequired
single_table_file_formatstringFile format

Accepted values: csv ↓, json, parquet		optional
single_table_namestringCollection nameoptional
single_table_file_format

When single_table_file_format is csv or single_table_file_formats contains csv:

NameTypeDescriptionRequired
skip_linesintegerSkip first lines

Skip first N lines of each CSV file.		optional

is_single_table = true and is_directory_snapshot = true

NameTypeDescriptionRequired
single_table_file_formatsarrayFile formats that may be present across different tablesoptional

Example

{
  "name": "Dropbox connection",
  "type": "dropbox",
  "configuration": {
    "app_key": "a45gadsfdsaf47byor2ugfbhsgllpf12gf56gfds",
    "app_secret": "ay8d5hdepz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq",
    "bucket": "my-folder",
    "csv_has_headers": true,
    "is_single_table": false,
    "oauth_refresh_token": "dasfdasz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq"
  }
}

Model Sync

Source

Configuration

NameTypeDescriptionRequired
file_formatstringFile format

Accepted values: csv, json, parquet		optional
keystringObject key

The key of the object in the bucket to read from.		optional
model_fromstringFiles

The model is generated from a single file or a multi-file archive. Accepted values: single_file, multi_file_archive		required
skip_linesintegerSkip first lines

Skip first N lines of each CSV file.		optional
subfolderstringSubfolder to read files from from (optional)optional

Example

{
  ...
  "configuration": {
    "file_format": "csv",
    "key": "",
    "model_from": "single_file",
    "skip_lines": 0,
    "subfolder": ""
  }
}

Target

Dropbox connections may be used as the destination in a model sync.

All targets

Configuration
NameTypeDescriptionRequired
formatstringOutput format

Output file encoding. Accepted values: csv, json-doc, json, parquet		optional
Example
{
  ...
  "target": {
      "configuration": {
        "format": "csv"
    }
  }
}

Bulk Sync

Source

Dropbox connections may be used as a bulk sync source. No additional configuration options are required.

Destination

Configuration

NameTypeDescriptionRequired
advancedobjectoptional
formatstringOutput file encodingoptional
subfolderstringSubfolder to write to (optional)optional

Example

{
  ...
  "destination_configuration": {
    "advanced": {
        "write_incremental": false
    },
    "format": "csv",
    "subfolder": "reports"
  }
}