Azure Blob Storage | Polytomic Docs

Supports:

✅ Models
✅ Model sync destination
✅ Bulk sync source
✅ Bulk sync destination

Connection

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
auth_method	string	Accepted values: `access_key`, `client_credentials`, `oauth`	true	false
access_key	string	(required if `auth_method` is “access_key”)	false	false
tenant_id	string	(required if `auth_method` is “client_credentials”)	false	false
client_id	string	(required if `auth_method` is “client_credentials”)	false	false
client_secret	string	(required if `auth_method` is “client_credentials”)	false	false
oauth_refresh_token	string		false	false
container_name	string		true	false
account_name	string		true	false
is_single_table	boolean	Treat the files as a single table.	false	false
is_directory_snapshot	boolean		false	false
directory_glob_pattern	string		false	false
single_table_name	string		false	false
single_table_file_format	string	Accepted values: `csv`, `json`, `parquet`	false	false
skip_lines	integer	Skip first N lines of each CSV file.	false	false

Example

1 {
2   "name": "Azure Blob Storage connection",
3   "type": "azureblob",
4   "configuration": {
5     "access_key": "abcdefghijklmnopqrstuvwxyz0123456789/+ABCDEabcdefghijklmnopqrstuvwxyz0123456789/+ABCDE==",
6     "account_name": "account",
7     "auth_method": "",
8     "client_id": "",
9     "client_secret": "",
10     "container_name": "container",
11     "directory_glob_pattern": "",
12     "is_directory_snapshot": false,
13     "is_single_table": false,
14     "oauth_refresh_token": "dasfdasz62px8lqeoakuea2ccl4rxm13i6tbyorxhu1i20kc8ruvksmzxq",
15     "single_table_file_format": "csv",
16     "single_table_name": "collection",
17     "skip_lines": 0,
18     "tenant_id": ""
19   }
20 }

Model Sync

Source

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
model_from	string	The model is generated from a single file or a multi-file archive. Accepted values: `single_file`, `multi_file_archive`	true	false
file_format	string	File format. Accepted values: `csv`, `json`, `parquet`	false	false
skip_lines	integer	Skip first N lines of each CSV file.	false	false
key	string	The key of the object in the bucket to read from.	false	false
subfolder	string	Subfolder to read files from from (optional)	false	false

Example

1 {
2   ...
3   "configuration": {
4     "file_format": "",
5     "key": "",
6     "model_from": "",
7     "skip_lines": 0,
8     "subfolder": ""
9   }
10 }

Target

Azure Blob Storage connections may be used as the destination in a model sync.

All targets

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
format	string	Output file encoding. Accepted values: `csv`, `json-doc`, `json`, `parquet`	false	false

Example

1 {
2   ...
3   "target": {
4       "configuration": {
5         "format": "csv"
6     }
7   }
8 }

Bulk Sync

Destination

Configuration

NAME	TYPE	DESCRIPTION	REQUIRED	READONLY
subfolder	string	Subfolder to write to (optional)	false	false
format	string	Output file encoding	false	false

Example

1 {
2   ...
3   "destination_configuration": {
4     "format": "csv",
5     "subfolder": "reports"
6   }
7 }