S3 Export

Upload data to S3-compatible storage services.

Properties

NameType
engineString=s3:write
credentialsObject
bucketString
regionString
pathString
endpointString
use_sslBoolean
encoderString

engine

Must be s3:write.

Required
Yes

credentials

The AWS credentials.

Required
Yes

Properties

NameType
access_key_idString
secret_access_keyString

credentials.access_key_id

Access key ID to authenticate with.

Required
Yes

credentials.secret_access_key

Secret access key to authenticate with.

Required
Yes

bucket

Bucket name to store file in. Creates the bucket if it doesn’t exist.

Required
Yes

region

The region of the S3 bucket.

Required
Yes
Default
us-east-1

path

The path at which to create the file on S3. If the file already exists it will be overwritten.

Required
Yes

endpoint

Defaults to s3.amazonaws.com.

Required
No
Default
s3.amazonaws.com

use_ssl

Defaults to true.

Required
No
Default
true

encoder

The format of the data.

Required
Yes
Enum
csv json ndjson msgpack parquet