Skip to content

Multiple S3 Buckets and AWS Accounts Support #129

Open
@JustinMGaiam

Description

@JustinMGaiam

After reviewing the documentation and tests it is not clear if support for S3 bucket in different AWS accounts is a supported feature. The configuration supports multiple AWS profiles, but the AWS_PROFILE environment variable only allows for one profile.

The feature I am looking for is to be able to use multiple S3 buckets with different credentials.

-- Load data from aws bucket in aws_profile_0 account
COPY table FROM 's3://mybucket/data.parquet' WITH (format 'parquet', aws_profile=aws_profile_0);

-- Copy a query result into Parquet in S3 in aws_profile_1 account
COPY (SELECT * FROM table) TO 's3://mybucket-0/data.parquet' WITH (format 'parquet', aws_profile=aws_profile_1);

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions