Ceph Multi-Tenancy support

[Hoeze]

Hi, how do I use boto3 with multi-tenancy on Ceph S3?
The following fails:

import boto3
from botocore.config import Config

# Define the custom configuration to use path-style addressing
config = Config(
    s3={
        'addressing_style': 'path'  # Force path-style addressing
    }
)

# Create the S3 client with the endpoint URL for Ceph
s3_client = boto3.client(
    's3',
    aws_access_key_id="TESTER",
    aws_secret_access_key="test123",
    endpoint_url="http://ep.host.dom/",  # Replace with your Ceph endpoint
    config=config
)

# Specify the bucket name including the tenant
bucket_name = "tenant:bucketname"

# Example: List objects in the bucket
response = s3_client.list_objects_v2(Bucket=bucket_name)

# Print the objects in the bucket
for obj in response.get('Contents', []):
    print(obj['Key'])

with the following error:

raise ParamValidationError(report=error_msg)
botocore.exceptions.ParamValidationError: Parameter validation failed:
Invalid bucket name "s3://tenant:bucket": Bucket name must match the regex "^[a-zA-Z0-9.\-_]{1,255}$" or be an ARN matching the regex "^arn:(aws).*:(s3|s3-object-lambda):[a-z\-0-9]+:[0-9]{12}:accesspoint[/:][a-zA-Z0-9\-]{1,63}$|^arn:(aws).*:s3-outposts:[a-z\-0-9]+:[0-9]{12}:outpost[/:][a-zA-Z0-9\-]{1,63}[/:]accesspoint[/:][a-zA-Z0-9\-]{1,63}$"

Link to the ceph docs:
https://docs.ceph.com/en/latest/radosgw/multitenancy/

[poquirion]

Here is a workaround so you can use the library anyway.

In your script where you load boto explicitely add colon : as a valid char in the VALID_BUCKET regex, you might also want to add more than 255 chars, which I am not doing here.

import boto3
from botocore.config import Config
import botocore.handlers
import re
botocore.handlers.VALID_BUCKET = re.compile(r'^[:a-zA-Z0-9.\-_]{1,255}$')

[...]
# Specify the bucket name including the tenant
bucket_name = "tenant:bucketname"

# Example: List objects in the bucket
response = s3_client.list_objects_v2(Bucket=bucket_name)
[...]