AWS SQS extended client functionality from amazon-sqs-java-extended-client-lib
Project description
sqs-extended-client
Implements the functionality of amazon-sqs-java-extended-client-lib in Python
Installation
pip install sqs-extended-client
Overview
sqs-extended-client allows for sending large messages through SQS via S3. This is the same mechanism that the Amazon library amazon-sqs-java-extended-client-lib provides. This library is interoperable with that library.
To do this, this library automatically extends the normal boto3 SQS client and Queue resource classes upon import using the botoinator library. This allows for further extension or decoration if desired.
Additional attributes available on boto3
SQS client
and Queue
objects
- large_payload_support -- the S3 bucket name that will store large messages.
- message_size_threshold -- the threshold for storing the message in the large messages bucket. Cannot be less than
0
or greater than262144
. Defaults to262144
. - always_through_s3 -- if
True
, then all messages will be serialized to S3. Defaults toFalse
- s3 -- the boto3 S3
resource
object to use to store objects to S3. Use this if you want to control the S3 resource (for example, custom S3 config or credentials). Defaults toboto3.resource("s3")
on first use if not previously set.
Usage
Note:
The s3 bucket must already exist prior to usage, and be accessible by whatever credentials you have available
Enabling support for large payloads (>256Kb)
import boto3
import sqs_extended_client
# Low level client
sqs = boto3.client('sqs')
sqs.large_payload_support = 'my-bucket-name'
# boto resource
resource = boto3.resource('sqs')
queue = resource.Queue('queue-url')
# Or
queue = resource.create_queue(QueueName='queue-name')
queue.large_payload_support = 'my-bucket-name'
Enabling support for large payloads (>64K)
import boto3
import sqs_extended_client
# Low level client
sqs = boto3.client('sqs')
sqs.large_payload_support = 'my-bucket-name'
sqs.message_size_threshold = 65536
# boto resource
resource = boto3.resource('sqs')
queue = resource.Queue('queue-url')
# Or
queue = resource.create_queue(QueueName='queue-name')
queue.large_payload_support = 'my-bucket-name'
queue.message_size_threshold = 65536
Enabling support for large payloads for all messages
import boto3
import sqs_extended_client
# Low level client
sqs = boto3.client('sqs')
sqs.large_payload_support = 'my-bucket-name'
sqs.always_through_s3 = True
# boto resource
resource = boto3.resource('sqs')
queue = resource.Queue('queue-url')
# Or
queue = resource.create_queue(QueueName='queue-name')
queue.large_payload_support = 'my-bucket-name'
queue.always_through_s3 = True
Setting a custom S3 resource
import boto3
from botocore.config import Config
import sqs_extended_client
# Low level client
sqs = boto3.client('sqs')
sqs.large_payload_support = 'my-bucket-name'
sqs.s3 = boto3.resource(
's3',
config=Config(
signature_version='s3v4',
s3={
"use_accelerate_endpoint": True
}
)
)
# boto resource
resource = boto3.resource('sqs')
queue = resource.Queue('queue-url')
# Or
queue = resource.create_queue(QueueName='queue-name')
queue.large_payload_support = 'my-bucket-name'
queue.s3 = boto3.resource(
's3',
config=Config(
signature_version='s3v4',
s3={
"use_accelerate_endpoint": True
}
)
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file sqs-extended-client-0.0.11.tar.gz
.
File metadata
- Download URL: sqs-extended-client-0.0.11.tar.gz
- Upload date:
- Size: 10.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d4af8b405776cdf134afd065950e7f3d3a752aec7c9fe3f0dddc33ab1e99f698 |
|
MD5 | 44bd7a1ae5fe103caaa312e45f7ed391 |
|
BLAKE2b-256 | 632a2909a7e02920b619136f5acf3d036fe7d54bcbbe18bfacda141c4e74e005 |
File details
Details for the file sqs_extended_client-0.0.11-py3-none-any.whl
.
File metadata
- Download URL: sqs_extended_client-0.0.11-py3-none-any.whl
- Upload date:
- Size: 10.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5197848f7f38fd7f75dc0d76fe1b4a020be4b5b0c02a1aea20484dfca075475d |
|
MD5 | a2bc088a03453087919931b3383dea3b |
|
BLAKE2b-256 | de49c056bfb05b65aaeb94d18e8b5ed15b35a274fb46c39e1375f13e8093805a |