A simple Amazon SQS consumer library.
Squishy is a simple Amazon SQS consumer for Python. Many versions of Python are supported, including 2.7, 3.3, 3.4, and 3.5. 2.6 should work but it is untested and unsupported.
This is currently beta software! It has a suite of tests and it’s being used for non-critical production tasks but it is still very young software.
Install from pypi: pip install squishy
- Create a virtualenv.
- Clone the repo.
- Install the requirements. If you want to use the futures workers on Python 2.7, be sure to install futures.
- Run python setup.py develop to get the squishy CLI tool.
Squishy provides a CLI to run a worker that will dispatch messages to a callback you define. The callback should accept a single parameter representing a single message consumed from an SQS queue. The message will be an instance of SQS.Message.
# my_consumer.py def my_callback(message): print('Got a message! Contents:', message.body)
Then on the command line:
$ squishy run_consumer https://sqs.us-east-1.amazonaws.com/12345/my_queue my_consumer:my_callback
Squishy uses boto3, which will automatically load credentials from $HOME/.aws/credentials. If you need more control over authentication, you can give Squishy a factory function for creating a custom session.
$ squishy --help Usage: squishy [OPTIONS] COMMAND [ARGS]... Options: --log-level [debug|info|warning|error|critical] Logging level. --botocore-log-level [debug|info|warning|error|critical] botocore logging level. --version Show the version and exit. --help Show this message and exit. Commands: run_consumer $ squishy run_consumer --help Usage: squishy run_consumer [OPTIONS] QUEUE_URL CALLBACK Options: --session-factory TEXT Factory function for a custom boto3.Session. -c, --concurrency INTEGER Worker concurrency. -m, --polling-method [long|short] Polling method. -t, --polling-timeout INTEGER Polling interval in seconds. -n, --polling-count INTEGER Number of messages to fetch when polling. -w, --worker-class [futures_process|futures_thread|gevent|mp_process|mp_thread] Worker class. --help Show this message and exit.
- The string used to import a callback now much have a colon in it, matching the behavior of setuptools. This was implied before but not required.
- The gevent worker no longer fails with an AttributeError when processing messages.
- Vastly improved test coverage.
- The consumer now dispatches an SQS.Message instance to the callback instead of dictionary.
- Fixed a bug in the multiprocessing workers where they would iterate infinitely if the callback raised an exception.
- Squishy now has unit tests!
- Fixed relative imports for modules that have the same name as a package. (Alejandro Mesa)
- Fixed missing import for gevent.monkey. (Alejandro Mesa)
- Fixed a bug with passing the message to the worker process without unpacking the dictionary. (Alejandro Mesa)
- Fixed a bug where the worker would fail to handle keyboard interrupts. (Alejandro Mesa)
- Fixed a bug with deleting keys from the results_to_message list while iterating through the list. (Alejandro Mesa)
- Switched to RST to be PyPI-friendly.
- First release.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|File Name & Hash SHA256 Hash Help||Version||File Type||Upload Date|
(14.7 kB) Copy SHA256 Hash SHA256
|py3||Wheel||Sep 24, 2016|
(10.5 kB) Copy SHA256 Hash SHA256
|–||Source||Sep 24, 2016|