Distribute tests to cloud machines without fuss
Project description
pytest-cloudist
pytest-cloudist is a pytest plugin to that distributes your tests to AWS EC2 machines with a minimum of fuss. It is a thin wrapper around Meadowrun, which does the heavy lifting of starting EC2 instances and synchronizing environment and code.
Installation
Simply pip install alongside pytest:
python -m pip install pytest-cloudist
That makes the following command line arguments on pytest
available:
Distributed testing in the cloud using Meadowrun:
--cloudist={test,file,no}
Set mode for distributing tests to workers.
test: send each test to a worker separately.
file: send each test file to a worker separately.
(default) no: run tests inprocess, don't distribute.
--cd-tasks-per-worker-target=tasks_per_worker_target
The number of tasks to target per worker. This number determines whether individual tests or files are grouped and sent as a chunk to the test worker. Chunking is normally more efficient, but may affect load balancing and worsen the effect of stragglers.
--cd-num-workers=num_workers
Number of workers to use for distributed testing.
--cd-cpu-per-worker=logical_cpu_per_worker
The number of logical CPUs needed per worker.
--cd-memory-per-worker=memory_gb_per_worker
The amount of memory (in GiB) needed per worker.
--cd-interrupt-prob=INTERRUPTION_PROBABILITY_THRESHOLD
The estimated probability that spot instances are interrupted by AWS. Set to 0 for on-demand instances, which will be up to 10x more expensive.
--cd-extra-files=EXTRA_FILES
Extra files to copy as to the remote machines, if needed. .py files on sys.path are copied automatically.
--cd-init-command=INIT_COMMAND
Initialization command to run once per worker
Usage
By default, pytest-cloudist is not activated, i.e. your tests run locally as normal. To enable pytest-cloudist, pass either --cloudist test
or --cloudist file
with any other options.
Credits
The code and approach of pytest-cloudist, in terms of pytest integration, are heavily based on the code for pytest-xdist, and as a result it is also licensed as MIT.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pytest_cloudist-0.1.0a1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a75988a1cd39819b049856448e2a86b2df0128d85f24bd412831b4f156b5ebca |
|
MD5 | ad97d1e44fc1b748ecadd74720f3a2e4 |
|
BLAKE2b-256 | 3d389de7cff99cc7ef52d152ee9527a540b843006396e4137652062f54994e1a |