Enables running Python functions as standalone jobs based on interaction with valiot-jobs API
Project description
python-gql-worker
Enables running Python functions as standalone jobs based on interaction with valiot-jobs API
installation
pipenv install valiotworker
Deployment:
python setup.py sdist bdist_wheel && python -m twine upload dist/* --skip-existing # UPLOAD TO PYPI
API < v0.4.0
Job footprint:
@valiotWorker.job(...)
def my_job(job_id, update_job, kwargs)
...
Parameters:
- job_id: Number representing the Identifier for this job
- update_job: function to update status of current job (FINISHED, ERROR, etc)
- kwargs: dictionary aliasing the custom params (from job's "input" attribute, for retrocompatibility)
API >= v0.5.0
@valiotWorker.job(...)
def my_job(my_arg1, my_arg2, ... my_arg_n, **_)
...
Starting from v0.5.0, every argument is accessed by its keyword.
You may have any arbitrary number of arguments which get loaded from the job input parameter, and the special arguments:
- update_job: function to update status of current job (FINISHED, ERROR, etc)
- job: dictionary containing job information (id, status, queue, insertion date, etc)
- queue: dictionary containing Job's parent Queue information (name, type, frequency, etc)
- kwargs: dictionary aliasing the custom params (from job's "input" attribute, for retrocompatibility)
Worker configuration:
This configurations must run before worker.run()
(event loop)
# Poll with subscription
worker.setPollingMode(PollingMode.SUBSCRIPTION)
# or Poll with Queries
worker.setPollingMode(PollingMode.QUERY)
worker.setJobConfigMode(JobConfigMode.KEEP)
# Config remains untouched (Allow persistence of config on DB)
worker.setJobConfigMode(JobConfigMode.KEEP)
# Config updates with job params (Allow quick iteration of job setups)
worker.setJobConfigMode(JobConfigMode.SYNC)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ValiotWorker-5.0.2.tar.gz
(32.5 kB
view hashes)
Built Distribution
Close
Hashes for ValiotWorker-5.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 87be4b63232ec3ef6185995da8cbdb3e2ed6ea15689e06fae020401dcae2f860 |
|
MD5 | a64ed3b104934958bb1e26b0b0337345 |
|
BLAKE2b-256 | e7210ad320fb127e0d41ecc3401e0e32c18d7eccefcf01414d5535829884ee13 |