Enables running Python functions as standalone jobs based on interaction with valiot-jobs API
Project description
python-gql-worker
Enables running Python functions as standalone jobs based on interaction with valiot-jobs API
installation
pipenv install valiotworker
Deployment:
python setup.py sdist bdist_wheel && python -m twine upload dist/* --skip-existing # UPLOAD TO PYPI
API < v0.4.0
Job footprint:
@valiotWorker.job(...)
def my_job(job_id, update_job, kwargs)
...
Parameters:
- job_id: Number representing the Identifier for this job
- update_job: function to update status of current job (FINISHED, ERROR, etc)
- kwargs: dictionary aliasing the custom params (from job's "input" attribute, for retrocompatibility)
API >= v0.5.0
@valiotWorker.job(...)
def my_job(my_arg1, my_arg2, ... my_arg_n, **_)
...
Starting from v0.5.0, every argument is accessed by its keyword.
You may have any arbitrary number of arguments which get loaded from the job input parameter, and the special arguments:
- update_job: function to update status of current job (FINISHED, ERROR, etc)
- job: dictionary containing job information (id, status, queue, insertion date, etc)
- queue: dictionary containing Job's parent Queue information (name, type, frequency, etc)
- kwargs: dictionary aliasing the custom params (from job's "input" attribute, for retrocompatibility)
Worker configuration:
This configurations must run before worker.run()
(event loop)
# Poll with subscription
worker.setPollingMode(PollingMode.SUBSCRIPTION)
# or Poll with Queries
worker.setPollingMode(PollingMode.QUERY)
worker.setJobConfigMode(JobConfigMode.KEEP)
# Config remains untouched (Allow persistence of config on DB)
worker.setJobConfigMode(JobConfigMode.KEEP)
# Config updates with job params (Allow quick iteration of job setups)
worker.setJobConfigMode(JobConfigMode.SYNC)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ValiotWorker-5.2.0.tar.gz
(31.4 kB
view hashes)
Built Distribution
Close
Hashes for ValiotWorker-5.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b4b2bf0332686a0e98f2df52b3bca5c06e197ebabcbee92c6b3adb5972b15c1a |
|
MD5 | e627d2a1a0e1849caed0380fef27e888 |
|
BLAKE2b-256 | 715a5eca5abc773a4b0de4e2c5ee3f41e76f792c9d1825ae3003579bd363e39f |