Skip to main content

The distributed parallel computing library hooks for xonsh

Project description

The distributed parallel computing library hooks for xonsh

If you like the idea click ⭐ on the repo and tweet.

Importantly this provides a substitute 'dworker' command which enables distributed workers to have access to xonsh builtins.

Furthermore, this xontrib adds a 'DSubmitter' context manager for executing a block remotely. Moreover, this also adds a convenience function 'dsubmit()' for creating DSubmitter and Executor instances at the same time.

Thus users may submit distributed jobs with::

with dsubmit('127.0.0.1:8786', rtn='x') as dsub:
    x = $(echo I am elsewhere)
res = dsub.future.result()
print(res)

This is useful for long running or non-blocking jobs.

Installation

To install use pip:

xpip install xontrib-distributed
# or: xpip install -U git+https://github.com/xonsh/xontrib-distributed

Usage

xontrib load distributed
# TODO: what's next?

Releasing your package

  • Bump the version of your package.
  • Create a GitHub release (The release notes are automatically generated as a draft release after each push).
  • And publish with poetry publish --build or twine

Credits

This package was created with xontrib cookiecutter template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xontrib-distributed-0.0.4.tar.gz (4.0 kB view hashes)

Uploaded Source

Built Distribution

xontrib_distributed-0.0.4-py3-none-any.whl (4.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page