Skip to main content

Waldorf, a distribution computing package based on celery

Project description

Waldorf

Waldorf is an efficient, parallel task execution framework written in Python. It was developed for research into reinforcement learning algorithms at our startup company in Beijing, China.

Waldorf is based on the Celery distributed task queue, and takes its name from Waldorf salad, which also has celery as an ingredient.

It can speed up algorithms such as Monte Carlo Tree Search (MCTS) by spreading concurrent sub-tasks, written as Python functions, across multiple machines and automating the collection of outputs. Waldorf can also be used to implement MapReduce-style work-flows.

Although Waldorf can be deployed on cloud servers, our emphasis at the moment is on utilizing the spare CPU capacity of a commodity PC cluster (e.g. normal office workstations). Support for GPUs may be included in a future release.

Features

  1. Waldorf uses a master node to pass messages between a client and slave nodes.

  2. A client can create a task as a Python function on his or her local machine. Waldorf sends tasks to a network of slave machines for execution using the Celery task queue. When Celery is used on its own, tasks typically must be defined in advance, but Waldorf allows tasks to be defined dynamically without any slave restarts required.

  3. Multiple clients can run their tasks simultaneously without conflict.

  4. Clients can adjust how many CPU cores are used on slave machines to perform calculations. This can be done dynamically from the Waldorf administration webpage.

Screenshot of Waldorf admin webpage

Basic Usage

You can use Waldorf on any task that requires parallel computing.

One of its many uses is to compute rollouts in an MCTS simulation (for example, in game-playing AIs).

Here is a simple illustration:

def rollout(args):
    # Do one rollout
    ...

def backup(result):
    # Backup and handle result
    ...

def mcts_search():
    for _ in range(iter):
        # Select action
        action = select()
        ...
        # Submit rollout job to waldorf client
        client.submit(rollout, args, callback=backup)
        ...
    # More code
    ...

For a more complex example, check out the gym demo.

Quick Start

Install Waldorf using the installation guide and check out the gym demo.

Disclaimer

Waldorf is still research code, so it may be slightly lacking in terms of documentation and support. Any feedback is welcomed.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

waldorf-0.6.0.post1-py3-none-any.whl (219.3 kB view details)

Uploaded Python 3

File details

Details for the file waldorf-0.6.0.post1-py3-none-any.whl.

File metadata

  • Download URL: waldorf-0.6.0.post1-py3-none-any.whl
  • Upload date:
  • Size: 219.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.5

File hashes

Hashes for waldorf-0.6.0.post1-py3-none-any.whl
Algorithm Hash digest
SHA256 58ae08b9922f931875437d24f5eb677f0a4cac9f75cc0ec1c305887682844c22
MD5 76b489345642879685697a093d1835ca
BLAKE2b-256 3aa175896b08b74765c7d2038edad2659c9bdc337f54f2debbccbedbfa0b46dc

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page