Skip to main content

Toloka prefect tasks library

Project description

Toloka-Prefect

This library makes the process of creating crowdsourcing pipelines easier by introducing out-of-the-box solutions for the majority of frequent steps in a typical Toloka pipeline. Here you can find most of Toloka-Kit functionality wrapped in Prefect's interface.

Prefect is a widely-used workflow management system, designed for modern infrastructure and powered by the open-source Prefect Core workflow engine. It offers many options for workflow management (for more information on the internal logic refer to an official example of Toloka's usage with prefect - the functions here are basically organized in the same way).

To see how a basic pipeline built with this library might look, see the example in this repo.

You can find fully supported functions in the toloka_prefect.py file.

An overview of the library's function is in the file functions_overview.md. Almost every function has token (your Toloka requester account's OAuth token) and env ('PRODUCTION' or 'SANDBOX') arguments to connect to Toloka server. For more information on functions' arguments, return values and usage cases see docstrings.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

toloka-prefect-0.0.1.tar.gz (7.1 kB view hashes)

Uploaded Source

Built Distribution

toloka_prefect-0.0.1-py3-none-any.whl (6.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page