A Toloka provider for Apache Airflow
Project description
Airflow Toloka Provider
This library allows you to run crowdsourcing Toloka processes in Apache Airflow - a widely used workflow management system
Here you can find a collection of ready-made Airflow tasks for the most frequently used actions in Toloka-Kit.
Getting started
$ pip install airflow-provider-toloka
A good way to start is to follow the example in this repo.
Configuration
In the Airflow Connections UI, create a new connection for Toloka.
Conn ID
:toloka_default
Conn Type
:Toloka
Password
: enter your OAuth token for Toloka. You can learn more about how to get it here.
Tasks uses the toloka_default
connection id by default, but
if needed, you can create additional Airflow Connections and reference them
as the function toloka_conn_id
argument.
Useful Links
Questions and bug reports
- For reporting bugs please use the Toloka/bugreport page.
- Join our English-speaking slack community for both tech and abstract questions.
License
© YANDEX LLC, 2022. Licensed under the Apache License, Version 2.0. See LICENSE file for more details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for airflow-provider-toloka-0.0.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8bcc8af580277b51f0d5e4206b895266108802daad424b2e3c1ef6a131c01c16 |
|
MD5 | b5b4fe0424a1ca216a91af9546a25489 |
|
BLAKE2b-256 | 574b8eb4d1b1acb59f0a0fea17680678da4651d7c0ee6cd0c4beec25ba610ed3 |
Hashes for airflow_provider_toloka-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7754579a0f864bd3d73da2d696774d294d340a17bb05025665d6f994d5ccbbb |
|
MD5 | 163f22d1bffe56ae8a0c49f4b4b4e7f4 |
|
BLAKE2b-256 | 37da05a78371c0012d24a3fa60f7a54335c594fb0c2778092f5a8aef609f8f13 |