Collection of tasks for I/O.
Project description
Collection of tasks for I/O. Designed to be used both in Prefect workflows and as modular, useful pieces of code.
Installation
The collection can be installed using:
pip install io-collection
Note that loading and saving images requires additional dependencies. Install these using:
pip install 'io-collection[images]'
We recommend using Poetry to manage and install dependencies. To install into your Poetry project, use:
poetry add io-collection
To include additional dependencies for loading and saving images:
poetry add 'io-collection[images]'
Usage
Prefect workflows
All tasks in this collection are wrapped in a Prefect @task
decorator, and can be used directly in a Prefect @flow
.
Running tasks within a Prefect flow enables you to take advantage of features such as automatically retrying failed tasks, monitoring workflow states, running tasks concurrently, deploying and scheduling flows, and more.
from prefect import flow
from io_collection.<module_name> import <task_name>
@flow
def run_flow():
<task_name>()
if __name__ == "__main__":
run_flow()
See cell-abm-pipeline for examples of using tasks from different collections to build a pipeline for simulating and analyzing agent-based model data.
Individual tasks
Not all use cases require a full workflow.
Tasks in this collection can be used without the Prefect @task
decorator by simply importing directly from the module:
from io_collection.<module_name>.<task_name> import <task_name>
def main():
<task_name>()
if __name__ == "__main__":
main()
or using the .fn()
method:
from io_collection.<module_name> import <task_name>
def main():
<task_name>.fn()
if __name__ == "__main__":
main()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for io_collection-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 85c546aa15d95d9e89541b8d4a0b5fbd8bf950a5d35acf3f0b47fb2d70525392 |
|
MD5 | 8c1144c6ef3f56da2bb3c1764d02d84c |
|
BLAKE2b-256 | b0317d666bab3c75fc00810f1168b71866d153616cf09ea6e1391363dbe4e25f |