taskade 0.0.1

A DAG framework written in std python

Effortless Task Management: Flexible, Fast, Simple and Reliable

Overview

Taskade is a Python framework designed to simplify the execution of tasks with dependencies. It provides a flexible and efficient way to manage task execution, allowing developers to focus on writing task logic rather than managing dependencies.

Features

• High Performance: Optimized for speed and efficiency.
• Easy to Use: Simple and intuitive API.
• Lightweight: Taskade has no dependencies on anything outside of the standard library.
• Flexible Execution: Choose from various execution strategies, including sequential, concurrent, and asynchronous execution.
• CGraphLib: An optional dependency written for Taskade cgraphlib. With up to a ~2.5x performance improvement over the standard library.

Design Principles

Taskade is designed with the following principles in mind:

• Separation of Concerns: Task logic is separate from execution logic.
• Flexibility: Support for various execution strategies and task types.
• Efficiency: Optimize task execution for performance.

Use Cases

Taskade is suitable for applications that require:

• Complex Task Dependencies: Manage complex task dependencies with ease.
• High-Performance Execution: Execute tasks concurrently for improved performance.
• Asynchronous Tasks: Support for asynchronous tasks and execution.

Getting Started

Install Taskade

pip install taskade

cgraphlib

cgraphlib is a C extension that provides a more performant graph traversal algorithm and is also available on versions of python that don't support the graphlib providing a ~2.5x performance improvement

Basic Usage

To create a Task, the simplest way is through the @task decorator:

from taskade import task

@task(graph_name='my_graph')
def my_task():
    # Task implementation
    return "example_output"

@task(graph_name='my_graph', dependencies=my_task)
def my_second_task():
    # Task implementation
    return "example_output"

@task(graph_name='my_graph')
def my_third_task():
    # Task implementation
    return "example_output"

@task(graph_name="my_graph", dependencies=(my_second_task, my_third_task))
def my_final_task(dependent_result)
    print(dependent_result)
    return "final_example_output"

Using the decorator automatically creates a Graph and allows it to be executed.

from taskade import get_graph

def main():
    results = get_graph("my_graph")() # Call the execution of the graph
    print(results[my_task]) # Prints `example_output`
    print(results[my_final_task]) # Prints `final_example_output`

if __name__ == "__main__":
    main()

Combine Sync & Async Tasks

Taskade graphs also allow for mixing async and sync tasks within the same graph. Blocking will occur only when an sync function is executing, but otherwise the same async behavior will be preserved.

from taskade import task

@task(graph_name='my_graph')
async def my_task():
    # Task implementation
    return "example_output"

@task(graph_name="my_graph", dependencies=my_task)
def my_final_task(dependent_result)
    print(dependent_result)

you will still need to execute the graph using await as some of the nodes are async.

from taskade import get_graph
import asyncio

async def main():
    results = await get_graph("my_graph")() # Call the execution of the graph
    print(results[my_task]) # Prints `example_output`
    print(results[my_final_task]) # Prints `final_example_output`

if __name__ == "__main__":
    asyncio.run(main())

Documentation

The above are just the basics of using Taskade, there is a lot more functionality provdided that can be found in the documentation.