task-lattice 0.0.1a2

Distributed Task Framework

Task Lattice

Distributed Task Framework for distributing work across workers

---

🚀 Key Features

Task Lattice's key features include:

• Broker Support - Following brokers are supported:
  • Solace
  • Kafka (Day 2)
• Queues - Multiple queue/priority queue support
• Async - Async tasks supported incl. execution in event loop
• Customisation - Extensive customisation of queue, worker and tasks including:
  • Automated task retry
  • Dead letter queues
  • Worker concurrency
  • Queue capacity
  • ...
• Minimal code - Minimal code is required to use task lattice in your project
• DAG support - Supports DAG (directed acyclical graph) workflow execution
• Monitoring - Supports live monitoring of the queues, workers, tasks

---

ℹ️ Installation

# Using pip
pip install task-lattice

# Using poetry
poetry add task-lattice

# Using uv
uv add task-lattice

---

📦 Dependencies

This project's dependencies are based on the broker used. They are minimal by design.

Solace:

• Solace Messaging

---

📘 How to use

Step 1 - Define your Task Lattice application

from task_lattice import TaskLattice, SolaceConnectionDetails, QueueDetails

app = TaskLattice(
    SolaceConnectionDetails(host="localhost", port=55555, vpn="default", username="admin", password="admin"),
    TaskLatticeConfig(
      queues=[
        QueueConfig(name="default", topic="tasks.default"),
      ], 
      default_queue="default"
    ),
)

Step 2 - Define your tasks:

@app.task
def sync_function():
  ...

@app.task
async def async_function():
  ...

Step 3 - Enqueue a task:

task = sync_function.create()

app.enqueue(task)

Step 4 - Run a worker to process tasks:

app.start_worker()

---

📘 Logging

Task Lattice uses the "task-lattice" logger. There are informational logs and also debugging logs.

---

ℹ️ License

This project is licensed under the terms of the MIT license.