fastpluggy-tasks-worker 0.3.164

Task Runner plugin for Fastpluggy

FastPluggy Task Runner

A powerful and extensible task execution framework for Python, built on top of FastPluggy.
Easily register, run, monitor, and schedule background tasks with full support for retries, logging, live WebSocket updates, and notifications.

---

✨ Features

• 🔧 Task registration with metadata, retries, scheduling, and custom parameters
• 🧠 Dynamic form generation from metadata
• 📡 Live logs and WebSocket updates
• 📅 CRON-based scheduler with optional notification rules
• 🔁 Retry logic with auto-link to parent task
• 🔒 Non-concurrent task execution with lock tracking
• 🧩 Extensible subscribers system (Console, Slack, Webhook...)
• 📊 Admin UI to manage tasks, schedules, locks, and reports
• 💾 Persistent task context and rehydration
• 📈 Task metrics from process/thread info

---

🛠️ How It Works

@TaskWorker.register(
    description="Sync data every 5 mins",
    schedule="*/5 * * * *",
    max_retries=3,
    allow_concurrent=False
)
def sync_data_task():
    print("Sync running...")

For detailed instructions on creating tasks and triggering them from JavaScript, see the Task Creation and JS Triggering Guide.

For information about Jinja template global variables available for task triggering, see the Jinja Template Globals documentation.

---

📋 Roadmap

✅ Completed / In Progress

• Task registration with metadata (description, tags, max_retries, schedule, allow_concurrent)
• Dynamic task form rendering via metadata
• Notification/subscribers system with:
  • Console / webhook / Slack (optional)
  • Selectable events: task_started, task_failed, logs, etc.
• Context/report tracking in DB
• Task retry linking via parent_task_id
• CRON-based scheduler loop
• Web UI for:
  • Task logs
  • Task reports
  • Scheduled tasks
  • Locks
  • Running task status
• Lock manager (TaskLockManager) with DB tracking
• Cancel button for live-running tasks

---

📌 Upcoming Features

🔁 Task Queue Enhancements

• Priority & rate-limit execution
• Per-user concurrency limits
• Task dependencies / DAG runner

🧠 Task Registry & Detection

• Auto-discovery of task definitions from modules
• Celery-style shared task detection

💾 Persistence & Rehydration

• Save function reference + args for replay/retry
• Task dependency tree and retry visualization

🌐 Remote Workers

• Register and manage remote workers
• Assign tasks based on tags/strategies
• Remote heartbeat & health monitoring

📈 Observability

• Task metrics via psutil (CPU, memory, threads)
• UI views for thread/process diagnostics

---

📦 Tech Stack

• FastAPI + FastPluggy
• SQLAlchemy + SQLite/PostgreSQL
• WTForms + Jinja2 + Bootstrap (Tabler)
• WebSockets for real-time feedback
• Plugin-ready & modular architecture

---

🧠 Philosophy

This runner is built to be:

• Introspective: auto-generate UIs from functions
• Composable: integrate with your FastPluggy app
• Scalable: support single-machine and multi-worker environments
• Extensible: notifiers, hooks, CRON, logs

---

📎 License

MIT – Use freely and contribute 💙

---

🚀 Contributions Welcome!

Open issues, send PRs, share ideas —
Let’s build the most pluggable Python task runner together.

Warning:

Does not work with SQLite due to JSONB field requirements.