taskflow-pipeline 0.1.0

A Python library for orchestrating RPA, data processing, and AI task pipelines from YAML/JSON configurations

TaskFlow

A Python library for orchestrating automated pipelines including RPA (desktop/web automation), data processing, and AI tasks using YAML or JSON configuration files.

Features

• Configuration-based execution: Define your task pipelines in YAML or JSON
• Modular task system: Supports RPA, data processing, and AI tasks
• Easy extensibility: Add custom task modules with simple function definitions
• Type-safe: Built with type hints for better IDE support
• Error handling: Clear error messages for debugging pipelines

Installation

pip install taskflow-pipeline

For development:

git clone https://github.com/berkterekli/taskflow-pipeline.git
cd taskflow-pipeline
pip install -e ".[dev]"

Quick Start

1. Create a tasks.yaml file:

tasks:
  - action: "rpa.click"
    params:
      target: "Submit Button"
  
  - action: "data.clean_data"
    params:
      data: "sample_data.csv"

2. Run your pipeline:

from taskflow import TaskFlow

# Initialize and run the pipeline
pipeline = TaskFlow("tasks.yaml")
pipeline.run()

Task Types

RPA Tasks

• rpa.click: Simulate clicking on UI elements
• rpa.extract_table_from_pdf: Extract tables from PDF files

Data Tasks

• data.clean_data: Clean and preprocess data

AI Tasks

• ai.generate_text: Generate text using AI models

Project Structure

taskflow/
├── __init__.py
├── core.py          # Main TaskFlow engine
├── parser.py        # YAML/JSON parser
└── tasks/
    ├── __init__.py
    ├── rpa_tasks.py      # RPA automation tasks
    ├── data_tasks.py     # Data processing tasks
    └── ai_tasks.py       # AI-related tasks

Development

Run tests:

pytest

Format code:

black taskflow tests

Type checking:

mypy taskflow

License

MIT License - see LICENSE file for details.

Contributing

Contributions are welcome! Please see CONTRIBUTING.md for guidelines.

Publishing

See PUBLISHING_GUIDE.md for detailed instructions on publishing to PyPI.

Changelog

See CHANGELOG.md for version history and changes.

Author

Berk Terekli

Support

• 📖 Documentation
• 🐛 Issue Tracker
• 💬 Discussions