Skip to main content

Portable workflow framework - transform any script into a versioned, schedulable command. Store in ~/.mcli/workflows/, version with lockfile, run as daemon or cron job.

Project description

MCLI - Portable Workflow Framework

codecov Tests Python Version License

Transform any script into a versioned, portable, schedulable workflow command.

MCLI is a modular CLI framework that lets you write scripts once and run them anywhere - as interactive commands, scheduled jobs, or background daemons. Your workflows live in ~/.mcli/workflows/, are versioned via lockfile, and completely decoupled from the engine source code.

🎯 Core Philosophy

Write a script. Store it. Version it. Run it anywhere. Schedule it. Share it.

No coupling to the engine. No vendor lock-in. Just portable workflows that work.

🚀 Visual Workflow Editing

Edit your workflow JSON files like Jupyter notebooks with our VSCode extension!

VSCode Extension Visual Editing

Features:

  • 📝 Cell-based editing (Jupyter-like interface)
  • ⚡ Live code execution (Python, Shell, Bash, Zsh, Fish)
  • 🎯 Monaco editor with IntelliSense
  • 📊 Rich markdown documentation cells
  • 💾 Files stay as .json (git-friendly)

Quick Install:

# From VSCode Marketplace (pending publication)
code --install-extension gwicho38.mcli-framework

# Or install from VSIX
code --install-extension vscode-extension/mcli-framework-2.0.0.vsix

Learn More:

⚡ Quick Start

Installation

# Install from PyPI
pip install mcli-framework

# Or with UV (recommended)
uv pip install mcli-framework

Initialize Workflows Directory

# Initialize workflows in current git repository
mcli init

# Or initialize global workflows
mcli init --global

# Initialize with git repository for workflows
mcli init --git

This creates a .mcli/workflows/ directory (local to your repo) or ~/.mcli/workflows/ (global) with:

  • README.md with usage instructions
  • commands.lock.json for version tracking
  • .gitignore for backup files

Create Your First Workflow

Method 1: From a Python Script

# Write your script
cat > my_task.py << 'EOF'
import click

@click.command()
@click.option('--message', default='Hello', help='Message to display')
def app(message):
    """My custom workflow"""
    click.echo(f"{message} from my workflow!")
EOF

# Import as workflow
mcli repo import-script my_task.py --name my-task

# Run it
mcli workflowss my-task --message "Hi"

Method 2: Interactive Creation

# Create workflow interactively
mcli repo add my-task

# Edit in your $EDITOR, then run
mcli workflowss my-task

📦 Workflow System Features

1. Create Workflows

Multiple ways to create workflows:

# Import from existing Python script
mcli repo import-script script.py --name my-workflow
# Create new workflow interactively
mcli repo add my-workflow --group workflow --description "Does something useful"

# List all workflows
mcli repo list-custom

2. Edit & Manage Workflows

# Edit workflow in $EDITOR
mcli repo edit my-workflow

# Show workflow details
mcli repo info my-workflow

# Search workflows
mcli repo search "pdf"

# Remove workflow
mcli repo remove my-workflow

3. Export & Import (Portability)

Share workflows across machines or with your team:

# Export all workflows to JSON
mcli repo export my-workflows.json

# Import on another machine
mcli repo import my-workflows.json

# Export single workflow to Python script
mcli repo export-script my-workflow --output my_workflow.py

Your workflows are just JSON files in ~/.mcli/workflows/:

$ ls ~/.mcli/workflows/
pdf-processor.json
data-sync.json
git-commit.json
commands.lock.json  # Version lockfile

4. Version Control with Lockfile

MCLI automatically maintains a lockfile for reproducibility:

# Update lockfile with current workflow versions
mcli repo update-lockfile

# Verify workflows match lockfile
mcli repo verify

Example commands.lock.json:

{
  "version": "1.0",
  "generated_at": "2025-10-17T10:30:00Z",
  "commands": {
    "pdf-processor": {
      "name": "pdf-processor",
      "description": "Intelligent PDF processor",
      "group": "workflow",
      "version": "1.2",
      "updated_at": "2025-10-15T14:30:00Z"
    }
  }
}

Version control your workflows:

# Add lockfile to git
git add ~/.mcli/workflows/commands.lock.json ~/.mcli/workflows/*.json
git commit -m "Update workflows"

# On another machine
git pull
mcli repo verify  # Ensures consistency

5. Run as Daemon or Scheduled Task

Workflows aren't coupled to the engine - run them however you want:

As a Daemon:

# Start workflow as background daemon
mcli run daemon start my-task-daemon --workflow my-task

# Check daemon status
mcli run daemon status

# Stop daemon
mcli run daemon stop my-task-daemon

As Scheduled Task:

# Schedule workflow to run every hour
mcli run scheduler add \
  --name hourly-sync \
  --schedule "0 * * * *" \
  --workflow my-task

# List scheduled workflows
mcli run scheduler list

# View logs
mcli run scheduler logs hourly-sync

🎨 Real-World Workflow Examples

Example 1: PDF Processor

# Create PDF processing workflow
mcli repo import-script pdf_tool.py --name pdf
# Use it
mcli run pdf extract ~/Documents/report.pdf
mcli run pdf compress ~/Documents/*.pdf --output compressed/
mcli run pdf split large.pdf --pages 10

Example 2: Data Sync Workflow

# Create sync workflow
cat > sync.py << 'EOF'
import click
import subprocess

@click.group()
def app():
    """Multi-cloud sync workflow"""
    pass

@app.command()
@click.argument('source')
@click.argument('dest')
def backup(source, dest):
    """Backup data to cloud"""
    subprocess.run(['rclone', 'sync', source, dest])
    click.echo(f"Synced {source} to {dest}")

@app.command()
def status():
    """Check sync status"""
    click.echo("Checking sync status...")
EOF

mcli repo import-script sync.py --name sync
# Run manually
mcli run sync backup ~/data remote:backup

# Or schedule it
mcli run scheduler add \
  --name nightly-backup \
  --schedule "0 2 * * *" \
  --workflow "sync backup ~/data remote:backup"

Example 3: Git Commit Helper

# Already included as built-in workflow
mcli run git-commit

# Or create your own variant
mcli repo export-script git-commit --output my_git_helper.py
# Edit my_git_helper.py to customize
mcli repo import-script my_git_helper.py --name my-git```

## 🔧 Workflow Structure

Each workflow is a JSON file with this structure:

```json
{
  "name": "my-workflow",
  "group": "workflow",
  "description": "Does something useful",
  "version": "1.0",
  "metadata": {
    "author": "you@example.com",
    "tags": ["utility", "automation"]
  },
  "code": "import click\n\n@click.command()\ndef app():\n    click.echo('Hello!')",
  "updated_at": "2025-10-17T10:00:00Z"
}

🚀 Built-in Workflows

MCLI comes with powerful built-in workflows:

mcli run --help

Available workflows:

  • pdf - Intelligent PDF processing (extract, compress, split, merge)
  • clean - Enhanced Mac system cleaner
  • emulator - Android/iOS emulator management
  • git-commit - AI-powered commit message generation
  • scheduler - Cron-like job scheduling
  • daemon - Process management and daemonization
  • redis - Redis cache management
  • videos - Video processing and overlay removal
  • sync - Multi-cloud synchronization
  • politician-trading - Now available as standalone package: politician-trading-tracker

💡 Why MCLI?

The Problem

You write scripts. They work. Then:

  • ❌ Can't remember where you saved them
  • ❌ Hard to share with team members
  • ❌ No version control or change tracking
  • ❌ Coupling to specific runners or frameworks
  • ❌ No easy way to schedule or daemonize

The MCLI Solution

  • Centralized Storage: All workflows in ~/.mcli/workflows/
  • Portable: Export/import as JSON, share anywhere
  • Versioned: Lockfile for reproducibility
  • Decoupled: Zero coupling to engine source code
  • Flexible Execution: Run interactively, scheduled, or as daemon
  • Discoverable: Tab completion, search, info commands

📚 Advanced Features

Shell Completion

# Install completion for your shell
mcli self completion install

# Now use tab completion
mcli run <TAB>          # Shows all workflows
mcli run pdf <TAB>      # Shows pdf subcommands

AI Chat Integration

# Chat with AI about your workflows
mcli chat

# Configure AI providers
export OPENAI_API_KEY=your-key
export ANTHROPIC_API_KEY=your-key

Self-Update

# Update MCLI to latest version
mcli self update

# Check version
mcli version

🛠️ Development

For Development or Customization

# Clone repository
git clone https://github.com/gwicho38/mcli.git
cd mcli

# Setup with UV
uv venv
uv pip install -e ".[dev]"

# Run tests
make test

# Build wheel
make wheel

📖 Documentation

🎯 Common Use Cases

Use Case 1: Daily Automation Scripts

# Create your daily automation
mcli repo add daily-tasks# Add your tasks in $EDITOR
mcli run scheduler add --name daily --schedule "0 9 * * *" --workflow daily-tasks

Use Case 2: Team Workflow Sharing

# On your machine
mcli repo export team-workflows.json

# Share file with team
# On teammate's machine
mcli repo import team-workflows.json
mcli repo verify  # Ensure consistency

Use Case 3: CI/CD Integration

# In your CI pipeline
- pip install mcli-framework
- mcli repo import ci-workflows.json
- mcli run build-and-test
- mcli run deploy --env production

📦 Dependencies

Core (Always Installed)

  • click: CLI framework
  • rich: Beautiful terminal output
  • requests: HTTP client
  • python-dotenv: Environment management

Optional Features

All features are included by default as of v7.0.0. For specialized needs:

# GPU support (CUDA required)
pip install "mcli-framework[gpu]"

# Development tools
pip install "mcli-framework[dev]"

🤝 Contributing

We welcome contributions! Especially workflow examples.

  1. Fork the repository
  2. Create feature branch: git checkout -b feature/awesome-workflow
  3. Create your workflow
  4. Export it: mcli repo export my-workflow.json
  5. Submit PR with workflow JSON

📄 License

MIT License - see LICENSE for details.

🙏 Acknowledgments


Start transforming your scripts into portable workflows today:

pip install mcli-framework
mcli repo add my-first-workflow```

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mcli_framework-7.14.1-py3-none-any.whl (759.4 kB view details)

Uploaded Python 3

File details

Details for the file mcli_framework-7.14.1-py3-none-any.whl.

File metadata

File hashes

Hashes for mcli_framework-7.14.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b7cf0c23237ea4012325d049336d43f35c8dfcd94e4ce9847efa959efda4f3e9
MD5 de1ed901d514a24951383efebf513ddc
BLAKE2b-256 921b701a560d37f9ee406bebb6dcd6acb84bada94c5df17e3bfad4f49d29b702

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page