Skip to main content

Portable workflow framework - transform any script into a versioned, schedulable command. Store in ~/.mcli/workflows/, version with lockfile, run as daemon or cron job.

Project description

MCLI - Portable Workflow Framework

codecov Tests Python Version License

Transform any script into a versioned, portable, schedulable workflow command.

MCLI is a modular CLI framework that lets you write scripts once and run them anywhere - as interactive commands, scheduled jobs, or background daemons. Your workflows live in ~/.mcli/workflows/, are versioned via lockfile, and completely decoupled from the engine source code.

🎯 Core Philosophy

Write a script. Store it. Version it. Run it anywhere. Schedule it. Share it.

No coupling to the engine. No vendor lock-in. Just portable workflows that work.

🚀 Visual Workflow Editing

Edit your workflow JSON files like Jupyter notebooks with our VSCode extension!

VSCode Extension Visual Editing

Features:

  • 📝 Cell-based editing (Jupyter-like interface)
  • ⚡ Live code execution (Python, Shell, Bash, Zsh, Fish)
  • 🎯 Monaco editor with IntelliSense
  • 📊 Rich markdown documentation cells
  • 💾 Files stay as .json (git-friendly)

Quick Install:

# From VSCode Marketplace (pending publication)
code --install-extension gwicho38.mcli-framework

# Or install from VSIX
code --install-extension vscode-extension/mcli-framework-2.0.0.vsix

Learn More:

⚡ Quick Start

Installation

# Install from PyPI
pip install mcli-framework

# Or with UV (recommended)
uv pip install mcli-framework

Initialize Workflows Directory

# Initialize workflows in current git repository
mcli init

# Or initialize global workflows
mcli init --global

# Initialize with git repository for workflows
mcli init --git

This creates a .mcli/workflows/ directory (local to your repo) or ~/.mcli/workflows/ (global) with:

  • README.md with usage instructions
  • commands.lock.json for version tracking
  • .gitignore for backup files

Create Your First Workflow

Method 1: From a Python Script

# Write your script
cat > my_task.py << 'EOF'
import click

@click.command()
@click.option('--message', default='Hello', help='Message to display')
def app(message):
    """My custom workflow"""
    click.echo(f"{message} from my workflow!")
EOF

# Import as workflow
mcli workflow import-script my_task.py --name my-task

# Run it
mcli workflowss my-task --message "Hi"

Method 2: Interactive Creation

# Create workflow interactively
mcli workflow add my-task

# Edit in your $EDITOR, then run
mcli workflowss my-task

📦 Workflow System Features

1. Create Workflows

Multiple ways to create workflows:

# Import from existing Python script
mcli workflow import-script script.py --name my-workflow
# Create new workflow interactively
mcli workflow add my-workflow --group workflow --description "Does something useful"

# List all workflows
mcli workflow list-custom

2. Edit & Manage Workflows

# Edit workflow in $EDITOR
mcli workflow edit my-workflow

# Show workflow details
mcli workflow info my-workflow

# Search workflows
mcli workflow search "pdf"

# Remove workflow
mcli workflow remove my-workflow

3. Export & Import (Portability)

Share workflows across machines or with your team:

# Export all workflows to JSON
mcli workflow export my-workflows.json

# Import on another machine
mcli workflow import my-workflows.json

# Export single workflow to Python script
mcli workflow export-script my-workflow --output my_workflow.py

Your workflows are just JSON files in ~/.mcli/workflows/:

$ ls ~/.mcli/workflows/
pdf-processor.json
data-sync.json
git-commit.json
commands.lock.json  # Version lockfile

4. Version Control with Lockfile

MCLI automatically maintains a lockfile for reproducibility:

# Update lockfile with current workflow versions
mcli workflow update-lockfile

# Verify workflows match lockfile
mcli workflow verify

Example commands.lock.json:

{
  "version": "1.0",
  "generated_at": "2025-10-17T10:30:00Z",
  "commands": {
    "pdf-processor": {
      "name": "pdf-processor",
      "description": "Intelligent PDF processor",
      "group": "workflow",
      "version": "1.2",
      "updated_at": "2025-10-15T14:30:00Z"
    }
  }
}

Version control your workflows:

# Add lockfile to git
git add ~/.mcli/workflows/commands.lock.json ~/.mcli/workflows/*.json
git commit -m "Update workflows"

# On another machine
git pull
mcli workflow verify  # Ensures consistency

5. Run as Daemon or Scheduled Task

Workflows aren't coupled to the engine - run them however you want:

As a Daemon:

# Start workflow as background daemon
mcli workflows daemon start my-task-daemon --workflow my-task

# Check daemon status
mcli workflows daemon status

# Stop daemon
mcli workflows daemon stop my-task-daemon

As Scheduled Task:

# Schedule workflow to run every hour
mcli workflows scheduler add \
  --name hourly-sync \
  --schedule "0 * * * *" \
  --workflow my-task

# List scheduled workflows
mcli workflows scheduler list

# View logs
mcli workflows scheduler logs hourly-sync

🎨 Real-World Workflow Examples

Example 1: PDF Processor

# Create PDF processing workflow
mcli workflow import-script pdf_tool.py --name pdf
# Use it
mcli workflows pdf extract ~/Documents/report.pdf
mcli workflows pdf compress ~/Documents/*.pdf --output compressed/
mcli workflows pdf split large.pdf --pages 10

Example 2: Data Sync Workflow

# Create sync workflow
cat > sync.py << 'EOF'
import click
import subprocess

@click.group()
def app():
    """Multi-cloud sync workflow"""
    pass

@app.command()
@click.argument('source')
@click.argument('dest')
def backup(source, dest):
    """Backup data to cloud"""
    subprocess.run(['rclone', 'sync', source, dest])
    click.echo(f"Synced {source} to {dest}")

@app.command()
def status():
    """Check sync status"""
    click.echo("Checking sync status...")
EOF

mcli workflow import-script sync.py --name sync
# Run manually
mcli workflows sync backup ~/data remote:backup

# Or schedule it
mcli workflows scheduler add \
  --name nightly-backup \
  --schedule "0 2 * * *" \
  --workflow "sync backup ~/data remote:backup"

Example 3: Git Commit Helper

# Already included as built-in workflow
mcli workflows git-commit

# Or create your own variant
mcli workflow export-script git-commit --output my_git_helper.py
# Edit my_git_helper.py to customize
mcli workflow import-script my_git_helper.py --name my-git```

## 🔧 Workflow Structure

Each workflow is a JSON file with this structure:

```json
{
  "name": "my-workflow",
  "group": "workflow",
  "description": "Does something useful",
  "version": "1.0",
  "metadata": {
    "author": "you@example.com",
    "tags": ["utility", "automation"]
  },
  "code": "import click\n\n@click.command()\ndef app():\n    click.echo('Hello!')",
  "updated_at": "2025-10-17T10:00:00Z"
}

🚀 Built-in Workflows

MCLI comes with powerful built-in workflows:

mcli workflows --help

Available workflows:

  • pdf - Intelligent PDF processing (extract, compress, split, merge)
  • clean - Enhanced Mac system cleaner
  • emulator - Android/iOS emulator management
  • git-commit - AI-powered commit message generation
  • scheduler - Cron-like job scheduling
  • daemon - Process management and daemonization
  • redis - Redis cache management
  • videos - Video processing and overlay removal
  • sync - Multi-cloud synchronization
  • politician-trading - Now available as standalone package: politician-trading-tracker

💡 Why MCLI?

The Problem

You write scripts. They work. Then:

  • ❌ Can't remember where you saved them
  • ❌ Hard to share with team members
  • ❌ No version control or change tracking
  • ❌ Coupling to specific runners or frameworks
  • ❌ No easy way to schedule or daemonize

The MCLI Solution

  • Centralized Storage: All workflows in ~/.mcli/workflows/
  • Portable: Export/import as JSON, share anywhere
  • Versioned: Lockfile for reproducibility
  • Decoupled: Zero coupling to engine source code
  • Flexible Execution: Run interactively, scheduled, or as daemon
  • Discoverable: Tab completion, search, info commands

📚 Advanced Features

Shell Completion

# Install completion for your shell
mcli self completion install

# Now use tab completion
mcli workflows <TAB>          # Shows all workflows
mcli workflows pdf <TAB>      # Shows pdf subcommands

AI Chat Integration

# Chat with AI about your workflows
mcli chat

# Configure AI providers
export OPENAI_API_KEY=your-key
export ANTHROPIC_API_KEY=your-key

Self-Update

# Update MCLI to latest version
mcli self update

# Check version
mcli version

🛠️ Development

For Development or Customization

# Clone repository
git clone https://github.com/gwicho38/mcli.git
cd mcli

# Setup with UV
uv venv
uv pip install -e ".[dev]"

# Run tests
make test

# Build wheel
make wheel

📖 Documentation

🎯 Common Use Cases

Use Case 1: Daily Automation Scripts

# Create your daily automation
mcli workflow add daily-tasks# Add your tasks in $EDITOR
mcli workflows scheduler add --name daily --schedule "0 9 * * *" --workflow daily-tasks

Use Case 2: Team Workflow Sharing

# On your machine
mcli workflow export team-workflows.json

# Share file with team
# On teammate's machine
mcli workflow import team-workflows.json
mcli workflow verify  # Ensure consistency

Use Case 3: CI/CD Integration

# In your CI pipeline
- pip install mcli-framework
- mcli workflow import ci-workflows.json
- mcli workflows build-and-test
- mcli workflows deploy --env production

📦 Dependencies

Core (Always Installed)

  • click: CLI framework
  • rich: Beautiful terminal output
  • requests: HTTP client
  • python-dotenv: Environment management

Optional Features

All features are included by default as of v7.0.0. For specialized needs:

# GPU support (CUDA required)
pip install "mcli-framework[gpu]"

# Development tools
pip install "mcli-framework[dev]"

🤝 Contributing

We welcome contributions! Especially workflow examples.

  1. Fork the repository
  2. Create feature branch: git checkout -b feature/awesome-workflow
  3. Create your workflow
  4. Export it: mcli workflow export my-workflow.json
  5. Submit PR with workflow JSON

📄 License

MIT License - see LICENSE for details.

🙏 Acknowledgments


Start transforming your scripts into portable workflows today:

pip install mcli-framework
mcli workflow add my-first-workflow```

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mcli_framework-7.12.1.tar.gz (803.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mcli_framework-7.12.1-py3-none-any.whl (753.3 kB view details)

Uploaded Python 3

File details

Details for the file mcli_framework-7.12.1.tar.gz.

File metadata

  • Download URL: mcli_framework-7.12.1.tar.gz
  • Upload date:
  • Size: 803.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for mcli_framework-7.12.1.tar.gz
Algorithm Hash digest
SHA256 9b036956dd829540e163a554064ce18b781c53c451d6cb837947a9c39a1ad7ba
MD5 372a150c0bed196d773861bab4aca03e
BLAKE2b-256 fae1669fb07043ade958ac1c88ea43a3256d7bb0c21c621691597c0e9c934bd9

See more details on using hashes here.

File details

Details for the file mcli_framework-7.12.1-py3-none-any.whl.

File metadata

File hashes

Hashes for mcli_framework-7.12.1-py3-none-any.whl
Algorithm Hash digest
SHA256 aa53b0a59699614fed6058cf088e6e7ec3425d158246ac3b85f4de702ccaf0a3
MD5 05f9689b99158f9f307f21f6eb94338e
BLAKE2b-256 7103b0ae8219b1b82f5769480af5117ede504acbeeec98a71cb02fda0a175510

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page