Portable workflow framework - transform any script into a versioned, schedulable command. Store in ~/.mcli/workflows/, version with lockfile, run as daemon or cron job.
Project description
MCLI - Portable Workflow Framework
Transform any script into a versioned, portable, schedulable workflow command.
MCLI is a modular CLI framework that lets you write scripts once and run them anywhere - as interactive commands, scheduled jobs, or background daemons. Your workflows live in ~/.mcli/workflows/, are versioned via lockfile, and completely decoupled from the engine source code.
🎯 Core Philosophy
Write a script. Store it. Version it. Run it anywhere. Schedule it. Share it.
No coupling to the engine. No vendor lock-in. Just portable workflows that work.
🚀 Visual Workflow Editing
Edit your workflow JSON files like Jupyter notebooks with our VSCode extension!
Features:
- 📝 Cell-based editing (Jupyter-like interface)
- ⚡ Live code execution (Python, Shell, Bash, Zsh, Fish)
- 🎯 Monaco editor with IntelliSense
- 📊 Rich markdown documentation cells
- 💾 Files stay as
.json(git-friendly)
Quick Install:
# From VSCode Marketplace (pending publication)
code --install-extension gwicho38.mcli-framework
# Or install from VSIX
code --install-extension vscode-extension/mcli-framework-2.0.0.vsix
Learn More:
- Extension README - Features and usage
- Visual Editing Guide - Quick start
- Installation Guide - Detailed setup
- Workflow Notebooks Docs - Complete guide
⚡ Quick Start
Installation
# Install from PyPI
pip install mcli-framework
# Or with UV (recommended)
uv pip install mcli-framework
Drop & Run: Simplest Way to Add Commands
MCLI automatically converts any script into a workflow command:
# 1. Create a script with metadata comments
cat > ~/.mcli/commands/backup.sh <<'EOF'
#!/usr/bin/env bash
# @description: Backup files to S3
# @version: 1.0.0
# @requires: aws-cli
aws s3 sync /data/ s3://my-bucket/backup/
EOF
# 2. Sync scripts to JSON (auto-runs on startup)
mcli commands sync -g
# 3. Run it!
mcli run -g backup
# Note: 'mcli run' is an alias for 'mcli workflows'
Supported Languages: Python, Bash, JavaScript, TypeScript, Ruby, Perl, Lua
Key Features:
- ✅ Auto-detect language from shebang or extension
- ✅ Extract metadata from
@-prefixedcomments - ✅ Keep scripts as source of truth (JSON is auto-generated)
- ✅ File watcher for real-time sync (
MCLI_WATCH_SCRIPTS=true)
See Script Sync Documentation for details.
Initialize Workflows Directory
# Initialize workflows in current git repository
mcli init
# Or initialize global workflows
mcli init --global
# Initialize with git repository for workflows
mcli init --git
This creates a .mcli/workflows/ directory (local to your repo) or ~/.mcli/workflows/ (global) with:
- README.md with usage instructions
- commands.lock.json for version tracking
- .gitignore for backup files
Create Your First Workflow
Method 1: From a Python Script
# Write your script
cat > my_task.py << 'EOF'
import click
@click.command()
@click.option('--message', default='Hello', help='Message to display')
def app(message):
"""My custom workflow"""
click.echo(f"{message} from my workflow!")
EOF
# Import as workflow
mcli commands import my_task.py --name my-task
# Run it
mcli run my-task --message "Hi"
Method 2: Interactive Creation
# Create workflow interactively
mcli new my-task
# Edit in your $EDITOR, then run
mcli run my-task
📦 Workflow System Features
1. Create Workflows
Multiple ways to create workflows:
# Import from existing Python script
mcli commands import script.py --name my-workflow
# Create new workflow interactively
mcli new my-workflow --description "Does something useful"
# List all workflows
mcli commands list
2. Edit & Manage Workflows
# Edit workflow in $EDITOR
mcli edit my-workflow
# Show workflow details
mcli commands info my-workflow
# Search workflows
mcli commands search "pdf"
# Remove workflow
mcli rm my-workflow
3. Export & Import (Portability)
Share workflows across machines or with your team:
# Export all workflows to JSON
mcli commands export my-workflows.json
# Import on another machine
mcli commands import my-workflows.json
# Export single workflow to Python script
mcli commands export my-workflow --script --output my_workflow.py
Your workflows are just JSON files in ~/.mcli/workflows/:
$ ls ~/.mcli/workflows/
pdf-processor.json
data-sync.json
git-commit.json
commands.lock.json # Version lockfile
4. Version Control with Lockfile
MCLI automatically maintains a lockfile for reproducibility:
# Update lockfile with current workflow versions
mcli lock update
# Verify workflows match lockfile
mcli lock verify
Example commands.lock.json:
{
"version": "1.0",
"generated_at": "2025-10-17T10:30:00Z",
"commands": {
"pdf-processor": {
"name": "pdf-processor",
"description": "Intelligent PDF processor",
"group": "workflow",
"version": "1.2",
"updated_at": "2025-10-15T14:30:00Z"
}
}
}
Version control your workflows:
# Add lockfile to git
git add ~/.mcli/workflows/commands.lock.json ~/.mcli/workflows/*.json
git commit -m "Update workflows"
# On another machine
git pull
mcli lock verify # Ensures consistency
5. Run as Daemon or Scheduled Task
Workflows aren't coupled to the engine - run them however you want:
As a Daemon:
# Start workflow as background daemon
mcli run daemon start my-task-daemon --workflow my-task
# Check daemon status
mcli run daemon status
# Stop daemon
mcli run daemon stop my-task-daemon
As Scheduled Task:
# Schedule workflow to run every hour
mcli run scheduler add \
--name hourly-sync \
--schedule "0 * * * *" \
--workflow my-task
# List scheduled workflows
mcli run scheduler list
# View logs
mcli run scheduler logs hourly-sync
🎨 Real-World Workflow Examples
Example 1: PDF Processor
# Create PDF processing workflow
mcli commands import pdf_tool.py --name pdf
# Use it
mcli run pdf extract ~/Documents/report.pdf
mcli run pdf compress ~/Documents/*.pdf --output compressed/
mcli run pdf split large.pdf --pages 10
Example 2: Data Sync Workflow
# Create sync workflow
cat > sync.py << 'EOF'
import click
import subprocess
@click.group()
def app():
"""Multi-cloud sync workflow"""
pass
@app.command()
@click.argument('source')
@click.argument('dest')
def backup(source, dest):
"""Backup data to cloud"""
subprocess.run(['rclone', 'sync', source, dest])
click.echo(f"Synced {source} to {dest}")
@app.command()
def status():
"""Check sync status"""
click.echo("Checking sync status...")
EOF
mcli commands import sync.py --name sync
# Run manually
mcli run sync backup ~/data remote:backup
# Or schedule it
mcli run scheduler add \
--name nightly-backup \
--schedule "0 2 * * *" \
--workflow "sync backup ~/data remote:backup"
Example 3: Git Commit Helper
# Already included as built-in workflow
mcli run git-commit
# Or create your own variant
mcli commands export git-commit --script --output my_git_helper.py
# Edit my_git_helper.py to customize
mcli commands import my_git_helper.py --name my-git
🔧 Workflow Structure
Each workflow is a JSON file with this structure:
{
"name": "my-workflow",
"group": "workflow",
"description": "Does something useful",
"version": "1.0",
"metadata": {
"author": "you@example.com",
"tags": ["utility", "automation"]
},
"code": "import click\n\n@click.command()\ndef app():\n click.echo('Hello!')",
"updated_at": "2025-10-17T10:00:00Z"
}
🚀 Built-in Workflows
MCLI comes with powerful built-in workflows:
mcli run --help
# or use the full command: mcli workflows --help
Note: mcli run is a convenient alias for mcli workflows
Available workflows:
- pdf - Intelligent PDF processing (extract, compress, split, merge)
- clean - Enhanced Mac system cleaner
- emulator - Android/iOS emulator management
- git-commit - AI-powered commit message generation
- scheduler - Cron-like job scheduling
- daemon - Process management and daemonization
- redis - Redis cache management
- videos - Video processing and overlay removal
- sync - Multi-cloud synchronization
- politician-trading - Now available as standalone package: politician-trading-tracker
💡 Why MCLI?
The Problem
You write scripts. They work. Then:
- ❌ Can't remember where you saved them
- ❌ Hard to share with team members
- ❌ No version control or change tracking
- ❌ Coupling to specific runners or frameworks
- ❌ No easy way to schedule or daemonize
The MCLI Solution
- ✅ Centralized Storage: All workflows in
~/.mcli/workflows/ - ✅ Portable: Export/import as JSON, share anywhere
- ✅ Versioned: Lockfile for reproducibility
- ✅ Decoupled: Zero coupling to engine source code
- ✅ Flexible Execution: Run interactively, scheduled, or as daemon
- ✅ Discoverable: Tab completion, search, info commands
📚 Advanced Features
Shell Completion
# Install completion for your shell
mcli self completion install
# Now use tab completion
mcli run <TAB> # Shows all workflows
mcli run pdf <TAB> # Shows pdf subcommands
AI Chat Integration
# Chat with AI about your workflows
mcli chat
# Configure AI providers
export OPENAI_API_KEY=your-key
export ANTHROPIC_API_KEY=your-key
Self-Update
# Update MCLI to latest version
mcli self update
# Check version
mcli version
🛠️ Development
For Development or Customization
# Clone repository
git clone https://github.com/gwicho38/mcli.git
cd mcli
# Setup with UV
uv venv
uv pip install -e ".[dev]"
# Run tests
make test
# Build wheel
make wheel
📖 Documentation
- 📚 Documentation Index: Complete Documentation Index - All docs organized by category
- Installation: See Installation Guide
- Workflows: Full workflow documentation (this README)
- Shell Completion: See Shell Completion Guide
- Testing: See Testing Guide
- Contributing: See Contributing Guide
- Release Notes: See Latest Release (7.14.2)
🎯 Common Use Cases
Use Case 1: Daily Automation Scripts
# Create your daily automation
mcli new daily-tasks # Add your tasks in $EDITOR
mcli run scheduler add --name daily --schedule "0 9 * * *" --workflow daily-tasks
Use Case 2: Team Workflow Sharing
# On your machine
mcli commands export team-workflows.json
# Share file with team
# On teammate's machine
mcli commands import team-workflows.json
mcli lock verify # Ensure consistency
Use Case 3: CI/CD Integration
# In your CI pipeline
- pip install mcli-framework
- mcli commands import ci-workflows.json
- mcli run build-and-test
- mcli run deploy --env production
📦 Dependencies
Core (Always Installed)
- click: CLI framework
- rich: Beautiful terminal output
- requests: HTTP client
- python-dotenv: Environment management
Optional Features
All features are included by default as of v7.0.0. For specialized needs:
# GPU support (CUDA required)
pip install "mcli-framework[gpu]"
# Development tools
pip install "mcli-framework[dev]"
🤝 Contributing
We welcome contributions! Especially workflow examples.
- Fork the repository
- Create feature branch:
git checkout -b feature/awesome-workflow - Create your workflow
- Export it:
mcli commands export my-workflow.json - Submit PR with workflow JSON
📄 License
MIT License - see LICENSE for details.
🙏 Acknowledgments
Start transforming your scripts into portable workflows today:
pip install mcli-framework
mcli new my-first-workflow
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mcli_framework-7.14.5.tar.gz.
File metadata
- Download URL: mcli_framework-7.14.5.tar.gz
- Upload date:
- Size: 829.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fe6bb36f8be7e678155a77e82954a7fd45175183fc787716be864a60c92b6813
|
|
| MD5 |
cb295c890fa7d4f043afd87049ca7ea2
|
|
| BLAKE2b-256 |
476241f48639fb46d827e27f25e2de8904b7af56da7a87ba486f2c16c3d2d218
|
File details
Details for the file mcli_framework-7.14.5-py3-none-any.whl.
File metadata
- Download URL: mcli_framework-7.14.5-py3-none-any.whl
- Upload date:
- Size: 787.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aaa7c161a7ff2adc4b7cfc5365b8e34bb317d2ef8d86bc96f62cb2c1f044db55
|
|
| MD5 |
33ad6ca1df9d650c75162d6633661f08
|
|
| BLAKE2b-256 |
f8cd1fe0574b9be0e142f8274740a25f5b01f8c571ba1f983206b2141f9f1e79
|