Skip to main content

AI-powered command line tool using local LLM

Project description

iCMD

iCMD is a local AI-powered command-line assistant that turns natural language prompts into Linux shell commands, runs the generated command, and prints the result back to your terminal.

It uses a fine-tuned Qwen-based GGUF model hosted on Hugging Face and runs inference fully locally by downloading the appropriate llama-cli executable for your operating system.

Features

  • Converts plain-English requests into bash commands using a fine-tuned local model
  • Executes commands directly from the CLI with a simple icmd "..." interface
  • Downloads the fine-tuned model and appropriate llama-cli executable automatically on first run
  • Runs fully locally using llama-cli and GGUF weights
  • Includes basic safety blocking for dangerous commands and shell operators
  • Works offline without a hosted LLM API after the first run downloads

Usage Examples

icmd "list all files in this directory"
icmd "print the current working directory"
icmd "show hidden files"
icmd --author

Example output:

$ icmd "print the current working directory"
/home/your_root_directory

Requirements

Before using iCMD, make sure the target system has:

  • Python 3.8 or newer
  • pip, uv, or pipx for installation
  • Network access on first run so iCMD can download the fine-tuned model and execution binary.
  • A Linux, macOS, or Windows environment.

Fine-Tuned Model

iCMD uses the fine-tuned model published at:

MSDeepak718/qwen-icmd

The downloaded model file is:

qwen-icmd-q4.gguf

On first run, iCMD downloads the model to:

~/.icmd_model/qwen-icmd-q4.gguf

After that, inference runs locally using the llama-cli executable, which is also downloaded dynamically based on your operating system.

Installation

Install from PyPI with uv

For CLI tools, uv tool install is the cleanest option:

uv tool install icmd-cli

After installation:

icmd "list all files"

To upgrade later:

uv tool upgrade icmd-cli

Install with pipx

pipx install icmd-cli

How It Works

  1. You pass a natural-language prompt to icmd.
  2. If needed, the app downloads the fine-tuned GGUF model from Hugging Face.
  3. The app runs the prompt locally through the dynamically downloaded llama-cli binary.
  4. The command is cleaned and checked against a small denylist of dangerous commands and shell symbols.
  5. If the command is allowed, iCMD executes it and prints the output.

Safety Notes

iCMD includes basic filtering, but it should still be treated as a developer tool and used carefully.

The current safety layer blocks commands involving items such as:

  • destructive filesystem tools like rm and mkfs
  • privilege escalation commands like sudo and su
  • remote/network-oriented commands like curl, wget, scp, and ssh
  • shell operators such as ;, |, &, and output redirection

This is a simple safety layer, not a security sandbox.

CLI Reference

Run a natural-language request:

icmd "your query"

Print the package author:

icmd --author

If no argument is provided, the CLI shows:

Usage: icmd "your query"

Project Structure

icmd/
├── executor.py
├── llm.py
├── main.py
├── safety.py
└── utils.py
pyproject.toml
README.md

Troubleshooting

externally-managed-environment

Your system Python is managed by the OS. Use a virtual environment, uv, or pipx instead of installing globally with pip.

The first run takes time

This is expected. iCMD downloads the fine-tuned model the first time you use it.

Model download fails

Make sure you have working network access and that Hugging Face is reachable from your machine.

llama-cli download fails

If icmd fails to download the llama-cli binary on the first run, make sure your internet connection is active, or download it manually and place it in ~/.icmd_model/bin/.

The package installs but icmd fails at runtime

Check that:

~/.icmd_model/qwen-icmd-q4.gguf
  • the model file exists locally in ~/.icmd_model/
  • the installed package version is the latest one you published
  • the llama-cli binary was successfully downloaded to ~/.icmd_model/bin/

Author

Built with ❤️ By Deepak Karthick

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

icmd_cli-0.2.0.tar.gz (6.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

icmd_cli-0.2.0-py3-none-any.whl (7.8 kB view details)

Uploaded Python 3

File details

Details for the file icmd_cli-0.2.0.tar.gz.

File metadata

  • Download URL: icmd_cli-0.2.0.tar.gz
  • Upload date:
  • Size: 6.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for icmd_cli-0.2.0.tar.gz
Algorithm Hash digest
SHA256 4e283ad455276715e9f07650a2e276905491c773a0cc39ebd01ce2cf9ea4464a
MD5 ce410518e262b3101d9444ebe85e527d
BLAKE2b-256 3dcbf3ac02386cdaf9a468dee0d233ebfafe121ada053904613d93507a82207a

See more details on using hashes here.

File details

Details for the file icmd_cli-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: icmd_cli-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 7.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for icmd_cli-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9d674acd1c8f312bb4e8a0db8279d5add6b7aff35750f131aab74cfb15290750
MD5 350885449bba37b6190b7b87e6990fe5
BLAKE2b-256 35cbb1fc85b7df6467373f4514e7436b66200741759a84549767b3313eba4541

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page