AI-powered command line tool using local LLM
Project description
iCMD
iCMD is a local AI-powered command-line assistant that turns natural language prompts into Linux shell commands, runs the generated command, and prints the result back to your terminal.
It uses a fine-tuned Qwen-based GGUF model hosted on Hugging Face and runs inference fully locally by downloading the appropriate llama-cli executable for your operating system.
Features
- Converts plain-English requests into bash commands using a fine-tuned local model
- Executes commands directly from the CLI with a simple
icmd "..."interface - Downloads the fine-tuned model and appropriate
llama-cliexecutable automatically on first run - Runs fully locally using
llama-cliand GGUF weights - Includes basic safety blocking for dangerous commands and shell operators
- Works offline without a hosted LLM API after the first run downloads
Usage Examples
icmd "list all files in this directory"
icmd "print the current working directory"
icmd "show hidden files"
icmd --author
Example output:
$ icmd "print the current working directory"
/home/your_root_directory
Requirements
Before using iCMD, make sure the target system has:
- Python 3.8 or newer
pip,uv, orpipxfor installation- Network access on first run so
iCMDcan download the fine-tuned model and execution binary. - A Linux, macOS, or Windows environment.
Fine-Tuned Model
iCMD uses the fine-tuned model published at:
MSDeepak718/qwen-icmd
The downloaded model file is:
qwen-icmd-q4.gguf
On first run, iCMD downloads the model to:
~/.icmd_model/qwen-icmd-q4.gguf
After that, inference runs locally using the llama-cli executable, which is also downloaded dynamically based on your operating system.
Installation
Install from PyPI with uv
For CLI tools, uv tool install is the cleanest option:
uv tool install icmd-cli
After installation:
icmd "list all files"
To upgrade later:
uv tool upgrade icmd-cli
Install with pipx
pipx install icmd-cli
How It Works
- You pass a natural-language prompt to
icmd. - If needed, the app downloads the fine-tuned GGUF model from Hugging Face.
- The app runs the prompt locally through the dynamically downloaded
llama-clibinary. - The command is cleaned and checked against a small denylist of dangerous commands and shell symbols.
- If the command is allowed,
iCMDexecutes it and prints the output.
Safety Notes
iCMD includes basic filtering, but it should still be treated as a developer tool and used carefully.
The current safety layer blocks commands involving items such as:
- destructive filesystem tools like
rmandmkfs - privilege escalation commands like
sudoandsu - remote/network-oriented commands like
curl,wget,scp, andssh - shell operators such as
;,|,&, and output redirection
This is a simple safety layer, not a security sandbox.
CLI Reference
Run a natural-language request:
icmd "your query"
Print the package author:
icmd --author
If no argument is provided, the CLI shows:
Usage: icmd "your query"
Project Structure
icmd/
├── executor.py
├── llm.py
├── main.py
├── safety.py
└── utils.py
pyproject.toml
README.md
Troubleshooting
externally-managed-environment
Your system Python is managed by the OS. Use a virtual environment, uv, or pipx instead of installing globally with pip.
The first run takes time
This is expected. iCMD downloads the fine-tuned model the first time you use it.
Model download fails
Make sure you have working network access and that Hugging Face is reachable from your machine.
llama-cli download fails
If icmd fails to download the llama-cli binary on the first run, make sure your internet connection is active, or download it manually and place it in ~/.icmd_model/bin/.
The package installs but icmd fails at runtime
Check that:
~/.icmd_model/qwen-icmd-q4.gguf
- the model file exists locally in
~/.icmd_model/ - the installed package version is the latest one you published
- the
llama-clibinary was successfully downloaded to~/.icmd_model/bin/
Author
Built with ❤️ By Deepak Karthick
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file icmd_cli-0.2.1.tar.gz.
File metadata
- Download URL: icmd_cli-0.2.1.tar.gz
- Upload date:
- Size: 6.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4fd3e425a7c0cdec0ef033541c8de6be5601899eda78cacd1287573e6177e9a4
|
|
| MD5 |
2b73042ae9f7975478804ee95f8e8104
|
|
| BLAKE2b-256 |
e6db6aff022827e1047d6b29231f836975a755f4d041fc897d5538333fe8fa19
|
File details
Details for the file icmd_cli-0.2.1-py3-none-any.whl.
File metadata
- Download URL: icmd_cli-0.2.1-py3-none-any.whl
- Upload date:
- Size: 7.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c10b4d20cab1cda4fdd3d4e4b396f01bebd0b35780cc26d5235a1eaebac5c4af
|
|
| MD5 |
eb136dd0ce3a8e242fddbe55687ffb50
|
|
| BLAKE2b-256 |
8f8d6d9e1bce482a6fb0b9e00795ba3f4df4eb243b5a8739de60a998a9753ff4
|