natilah-smre 0.2.2

SMRE — a free-to-install proprietary agent for AI memory virtualization analysis, connected to the Natilah Cloud Platform.

natilah-smre

Super Memory Reduction Engine for AI workloads.

SMRE is a free-to-install, closed-source memory virtualization tool for AI infrastructure. Teams deploy the lightweight SMRE Agent on their own machines, GPU servers, and clusters to measure memory pressure across model workloads. Advanced optimization logic, recommendations, benchmarking, dashboards, and cluster-wide insights are processed through the proprietary Natilah Cloud Platform.

Product Model

The public package is the SMRE Agent. It is designed to be frictionless to install and safe to run on developer machines or production infrastructure.

The SMRE Agent can locally inspect:

• GPU VRAM inventory and utilization when nvidia-smi is available
• CPU RAM inventory and utilization
• SMRE vault physical size, logical size, and deduplication ratio
• Base-model and adapter residency accounting
• Basic model-library density signals

Natilah Cloud processes the proprietary layer:

• KV-cache usage analysis
• Fragmentation and allocator efficiency analysis
• Deduplication opportunity discovery
• Model residency efficiency scoring
• Optimization recommendations
• Benchmarking and workload simulation
• Cluster-wide memory insights
• Cost savings reports
• Memory efficiency scores
• Workload density metrics
• Real-time dashboards
• Enterprise integrations

The SMRE engine, algorithms, optimization models, analytics, recommendation logic, and benchmarking logic remain proprietary.

Install

pip install natilah-smre

The PyPI package and primary installed command are both natilah-smre. Python imports use natilah_smre because import names cannot contain hyphens.

Optional extras are available for environments that need Hugging Face model inspection or GPU validation:

pip install "natilah-smre[hf]"
pip install "natilah-smre[gpu]"
pip install "natilah-smre[serve]"
pip install "natilah-smre[all]"

Local development install from this checkout:

pip install -e .

Agent Usage

Run a local scan without a cloud account:

natilah-smre agent scan

Print the full local report as JSON:

natilah-smre agent scan --json

Connect the agent to Natilah Cloud:

natilah-smre login --key <your-smre-api-key>
natilah-smre status
natilah-smre agent scan --upload

API keys are read from SMRE_API_KEY or stored in ~/.smre/config. The default API base is https://api.natilah.com; override it with SMRE_API_BASE for private deployments.

Local Vault

The agent includes a local model vault for measuring base-model reuse and adapter residency. It stores one base model once and accounts for adapters or fine-tunes separately so SMRE can report the difference between naive residency and base-plus-adapter residency.

natilah-smre add-base instruct Qwen/Qwen2.5-0.5B-Instruct
natilah-smre add-adapter task13 wuyanzu4692/task-13-Qwen-Qwen2.5-0.5B-Instruct --base instruct
natilah-smre list
natilah-smre load instruct --out ./out

The default vault is ~/.smre/vault. Override it with --vault or SMRE_VAULT.

Repository Layout

natilah_smre/          # Python package for natilah-smre
  agent.py              # lightweight local SMRE Agent telemetry
  cli.py                # natilah-smre command: login, status, agent scan, vault commands
  store.py              # local content-addressed vault accounting
  dedup.py              # local block-level deduplication accounting
  hf_io.py              # optional Hugging Face model loading helpers
  model_store.py        # local base-plus-delta model accounting helpers
  tensor_compression.py # local compatibility utilities
experiments/
  *.py                  # validation and measurement experiments

License

SMRE is proprietary software. Installation and basic local agent usage are free, but the software is not open source. See LICENSE.